Skip to content

Runway Commands

Comprehensive Runway AI video generation and editing commands and workflows for creative content creation.

Getting Started

Command Description
runway auth login Login to Runway account
runway auth logout Logout from account
runway auth status Check authentication status
runway --version Show version information
runway --help Show help information

Video Generation Models

Model Description
Gen-3 Alpha Latest video generation model
Gen-2 Previous generation model
Gen-1 First generation model
Image-to-Video Convert images to video
Text-to-Video Generate video from text

Text-to-Video Generation

Command Description
runway generate --prompt "A cat walking" Basic text-to-video
runway generate --prompt "..." --duration 4 Set video duration
runway generate --prompt "..." --aspect-ratio 16:9 Set aspect ratio
runway generate --prompt "..." --model gen-3 Specify model
runway generate --prompt "..." --seed 12345 Set random seed

Image-to-Video Generation

Command Description
runway img2vid --image input.jpg --prompt "..." Image to video
runway img2vid --image input.jpg --motion low Low motion
runway img2vid --image input.jpg --motion high High motion
runway img2vid --image input.jpg --duration 4 Set duration

Video Editing Tools

Tool Description
Inpainting Remove/replace objects
Upscaling Increase video resolution
Frame Interpolation Smooth slow motion
Green Screen Background removal
Motion Tracking Track object movement

API Integration

Endpoint Description
POST /v1/generate Generate video
GET /v1/tasks/{task_id} Check generation status
GET /v1/models List available models
POST /v1/upload Upload reference image
GET /v1/credits Check credit balance

Python SDK

Command Description
pip install runway-python Install Python SDK
from runway import RunwayML Import SDK
client = RunwayML(api_key="key") Initialize client
client.generate_video(prompt="...") Generate video
client.get_task_status(task_id) Check status

Video Parameters

Parameter Description
prompt Text description
duration Video length (1-10 seconds)
aspect_ratio Video dimensions
motion Motion intensity
seed Reproducibility seed
model Generation model

Aspect Ratios

Ratio Description
16:9 Widescreen (1920x1080)
9:16 Vertical (1080x1920)
1:1 Square (1080x1080)
4:3 Standard (1440x1080)
3:4 Portrait (1080x1440)

Motion Controls

Setting Description
motion: 1 Minimal motion
motion: 5 Moderate motion
motion: 10 Maximum motion
camera_motion: pan Camera panning
camera_motion: zoom Camera zooming

Advanced Features

Feature Description
Director Mode Precise camera control
Motion Brush Paint motion areas
Lip Sync Sync audio to video
Style Transfer Apply artistic styles
Multi-Motion Brush Multiple motion regions

Prompt Engineering

Technique Description
Descriptive language Detailed scene description
Camera angles Specify viewpoint
Lighting conditions Set mood and atmosphere
Movement description Define motion patterns
Style keywords Artistic direction

Quality Settings

Setting Description
quality: draft Fast, lower quality
quality: standard Balanced quality/speed
quality: high Best quality, slower
resolution: 720p HD resolution
resolution: 1080p Full HD resolution

Batch Processing

Command Description
runway batch --input prompts.txt Process multiple prompts
runway batch --images folder/ Process image folder
runway batch --config batch.json Use batch configuration
runway batch --parallel 3 Set parallel jobs

Project Management

Command Description
runway project create "My Project" Create new project
runway project list List projects
runway project open <project_id> Open project
runway project delete <project_id> Delete project
runway project export <project_id> Export project

Asset Management

Command Description
runway upload --file video.mp4 Upload video
runway upload --file image.jpg Upload image
runway assets list List uploaded assets
runway assets delete <asset_id> Delete asset
runway download <asset_id> Download asset

Collaboration Features

Command Description
runway share --project <id> Share project
runway collaborate --invite <email> Invite collaborator
runway permissions --user <email> --role editor Set permissions
runway comments --add "Great work!" Add comment

Export Options

Format Description
mp4 Standard video format
mov QuickTime format
gif Animated GIF
webm Web-optimized format
frames Individual frames

CLI Configuration

Command Description
runway config set api_key <key> Set API key
runway config set default_model gen-3 Set default model
runway config show Show configuration
runway config reset Reset to defaults

Monitoring and Status

Command Description
runway status Check service status
runway queue View generation queue
runway credits Check credit balance
runway usage View usage statistics
runway history View generation history

Error Handling

Error Description
INSUFFICIENT_CREDITS Not enough credits
INVALID_PROMPT Prompt violates guidelines
GENERATION_FAILED Technical failure
QUEUE_FULL System overloaded
TIMEOUT Generation timeout

Best Practices

Practice Description
Clear prompts Specific, detailed descriptions
Appropriate duration Match content to length
Consistent style Maintain visual coherence
Test iterations Refine through experimentation
Credit management Monitor usage

Integration Examples

Platform Use Case
Social Media Content creation
Marketing Advertisement videos
Education Instructional content
Entertainment Creative projects
Prototyping Concept visualization

Webhook Configuration

Command Description
runway webhook create --url <url> Create webhook
runway webhook list List webhooks
runway webhook delete <id> Delete webhook
runway webhook test <id> Test webhook

Advanced Prompting

Technique Example
Scene setting "A bustling Tokyo street at night"
Camera movement "Slow zoom into character's face"
Lighting "Golden hour lighting, soft shadows"
Style reference "In the style of Studio Ghibli"
Motion description "Gentle swaying of tree branches"

Performance Optimization

Setting Description
--fast Prioritize speed
--quality Prioritize quality
--cache Enable result caching
--parallel Parallel processing
--optimize Optimize for efficiency

Troubleshooting

Issue Solution
Slow generation Check queue status
Poor quality Improve prompt specificity
Motion artifacts Adjust motion settings
Credit depletion Purchase more credits
API errors Check authentication

Environment Variables

Variable Description
RUNWAY_API_KEY API authentication key
RUNWAY_API_URL API base URL
RUNWAY_TIMEOUT Request timeout
RUNWAY_CACHE_DIR Cache directory

Configuration Files

File Description
.runway.json Project configuration
runway.config.js Global settings
prompts.txt Batch prompts
styles.json Style presets

Community and Resources

Resource Description
Discord Community support
Documentation Official guides
Tutorials Learning resources
Gallery Inspiration showcase
Blog Latest updates