Comprehensive Runway AI video generation and editing commands and workflows for creative content creation.
Getting Started
| Command | Description |
|---|
runway auth login | Login to Runway account |
runway auth logout | Logout from account |
runway auth status | Check authentication status |
runway --version | Show version information |
runway --help | Show help information |
Video Generation Models
| Model | Description |
|---|
Gen-3 Alpha | Latest video generation model |
Gen-2 | Previous generation model |
Gen-1 | First generation model |
Image-to-Video | Convert images to video |
Text-to-Video | Generate video from text |
Text-to-Video Generation
| Command | Description |
|---|
runway generate --prompt "A cat walking" | Basic text-to-video |
runway generate --prompt "..." --duration 4 | Set video duration |
runway generate --prompt "..." --aspect-ratio 16:9 | Set aspect ratio |
runway generate --prompt "..." --model gen-3 | Specify model |
runway generate --prompt "..." --seed 12345 | Set random seed |
Image-to-Video Generation
| Command | Description |
|---|
runway img2vid --image input.jpg --prompt "..." | Image to video |
runway img2vid --image input.jpg --motion low | Low motion |
runway img2vid --image input.jpg --motion high | High motion |
runway img2vid --image input.jpg --duration 4 | Set duration |
| Tool | Description |
|---|
Inpainting | Remove/replace objects |
Upscaling | Increase video resolution |
Frame Interpolation | Smooth slow motion |
Green Screen | Background removal |
Motion Tracking | Track object movement |
API Integration
| Endpoint | Description |
|---|
POST /v1/generate | Generate video |
GET /v1/tasks/{task_id} | Check generation status |
GET /v1/models | List available models |
POST /v1/upload | Upload reference image |
GET /v1/credits | Check credit balance |
Python SDK
| Command | Description |
|---|
pip install runway-python | Install Python SDK |
from runway import RunwayML | Import SDK |
client = RunwayML(api_key="key") | Initialize client |
client.generate_video(prompt="...") | Generate video |
client.get_task_status(task_id) | Check status |
Video Parameters
| Parameter | Description |
|---|
prompt | Text description |
duration | Video length (1-10 seconds) |
aspect_ratio | Video dimensions |
motion | Motion intensity |
seed | Reproducibility seed |
model | Generation model |
Aspect Ratios
| Ratio | Description |
|---|
16:9 | Widescreen (1920x1080) |
9:16 | Vertical (1080x1920) |
1:1 | Square (1080x1080) |
4:3 | Standard (1440x1080) |
3:4 | Portrait (1080x1440) |
Motion Controls
| Setting | Description |
|---|
motion: 1 | Minimal motion |
motion: 5 | Moderate motion |
motion: 10 | Maximum motion |
camera_motion: pan | Camera panning |
camera_motion: zoom | Camera zooming |
Advanced Features
| Feature | Description |
|---|
Director Mode | Precise camera control |
Motion Brush | Paint motion areas |
Lip Sync | Sync audio to video |
Style Transfer | Apply artistic styles |
Multi-Motion Brush | Multiple motion regions |
Prompt Engineering
| Technique | Description |
|---|
Descriptive language | Detailed scene description |
Camera angles | Specify viewpoint |
Lighting conditions | Set mood and atmosphere |
Movement description | Define motion patterns |
Style keywords | Artistic direction |
Quality Settings
| Setting | Description |
|---|
quality: draft | Fast, lower quality |
quality: standard | Balanced quality/speed |
quality: high | Best quality, slower |
resolution: 720p | HD resolution |
resolution: 1080p | Full HD resolution |
Batch Processing
| Command | Description |
|---|
runway batch --input prompts.txt | Process multiple prompts |
runway batch --images folder/ | Process image folder |
runway batch --config batch.json | Use batch configuration |
runway batch --parallel 3 | Set parallel jobs |
Project Management
| Command | Description |
|---|
runway project create "My Project" | Create new project |
runway project list | List projects |
runway project open <project_id> | Open project |
runway project delete <project_id> | Delete project |
runway project export <project_id> | Export project |
Asset Management
| Command | Description |
|---|
runway upload --file video.mp4 | Upload video |
runway upload --file image.jpg | Upload image |
runway assets list | List uploaded assets |
runway assets delete <asset_id> | Delete asset |
runway download <asset_id> | Download asset |
Collaboration Features
| Command | Description |
|---|
runway share --project <id> | Share project |
runway collaborate --invite <email> | Invite collaborator |
runway permissions --user <email> --role editor | Set permissions |
runway comments --add "Great work!" | Add comment |
Export Options
| Format | Description |
|---|
mp4 | Standard video format |
mov | QuickTime format |
gif | Animated GIF |
webm | Web-optimized format |
frames | Individual frames |
CLI Configuration
| Command | Description |
|---|
runway config set api_key <key> | Set API key |
runway config set default_model gen-3 | Set default model |
runway config show | Show configuration |
runway config reset | Reset to defaults |
Monitoring and Status
| Command | Description |
|---|
runway status | Check service status |
runway queue | View generation queue |
runway credits | Check credit balance |
runway usage | View usage statistics |
runway history | View generation history |
Error Handling
| Error | Description |
|---|
INSUFFICIENT_CREDITS | Not enough credits |
INVALID_PROMPT | Prompt violates guidelines |
GENERATION_FAILED | Technical failure |
QUEUE_FULL | System overloaded |
TIMEOUT | Generation timeout |
Best Practices
| Practice | Description |
|---|
Clear prompts | Specific, detailed descriptions |
Appropriate duration | Match content to length |
Consistent style | Maintain visual coherence |
Test iterations | Refine through experimentation |
Credit management | Monitor usage |
Integration Examples
| Platform | Use Case |
|---|
Social Media | Content creation |
Marketing | Advertisement videos |
Education | Instructional content |
Entertainment | Creative projects |
Prototyping | Concept visualization |
Webhook Configuration
| Command | Description |
|---|
runway webhook create --url <url> | Create webhook |
runway webhook list | List webhooks |
runway webhook delete <id> | Delete webhook |
runway webhook test <id> | Test webhook |
Advanced Prompting
| Technique | Example |
|---|
Scene setting | ”A bustling Tokyo street at night” |
Camera movement | ”Slow zoom into character’s face” |
Lighting | ”Golden hour lighting, soft shadows” |
Style reference | ”In the style of Studio Ghibli” |
Motion description | ”Gentle swaying of tree branches” |
| Setting | Description |
|---|
--fast | Prioritize speed |
--quality | Prioritize quality |
--cache | Enable result caching |
--parallel | Parallel processing |
--optimize | Optimize for efficiency |
Troubleshooting
| Issue | Solution |
|---|
Slow generation | Check queue status |
Poor quality | Improve prompt specificity |
Motion artifacts | Adjust motion settings |
Credit depletion | Purchase more credits |
API errors | Check authentication |
Environment Variables
| Variable | Description |
|---|
RUNWAY_API_KEY | API authentication key |
RUNWAY_API_URL | API base URL |
RUNWAY_TIMEOUT | Request timeout |
RUNWAY_CACHE_DIR | Cache directory |
Configuration Files
| File | Description |
|---|
.runway.json | Project configuration |
runway.config.js | Global settings |
prompts.txt | Batch prompts |
styles.json | Style presets |
Community and Resources
| Resource | Description |
|---|
Discord | Community support |
Documentation | Official guides |
Tutorials | Learning resources |
Gallery | Inspiration showcase |
Blog | Latest updates |