Runway AI Cheatsheet (May 2025)

Runway AI Cheatsheet

A comprehensive guide to Runway's AI features, capabilities, and pricing as of May 2025

What is Runway?

Runway ML is an applied AI research company focused on advancing creativity through artificial intelligence, offering advanced tools for art, entertainment, and human expression. The platform specializes in generative AI models that help transform ideas into visual reality with minimal technical knowledge required.

Core Technology Offerings

General World Models

AI systems that understand and generate comprehensive visual environments

Multi-Motion Brush

Sophisticated motion control in generated videos

Gen-4

Their latest and most powerful generative AI system (released April 2025)

NEW

Latest Updates (as of May 2025)

Late April 2025: Enhanced ControlNet & Camera Paths for Gen-4 NEW +

Runway rolled out improved ControlNet functionalities for Gen-4, offering more precise structural guidance in video generation. Additionally, new camera path options provide users with more dynamic and customizable camera movements within their generated scenes.

April 1, 2025: Gen-4 Release +

Runway's latest Gen-4 model has been released to all subscription users, offering dramatic improvements in consistency, control, and visual quality.

March 6, 2025: Restyle Video Feature +

New Restyle Video feature added to Gen-3 Alpha and Turbo, allowing users to transform the visual aesthetic of videos using reference images.

February 22, 2025: Frames Enhancements +

New features added to Frames for enhanced image generation, providing more stylistic control and improved visual fidelity.

Runway's latest features are available to all subscription tiers, but may use different amounts of credits depending on your plan. Always check the official Runway blog for the very latest announcements.

Runway's AI Model Ecosystem

Runway offers several cutting-edge AI models with varying capabilities, each specialized for different creative tasks.

Gen-4 NEW

Released April 2025, Gen-4 is Runway's most advanced video generation system.

  • Character Consistency: Maintains consistent characters across different scenes and shots
  • Coherent Environments: Creates stable, persistent world environments throughout videos
  • Perspective Control: Can regenerate elements from different angles within scenes
  • Visual References: Utilizes reference images combined with text instructions
  • Enhanced Control: Features like advanced camera paths and improved ControlNet integration.

Gen-3 Alpha

High-quality video generation model with improved fidelity and control.

  • Video Quality: Improved fidelity, consistency, and motion compared to previous models
  • Video Length: Supports up to 40-second videos through extensions
  • Camera Control: Options for static camera and handheld camera shake effects
  • Restyle Feature: Ability to apply visual styles from reference images to videos.

Frames

Advanced image generation model for high-fidelity still images.

  • High-Fidelity Images: Advanced base model for detailed image creation
  • Stylistic Control: Superior control over visual details and aesthetic
  • Reference Processing: Convert reference images to text prompts and custom styles

Model Feature Comparison

FeatureGen-4Gen-3 AlphaFrames
Character Consistency✓✓✓✓✓N/A
Environmental Coherence✓✓✓✓✓N/A
Multi-Motion Control✓✓✓✓✓N/A
Advanced Camera Control✓✓✓N/A
Text Prompt Complexity✓✓✓✓✓✓✓✓
Reference Image Use✓✓✓✓✓✓✓✓
Video Creation Toolset

Runway provides comprehensive tools for generating, editing, and enhancing video content through AI.

Video Creation Methods

Text-to-Video

Generate videos directly from text descriptions with support for various styles and cinematic controls.

Image-to-Video

Transform static images into dynamic videos with first frame control and detailed text prompting.

Video-to-Video

Apply different styles to existing videos while preserving motion and structure, including the Restyle feature.

Video Editing Features

  • 4K Resolution: Upscale video to 4K for professional output
  • Extension: Extend clips beyond original length (up to 40 seconds with Gen-3, potentially longer or higher quality with Gen-4)
  • Expand Video: Transform videos into new aspect ratios
  • Editing Tools: Trim, reverse, adjust video speed
  • Background Removal: Isolate subjects from backgrounds
  • Color Grading: Text-based color adjustment

Special Effects and Controls

Multi-Motion Brush+
  • Define up to five unique areas with individual motion parameters
  • Auto-detect feature for key elements in input images
  • Apply to extended clips in video generation
Camera Control & Paths ENHANCED+
  • Direction and intensity controls for camera movement
  • Static camera option to reduce motion
  • Handheld camera shake simulation with adjustable parameters
  • Advanced camera path definitions for more complex shots (especially in Gen-4)
Act-One+
  • Animate still character images using video input
  • Create expressive character performances
  • Support for both horizontal and vertical video formats
ControlNet Integration ENHANCED+
  • Use reference images or videos to guide the structure, composition, or style of generated videos.
  • Enhanced capabilities with Gen-4 for more precise control over elements like depth, edges, and pose.

For best results with video generation, start with a clear main subject in your prompt, then add visual details, camera specifications, lighting information, and style references. Utilize features like Multi-Motion Brush and Camera Paths to refine your output.

Image Generation & Editing

Runway's image tools allow for high-fidelity image creation with precise stylistic control.

Frames Image Model

Advanced base model for high-fidelity image creation with superior control.

  • Advanced base model for high-fidelity image creation
  • Superior stylistic control and visual detail
  • Reference image conversion to text prompts and custom styles

Image Capabilities

Frames can:

  • Generate images up to 1024×1024 resolution (and potentially higher with upscaling tools)
  • Accept text prompts with detailed descriptions
  • Use reference images as style guides or structural input
  • Maintain coherent visual aesthetics
  • Create diverse artistic styles and realistic images

When creating images to use as video generation references (e.g., for Image-to-Video or style references), focus on clear composition with defined foreground subjects and uncluttered backgrounds for optimal results.

Audio Capabilities

Runway provides various audio generation and transformation tools to complement its visual features.

Audio Features

Text-to-Speech

  • Convert text to natural-sounding voice
  • Support for up to 10,000 characters
  • Multiple voice options and styles

Speech-to-Speech

  • Retain content, pace, and tone while changing voice
  • Natural voice transformation

Lip Sync

  • Match facial movements to audio tracks
  • Support for multiple faces simultaneously
  • Videos up to 45 seconds in length

Custom Voices

Runway allows you to create personalized voices from short audio samples (available in Pro plan and higher):

  • Create personalized voices from short audio samples
  • Share with workspace collaborators
  • Requires explicit user consent for creation
Pricing Plans (May 2025)

Runway offers several pricing tiers to accommodate different needs and usage levels.

PlanPriceCreditsKey Features
Free$0125 one-time
  • Create up to 3 projects
  • Limited features and tools
  • 5GB storage
  • Access to older/basic models
Standard$15/mo
$12/mo (yearly)
625 monthly
  • Basic video and image generation (Gen-3, Frames)
  • 5GB assets storage (may be higher)
  • Up to 720p export (may include 1080p)
  • Some Gen-4 access (limited credits)
Pro$35/mo
$28/mo (yearly)
2,250 monthly
  • Full access to Gen-4, Gen-3, Frames
  • 4K upscaling
  • Watermark removal
  • Unlimited video projects
  • Custom AI generators
  • 100GB storage (may be higher)
  • Custom Voices
Unlimited$95/mo
$76/mo (yearly)
Higher allocation (e.g., 10,000+) or truly unlimited for certain tasks.
  • All Pro features
  • Highest credit allocation or unlimited generations for specific models/features
  • Priority feature access & support
  • Higher generation limits
EnterpriseCustom (starts ~$1500/year)Custom amounts
  • Advanced security and compliance
  • Ongoing support programs
  • Model customizations & fine-tuning
  • Enterprise-wide support
  • Integration with internal tools
  • Dedicated account management

Note: Pricing, credit allocations, and specific feature availability per plan are subject to change. Always refer to the official RunwayML website for the most up-to-date and detailed information.

Credit System Explained

Credits are the currency used within Runway ML to generate content:

  • Different generation types consume varying amounts of credits (e.g., Gen-4 video costs more than Gen-3)
  • Higher quality outputs, longer videos, and advanced features use more credits
  • Credits refresh monthly based on your subscription plan or can be purchased as top-ups.

For teams or frequent users, the Pro or Unlimited plans offer the best balance of features and credit allocation. Individuals starting out may find the Standard plan sufficient, but should monitor credit usage with newer models like Gen-4.

Prompting Best Practices

Effective prompting is key to getting the best results from Runway's AI models.

Do's

  • Be descriptive: Focus on visual details rather than abstract concepts. Describe what you want to see.
  • Think cinematically: Describe what the "camera" is capturing, including shot types, angles, and movement.
  • Use technical terms: Include camera specifications (e.g., "35mm lens," "wide angle"), lens types, lighting terms ("golden hour," "volumetric lighting").
  • Keep it direct: Use simple, clear language that describes the scene. Be specific.
  • Specify art style: (e.g., "impressionistic painting," "sci-fi concept art," "photorealistic").
  • Iterate: Start simple and add complexity. Refine prompts based on results.

Don'ts

  • Avoid conversational language: (e.g., "Can you please make me a video...")
  • Avoid command-based prompts for generation: (e.g., "Add a dog to this clip..." - use editing tools for this). For generation, describe the scene *with* the dog.
  • Don't use overly negative phrasing: (e.g., "No clouds in the sky..." - instead describe "clear blue sky"). Some negative prompts are supported but positive description is usually better.
  • Don't provide multi-shot instructions in one prompt: One prompt generally creates one continuous shot or image.
  • Avoid overly complex or contradictory descriptions in a single prompt.

Expert Prompt Structure

A good starting structure for prompts, especially for video:

[SUBJECT] + [ACTION/SETTING] + [VISUAL DETAILS/MOOD] + [CAMERA SHOT/ANGLE/MOVEMENT] + [LIGHTING] + [STYLE]

Example: "A majestic dragon soaring through a stormy sky, lightning illuminates its scales, dramatic clouds, aerial shot tracking the dragon, low angle view, rim lighting, fantasy art style, cinematic."

When working with Gen-4, focus on describing the world, characters, and their actions clearly. Gen-4 excels at maintaining consistency, so detailed descriptions of characters and environments can lead to more coherent and believable results across scenes and perspectives.

AI Mindset Footer Navigation