A beginner guide to RunwayML Gen-2:

Hero Kominato
AI Movies & AI Video
3 min readJul 28, 2023

Ever dreamt of becoming the next Spielberg without the filming experience? In this article, I guide you through RunwayML (Not sponsored) in following topic.

  • What is RunwayML and Gen-2
  • Key Features of RunwayML
  • A Look at Different Video Generation Tool
  • Pricing (On the day I edited)
A beginner guide to RunwayML

Are you more of a visual learner? If so, watch our comprehensive YouTube video on RunwayML. But if you’re here for a detailed articles, stay with me.

What is Runway ML?

RunwayML is an applied AI research company that aims to make content creation accessible to all by taking recent advancements in computer graphics and machine learning.

RunwayML used to be a video editing tool but now it can generate video like AI image tools. Imagine crafting a video without filming any footage or the worries of coordinating with a film crew. With RunwayML, you can use its special AI to generate videos from mere text or images.

Screenshot of RunwayML editing interface
RunwayML is also a video editing tool.

Key Features of RunwayML

1. Editing Videos

  • Various edits at your fingertips: remove backgrounds or change playback speed.

2. Generating Videos

  • Craft from your imagination, leaving behind the confines of traditional filming.

Let’s look at video generation in this article.

A Closer Look at Video Generation

RunwayML comes with three standout video generation tools:

Gen1: Video to Video Feature

Firstly, RunwayML allows the transformation of any video into a different one entirely. The process is straightforward; you select a preset and the style of the video that you prefer, and the application subsequently outputs your video in the specified styles.

Additionally, you have the option to add reference image or describe the style of the images you want. Check out our recent articles on how to use Gen1 effectively!

Gen2: Text to Video Feature

The second key capability is the ‘Text to Video’ feature. With this tool, you simply describe your desired video in text form, and the application generates a result accordingly. This gives you the power to specify exactly how you’d like your video to be edited or modified.

Gen2 : Image to Video Feature (New and Best one!)

The third notable feature is the ‘Image to Video’ tool. This tool allows you to use a specific image as a starting point of a video instead of as references.

Note that if you add text, it is recognized as Text to Video feature. It’s worth noting that this might lessen some consistency or not strictly adhere to the starting point images’ aesthetics.

You can check out some of the impressive result from indie filmmaker using Gen2 model.

Use of RunwayML

Currently, using images as a starting point — the ‘Image to Video’ tool — tends to yield the most optimal results. As of now, is the most effective approach in utilizing the capabilities of RunwayML.

Harnessing the Power of AI in Filmmaking: Tips and Tricks

To get the most out of your AI filmmaking experience, we invite you to follow us for upcoming articles. These will dive deeper into how AI can generate images and create movies. Our goal is to empower you to a level where you’re capable of creating your own movies. Stay tuned!👇

--

--

Hero Kominato
AI Movies & AI Video

⭐️Sharing Tips for Filmmaking and AI assisted filmmaking.