Skip to main content

Handbook: The Four Stages of Autopilot

Music, Track, Storyboard, Video

Updated this week

There are four total steps to the Autopilot process to get your video to the finish line. This article will detail out each page and their functionalities. Consider this handbook as a co-pilot when working on your first videos as it may help you with your process, and maybe even help or improve your projects.


Music

On this page, you'll upload the song for your Autopilot project. You will also see your library of previously uploaded songs.

To upload a song, select Upload Music. From there, your computer's directory will appear and you would select your song.


Track

There's a lot of really great functionalities on the Track page. To best understand each component, below is a screenshot with numbers that will dive into each feature.


1) Album Cover Generator

To generate a cover for your track, you can click on the πŸŒ„+ icon. A popup box will appear where you can enter your Prompt for the artwork and select a Style preset (optional). From there, click Generate and you will see your album art appear below. You can click on the album art to Expand on it, or select it and click Close. Generating an album cover uses 3 credits.


2) Title of your Song

You can change the title of your song - this is a great option if you have demos of songs you're working with, or just want to keep things organized to your liking.


3) Waveform

Helpful when creating customized durations of your video. Click anywhere on the waveform and drag both left and right to find the exact duration that you're wanting. To confirm that you've reached the correct placement, click the Play button to hear the playback from the beginning and end point of the duration.


4) Lyric Editor

When uploading your song, our AI automatically transcribes the lyrics to the song. There may be instances where you need to fine-tune the lyrics. To edit the Lyrics, click into the Lyrics box and make any necessary changes. You can play the timestamped line of lyrics and adjust the timing. You can add or delete lines of captions, too.


5) Clips

All of your previous videos for the specific uploaded track will be here. Click into a Clip and this will redirect you to the Storyboard. Helpful when creating an Autopilot draft and wanting to continue your project, or fine-tuning a specific clip or scene.


6) Aspect Ratio

Click the dropdown to select between 16:9 or 9:16 aspect ratios, perfect formats for social media.

  • 16:9 is Widescreen which is great for YouTube

  • 9:16 is great for social media, like TikTok or YouTube and Instagram reels


7) Duration Preset

While you have the ability to click on the waveform and drag it around to precisely the exact position you want, we also offer Presets which are great for social media. As an example, for a YouTube Short, your video must be under 60 seconds.


8) Video Concept

The Video Concept is where your story comes to life. This is where you would enter the type of video you're wanting, info about what your subject or character is going to be experiencing in the video. You can also mention aspects of scenery, location, and style. You can write anything in here that you want and our AI will listen to all of it.

If you don't enter a Video Concept, no worries! Our AI will create one for you based on your song.

πŸ’‘ Tips:

**** For Negative Prompting, or object/subject exclusion, you can enter NO [subject] in the Video Concept. As an example: NO: Animals, NO: Insects

**** If you don't wish to have Character Consistency, you can enter NO: Character Consistency.


9) Visual Style

Styles add visual flair to your video. Here, you have the ability to select from Preset Styles or an Autopilot Style that you've created. For more info about Autopilot Styles, check out this article.


10) Character

You can upload an image of your main character, or text prompt a consistent main character for your video. Additionally, you can select no character at all or let our AI generate a character for you based on your song. For more info, check out this article.


11) Create Video

Once you have all of your parameters locked in, click Create Video. You will see a pop-up screen that asks you to choose your Video Technique. There are three different types of techniques:

  • Classic Video: Uses default settings to create a video. The default settings are set to everything being standard - there's no blending, vocal video, or lyric showcase. However, you can enable/customize between Cut, Blend and also Lip Sync videos after generating the keyframes. Classic Video is a great option for having default options up front but then being able to select multiple parameters for your video by hand.

  • Lyric Showcase: Highlight the most lyrically meaningful moments of your song with Lyric Showcase. At the default setting, you'll see Blending from clip to clip to create immersive, beautiful background experiences to your video. For more info about Lyric Showcase, check out this article.

  • Vocal Video: Have your character sing along to specific scenes in your video. The default option has some clips enabled for Lip Sync, but you can also enable specific Keyframes to allow for Lip Sync as well. For more info about Vocal Video, check out this article.


Storyboard

The Storyboard page is where you'll see your video begin to come together - you can fine tune the project or you can let our AI take the wheel. To best understand each component, below is a screenshot with numbers that will dive into each feature.

1) Video Concept

Whether you added your Video Concept or you let our AI generate the Video Concept, you'll have the ability to make changes to this prompt box. You can be as descriptive as you want - the AI will listen to all of it.

You also have the option to Pimp My Story, which uses our AI to put an extra kick to your Video Concept. Note: Pimp My Story uses 1 credit.

πŸ’‘ Tips:

**** For Negative Prompting, or object/subject exclusion, you can enter NO [subject] in the Video Concept. As an example: NO: Animals, NO: Insects

**** If you don't wish to have Character Consistency, you can enter NO: Character Consistency.

Once you've made changes to your Video Concept, be sure to click Regenerate Scenes to have your updated Video Concept align with the scenes of your video.


2) Style

Based on attributes of your song, our AI will select a Style automatically. If you want to change the Style, you can click on the Style button. This will expand into multiple Style presets that we offer where you can view some examples of the images used for each Style. If you've trained an Autopilot Style, you can select it here.

If you make changes to your Style, be sure to Regenerate Scenes to activate the new Style for your scenes and video.


3) Scenes

The Scenes portion of the Storyboard page is where your Storyboard comes to life. With the Scenes feature, you can see the way your story will be told, based on your Video Concept. You can make changes to each Scene, and individually Regenerate Scenes, rather than the entire Storyboard.


4) Character

If you didn't assign your character, or if you want to adjust the current character based on the Storyboard scene images you're seeing, you can click into the Character feature to assign, prompt, or upload an image of your character. For more info about Character Consistency, please check out this article.


5) Regenerate Scenes

Anytime you make changes to the Video Concept, Style, or Character, you'll need to click Regenerate Scenes. This way, your changes to the Video Concept prompt and the Style that you've selected are locked in for the video. The credit value for Regenerating Scenes is listed on the button, and typically aligns with how many scenes are on the Storyboard.


6) Video Model (Keyframes and Video Cost)

Clicking on the Video Model (Keyframes cost + Video cost) will allow you to select which model you'd like to use. It's important to note that the total cost of each video you create is dependent on the duration of your track, the amount of clips needed, and the model you select.

When selecting the model, keep in mind the total cost of the video, which is the Keyframe Value + the Video Cost. In the GIF below, you can see the separate Keyframe cost and the Video Cost. You will need to add these two numbers together to get the total cost of your video. In the GIF below, the costs to create this video are:

  • Seedance V1 Lite: 1,680

  • Kling 2.1 Standard: 2,268

  • Kling 2.1 Pro: 3,052

  • Seedance V1 Pro: 5,320


7) Video Technique

If you didn't lock in the Video Technique, you can select it from this dropdown.

  • Classic Video: Uses default settings to create a video. The default settings are set to everything being standard - there's no blending, vocal video, or lyric showcase. However, you can enable/customize between Cut, Blend and also Lip Sync videos after generating the keyframes. Classic Video is a great option for having default options up front but then being able to select multiple parameters for your video by hand.

  • Lyric Showcase: Highlight the most lyrically meaningful moments of your song with Lyric Showcase. At the default setting, you'll see Blending from clip to clip to create immersive, beautiful background experiences to your video. For more info about Lyric Showcase, check out this article.

  • Vocal Video: Have your character sing along to specific scenes in your video. The default option has some clips enabled for Lip Sync, but you can also enable specific Keyframes to allow for Lip Sync as well. For more info about Vocal Video, check out this article.

8) Create Video

When clicking on the Create Video dropdown, you have the ability to Generate Starting Images first (Keyframes) so you can view each starting image individually, or you can skip straight to the full video.

Generating Starting Images to view all of the starting images, keyframe prompts and video prompts does take a bit of extra time, but avoids extra surprises and allows you to regenerate the keyframes up front, saving potential future cost in the future if needing to re-generate a clip from your video.

❗ Note: Once you click an option on this Create Video button, you cannot intercept, pause, or cancel the video. The Starting Images or Full Video begin generating automatically with no kill switch.


Video

Once you click Create Video on the previous page, you'll be taken to the Video page.

Starting Images First

When you select the Starting Images First on the Storyboard page, you have the ability to:

  • View all of the Scenes of your video

  • Select parameters for each keyframe including Cut, Blend or Lip Sync

  • Click into the Starting Images/Keyframes to view what each clip will look like at the beginning, which is an excellent indicator of how the video will look

  • Edit and Regenerate the Starting Image

  • Edit the Video Prompt to make sure that the action in the clip is exactly how you'd like it

Parameters for Cut, Blend, Lip Sync

Select how each individualclip will look by using the Cut, Blend or Lip Sync scene parameters.

Notes:

  • Seedance V1 Lite and Seedance 1 Pro are the only two models that allow for Blending

  • Lip Sync is only available on clips that have a vocal signal at that specific timestamp of the song.


Edit and Regenerate the Starting Image

When you generate the Starting Images first, this gives you a really great idea of how the video will look because you can see the exact prompt for the Starting Image, as well as the animation prompt associated with the image. You can make changes to the Starting Image and then Re-generate the image, and you can make changes to the animation prompt.

Important: When you make changes to the Starting Image, be sure to Regenerate the Keyframe. To do this, click on the πŸ”„ icon where you're editing the prompt. If you only make changes to the Video Prompt, there's no need to regenerate the keyframes at all.


Create Video

When you've finished making any necessary changes to the Starting Images and have Regenerated them, or any changes to the Video Prompts, you can click Create Video. Your video should be finished in around 10 minutes.


Full Video

When your video is complete, you have the ability to:

  • Edit the prompts for all of the Starting Images (the beginning frame of each clip)

  • Edit the prompts for the Video Prompt (the animation that occurs with each clip)

  • Edit the Cut, Blend or Lip Sync of the clip (Lip Sync must have an audio signal for the clip, Blend is only supported with Seedance V1 Lite and Seedance 1 Pro).

To begin the editing process on the Video page, scroll towards the bottom, right below the Video Player. You can click for a specific Scene to scroll through all of the clips related to a Scene, or you can click on a Scene and then select an individual clip.

You can then begin the editing process for either the Starting Image, or the Video Prompt. Once you have made adjustments, you can:

  • Regenerate the Keyframe (the Starting Image / First Frame of your video)

  • Regenerate the Video Clip

  • Regenerate the Keyframe AND the Video Clip


Did this answer your question?