Create a Project

Upload Video

To get started, navigate to your Dashboard and click Generate Talking Video - Start with Video.

This will open the upload dialog, where you can drag and drop your video files or click to upload. You can also paste a link to upload your video.

In addition, you can also create a project from the Translate & Dub or Edit Script & Dub projects by clicking the Lip Sync Tab on the left side. This will allow you to use the new dubbing to drive the lip sync.

Input Audio

Next, you can use Text-to-Speech, upload an audio file, or use the audio from the video itself for lip-syncing.

Generation Mode

There are two generation modes available for lip sync:

  • Standard Mode uses a fast, general-purpose model to generate results quickly. It’s suitable for most cases but may offer average quality on complex videos.
  • Precision Mode trains a model specifically for your video, learning its facial characteristics for higher-quality results. It takes longer to process but provides better accuracy.

Number of Faces Appeared in the Video

If only one face appears throughout the video, select “Only 1 Face”. If multiple faces appear (including non-speaking or animated faces), select “Auto-Detect” and manually select the faces for lip sync.

Edit the Lip Sync Face

Once the video is generated, you can preview the lip-synced result.

If you find that Lip Sync has been applied to the wrong face or to a segment where it shouldn’t have been synced, you can easily make edits in the Lip Sync editor.

Download the Video

If you are satisfied with the video, click the Download/Export button in the top-right corner to download the lip-synced video.