Get Started
Lip Sync allows you to sync the lip movements of people in the video with the audio, supporting both single and multiple speakers.
Create a Project
Upload Video
To get started, navigate to your Dashboard and click Generate Talking Video - Start with Video.
This will open the upload dialog, where you can drag and drop your video files or click to upload. You can also paste a link to upload your video.
In addition, you can also create a project from the Translate & Dub or Edit Script & Dub projects by clicking the Lip Sync Tab on the left side. This will allow you to use the new dubbing to drive the lip sync.
Input Audio
Next, you can use Text-to-Speech, upload an audio file, or use the audio from the video itself for lip-syncing.
Generation Mode
There are two generation modes available for lip sync:
- Standard Mode uses a fast, general-purpose model to generate results quickly. It’s suitable for most cases but may offer average quality on complex videos.
- Precision Mode trains a model specifically for your video, learning its facial characteristics for higher-quality results. It takes longer to process but provides better accuracy.
Number of Faces Appeared in the Video
If only one face appears throughout the video, select “Only 1 Face”. If multiple faces appear (including non-speaking or animated faces), select “Auto-Detect” and manually select the faces for lip sync.
Edit the Lip Sync Face
Once the video is generated, you can preview the lip-synced result.
If you find that Lip Sync has been applied to the wrong face or to a segment where it shouldn’t have been synced, you can easily make edits in the Lip Sync editor.
Download the Video
If you are satisfied with the video, click the Download/Export button in the top-right corner to download the lip-synced video.