To get started, navigate to your Dashboard and click Generate Talking Video - Start with Video.This will open the upload dialog, where you can drag and drop your video files or click to upload. You can also paste a link to upload your video.
In addition, you can also create a project from the Translate & Dub or Edit Script & Dub projects by clicking the Lip Sync Tab on the left side. This will allow you to use the new dubbing to drive the lip sync.
Standard Mode uses a fast, general-purpose model to generate results quickly. It’s suitable for most cases but may offer average quality on complex videos.
Precision Mode trains a model specifically for your video, learning its facial characteristics for higher-quality results. It takes longer to process but provides better accuracy.
If only one face appears throughout the video, select “Only 1 Face”. If multiple faces appear (including non-speaking or animated faces), select “Auto-Detect” and manually select the faces for lip sync.
Once the video is generated, you can preview the lip-synced result.If you find that Lip Sync has been applied to the wrong face or to a segment where it shouldn’t have been synced, you can easily make edits in the Lip Sync editor.