digital-human
Bytedance LatentSync combines Stable Diffusion and TREPA for high-res end-to-end lip-sync, delivering precise, realistic mouth motions in generated videos. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.
Input
Idle
Your request will cost $0.15 per run.
For $10 you can run this model approximately 66 times.
ExamplesView all
README
ByteDance LatentSync
ByteDance LatentSync is an advanced AI-powered lip synchronization model that matches video lip movements to any audio track. Upload a video and audio file, and the model automatically adjusts the speaker's lips to perfectly sync with the new audio — ideal for dubbing, translation, and content localization.
Why It Stands Out
- Precise lip synchronization: AI analyzes audio and adjusts lip movements frame by frame for natural results.
- Latent-based approach: Advanced latent space manipulation for high-quality, realistic output.
- Audio replacement: Sync any audio track to existing video footage seamlessly.
- High-quality output: Produces realistic lip movements that blend naturally with the original video.
- Simple workflow: Just upload audio and video — no manual editing required.
Parameters
| Parameter | Required | Description |
|---|---|---|
| audio | Yes | Audio file to sync (upload or public URL). |
| video | Yes | Video file with the face to be synced (upload or public URL). |
How to Use
- Upload your audio — drag and drop a file or paste a public URL.
- Upload your video — provide the video containing the face to be lip-synced.
- Click Run and wait for processing.
- Preview and download the lip-synced video.
Best Use Cases
- Video Dubbing — Replace original audio with dubbed versions in different languages.
- Content Localization — Adapt videos for international audiences with synced translations.
- Film & TV Production — Fix audio sync issues or replace dialogue in post-production.
- Marketing & Advertising — Create localized ad content without reshooting.
- E-learning — Produce multilingual training videos from a single source.
- Social Media — Create fun lip-sync content for entertainment.
Pricing
| Duration | Price |
|---|---|
| 5 seconds | $0.15 |
| 30 seconds | $0.90 |
| 60 seconds | $1.80 |
Billing Rules
- Billed per 5 seconds of audio at $0.15
- Minimum charge: 5 seconds
- Maximum billable duration: 600 seconds (10 minutes)
Pro Tips for Best Quality
- Use clear, high-quality audio for best lip-sync accuracy.
- Ensure the face in the video is clearly visible and well-lit.
- Front-facing videos with minimal head movement produce the best results.
- Keep audio and video durations matched for optimal synchronization.
- For best results, use videos where the speaker's mouth is clearly visible throughout.
Notes
- Ensure uploaded audio and video URLs are publicly accessible.
- Maximum billable duration is 600 seconds (10 minutes) per job.
- Processing time varies based on video length and current queue load.
- Please ensure your content complies with usage guidelines.