Bytedance Latentsync
Playground
Try it on WavespeedAI!Bytedance LatentSync combines Stable Diffusion and TREPA for high-res end-to-end lip-sync, delivering precise, realistic mouth motions in generated videos. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.
Features
ByteDance LatentSync
ByteDance LatentSync is an advanced AI-powered lip synchronization model that matches video lip movements to any audio track. Upload a video and audio file, and the model automatically adjusts the speaker’s lips to perfectly sync with the new audio — ideal for dubbing, translation, and content localization.
Why It Stands Out
- Precise lip synchronization: AI analyzes audio and adjusts lip movements frame by frame for natural results.
- Latent-based approach: Advanced latent space manipulation for high-quality, realistic output.
- Audio replacement: Sync any audio track to existing video footage seamlessly.
- High-quality output: Produces realistic lip movements that blend naturally with the original video.
- Simple workflow: Just upload audio and video — no manual editing required.
Parameters
| Parameter | Required | Description |
|---|---|---|
| audio | Yes | Audio file to sync (upload or public URL). |
| video | Yes | Video file with the face to be synced (upload or public URL). |
How to Use
- Upload your audio — drag and drop a file or paste a public URL.
- Upload your video — provide the video containing the face to be lip-synced.
- Click Run and wait for processing.
- Preview and download the lip-synced video.
Best Use Cases
- Video Dubbing — Replace original audio with dubbed versions in different languages.
- Content Localization — Adapt videos for international audiences with synced translations.
- Film & TV Production — Fix audio sync issues or replace dialogue in post-production.
- Marketing & Advertising — Create localized ad content without reshooting.
- E-learning — Produce multilingual training videos from a single source.
- Social Media — Create fun lip-sync content for entertainment.
Pricing
| Duration | Price |
|---|---|
| 5 seconds | $0.15 |
| 30 seconds | $0.90 |
| 60 seconds | $1.80 |
Billing Rules
- Billed per 5 seconds of audio at $0.15
- Minimum charge: 5 seconds
- Maximum billable duration: 600 seconds (10 minutes)
Pro Tips for Best Quality
- Use clear, high-quality audio for best lip-sync accuracy.
- Ensure the face in the video is clearly visible and well-lit.
- Front-facing videos with minimal head movement produce the best results.
- Keep audio and video durations matched for optimal synchronization.
- For best results, use videos where the speaker’s mouth is clearly visible throughout.
Notes
- Ensure uploaded audio and video URLs are publicly accessible.
- Maximum billable duration is 600 seconds (10 minutes) per job.
- Processing time varies based on video length and current queue load.
- Please ensure your content complies with usage guidelines.
Authentication
For authentication details, please refer to the Authentication Guide.
API Endpoints
Submit Task & Query Result
# Submit the task
curl --location --request POST "https://api.wavespeed.ai/api/v3/bytedance/latentsync" \
--header "Content-Type: application/json" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}" \
--data-raw '{}'
# Get the result
curl --location --request GET "https://api.wavespeed.ai/api/v3/predictions/${requestId}/result" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}"
Parameters
Task Submission Parameters
Request Parameters
| Parameter | Type | Required | Default | Range | Description |
|---|---|---|---|---|---|
| audio | string | Yes | - | - | The audio for generating the output. |
| video | string | Yes | - | The video for generating the output. |
Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data.id | string | Unique identifier for the prediction, Task Id |
| data.model | string | Model ID used for the prediction |
| data.outputs | array | Array of URLs to the generated content (empty when status is not completed) |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.has_nsfw_contents | array | Array of boolean values indicating NSFW detection for each output |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |
Result Request Parameters
| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
| id | string | Yes | - | Task ID |
Result Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data | object | The prediction data object containing all details |
| data.id | string | Unique identifier for the prediction, the ID of the prediction to get |
| data.model | string | Model ID used for the prediction |
| data.outputs | string | Array of URLs to the generated content (empty when status is not completed). |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |