Ltx 2.3 Lipsync
Playground
Try it on WavespeedAI!LTX-2.3 Lipsync generates talking head videos from audio with synchronized lip movements and natural facial expressions. Built on DiT-based architecture with improved audio-visual alignment quality. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.
Features
LTX-2.3 Lipsync
LTX-2.3 Lipsync is an advanced AI model that generates talking head videos from audio and an optional reference image. Built on the LTX-2.3 DiT-based architecture with improved audio-visual quality, it creates realistic lip-synced videos that match your audio input.
Why Choose This?
-
Improved quality Enhanced audio-visual alignment with better lip sync accuracy and natural facial movements.
-
Audio-driven generation Automatically generates video with synchronized lip movements from audio input.
-
Optional reference image Provide a portrait image to use as the base, or let the model use a default portrait.
-
Flexible resolution Supports 480p, 720p, and 1080p outputs to balance quality and cost.
-
Automatic duration Video length automatically matches audio duration (5-20 seconds).
Parameters
| Parameter | Required | Description |
|---|---|---|
| audio | Yes | Audio file URL - duration determines video length (5-20s) |
| image | No | Reference portrait image (optional) |
| prompt | No | Text prompt to guide generation style and motion |
| resolution | No | Output resolution: 480p, 720p (default), or 1080p |
| seed | No | Random seed for reproducibility (-1 for random) |
Resolution Options
| Resolution | Best For |
|---|---|
| 480p | Fast previews, iteration, lowest cost |
| 720p | Balanced quality and cost (default) |
| 1080p | Final delivery, maximum detail |
How to Use
- Upload your audio — the audio track that drives the video (5-20 seconds).
- Upload reference image (optional) — a portrait to use as the base character.
- Add prompt (optional) — describe the style or motion you want.
- Select resolution — 480p for iteration, 720p for balance, 1080p for final output.
- Run — submit and download the lip-synced video.
Pricing
Pricing is based on audio duration (automatically detected):
| Resolution | 5s | 10s | 15s | 20s |
|---|---|---|---|---|
| 480p | $0.10 | $0.20 | $0.30 | $0.40 |
| 720p | $0.15 | $0.30 | $0.45 | $0.60 |
| 1080p | $0.20 | $0.40 | $0.60 | $0.80 |
Best Use Cases
- Talking Head Videos — Generate spokesperson videos from audio recordings.
- Content Localization — Create videos in multiple languages from audio tracks.
- Virtual Presenters — Generate AI presenters for training, marketing, or education.
- Audio-to-Video — Convert podcasts or audio content into video format.
- Character Animation — Bring portraits to life with synchronized speech.
Pro Tips
- Audio quality directly affects lip sync accuracy - use clear audio.
- Provide a frontal portrait image for best results.
- Use prompt to guide facial expressions and style.
- Iterate at 480p to verify results, then render at higher resolution.
- Audio duration is automatically detected - no need to specify manually.
Notes
- Audio duration must be between 5-20 seconds.
- If no reference image is provided, a default portrait will be used.
- Video length automatically matches audio duration.
Related Models
- LTX-2.3 Text-to-Video — Generate video with audio from text.
- LTX-2.3 Image-to-Video — Animate images with synchronized audio.
Authentication
For authentication details, please refer to the Authentication Guide.
API Endpoints
Submit Task & Query Result
# Submit the task
curl --location --request POST "https://api.wavespeed.ai/api/v3/wavespeed-ai/ltx-2.3/lipsync" \
--header "Content-Type: application/json" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}" \
--data-raw '{
"resolution": "720p",
"seed": -1
}'
# Get the result
curl --location --request GET "https://api.wavespeed.ai/api/v3/predictions/${requestId}/result" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}"
Parameters
Task Submission Parameters
Request Parameters
| Parameter | Type | Required | Default | Range | Description |
|---|---|---|---|---|---|
| audio | string | Yes | - | - | The audio file URL for lip-sync generation. Duration determines video length (5-20 seconds max). |
| image | string | No | - | The reference image for the generation. Optional - if not provided, a default portrait will be used. | |
| prompt | string | No | - | Optional text prompt to guide the generation style and motion. | |
| resolution | string | No | 720p | 480p, 720p, 1080p | Video resolution. |
| seed | integer | No | -1 | -1 ~ 2147483647 | The random seed to use for the generation. -1 means a random seed will be used. |
Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data.id | string | Unique identifier for the prediction, Task Id |
| data.model | string | Model ID used for the prediction |
| data.outputs | array | Array of URLs to the generated content (empty when status is not completed) |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.has_nsfw_contents | array | Array of boolean values indicating NSFW detection for each output |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |
Result Request Parameters
| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
| id | string | Yes | - | Task ID |
Result Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data | object | The prediction data object containing all details |
| data.id | string | Unique identifier for the prediction, the ID of the prediction to get |
| data.model | string | Model ID used for the prediction |
| data.outputs | string | Array of URLs to the generated content (empty when status is not completed). |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |