Sync Lipsync 1.9.0 Beta | AI Digital Human API

sync/lipsync-1.9.0-beta — Audio-to-Video Lip Sync

sync/lipsync-1.9.0-beta takes an existing video and a separate audio track, then reanimates the speaker’s mouth so the lips match the new speech. It’s a zero-shot lipsync model from Sync Labs—no training or cloning step required.

🔍 Highlights

Zero-shot lipsync – Works on any person in any video; just upload video + audio.
Style-aware editing – Adjusts only the mouth region while keeping the person’s identity, lighting, and background intact.
Cross-domain support – Handles live-action footage, stylised CG, and AI-generated faces.
Flexible timing control – sync_mode lets you decide how to handle length mismatches between video and audio.

🧩 Parameters

video* Required. Input video to be edited (URL or upload). Use a shot with a clearly visible face for best results.
audio* Required. Target speech track (URL or upload, e.g. MP3/WAV). The model will align lip movements to this audio.
sync_mode Controls behavior when video and audio durations differ. Options:
loop
bounce
cut_off
silence
remap

Choose how you want the shorter stream to be treated (looped, trimmed, padded with silence, or time-remapped).

Output: a new video where the speaker’s lips follow the uploaded audio.

💰 Pricing

Rate: $0.025 per second of processed video.

Clip length (s)	Price (USD)
5	$0.13
10	$0.25
20	$0.50
30	$0.75
60	$1.50

You will only be charged for the actual duration of the input video after upload.

🚀 How to Use

Upload your video in the video field (face should be front-facing or ¾ view, with minimal occlusion).
Upload your audio in the audio field (clean speech, minimal background noise).
Pick a sync_mode depending on how you want to handle length mismatches.
Click Run and wait for the processed clip.
Review the result; if timing feels off, try a different sync_mode or tweak your source video/audio.

💡 Tips

Use clean, well-lit close-ups for the most convincing lipsync.
Avoid heavy head turns or faces partially out of frame.
For dubbed content, make sure the speech rhythm in your audio is reasonably close to the original—lipsync works best when phrasing and pauses roughly match the performance.

More Models to Try

WaveSpeedAI / InfiniteTalk WaveSpeedAI’s single-avatar talking-head model that turns one photo plus audio into smooth, lip-synced digital presenter videos for tutorials, marketing, and social content.
WaveSpeedAI / InfiniteTalk Multi Multi-avatar version of InfiniteTalk that drives several characters in one scene from separate audio tracks, ideal for dialog-style explainers, interviews, and role-play videos.
Kwaivgi / Kling V2 AI Avatar Standard Cost-effective Kling-based AI avatar model that generates natural talking-face videos from a single reference image and voice track, suitable for everyday content and customer support.
Kwaivgi / Kling V2 AI Avatar Pro Higher-fidelity Kling V2 avatar model for premium digital humans, offering smoother motion, better lip-sync, and more stable faces for commercials, brand spokespeople, and product demos.

Lipsync 1.9.0 Beta API — Quick start

Grab a WaveSpeedAI API key, then call POST https://api.wavespeed.ai/api/v3/sync/lipsync-1.9.0-beta with your input as JSON. The endpoint returns a prediction id; poll the prediction endpoint until status flips to completed, then read the output URL from data.outputs[0]. Examples for Lipsync 1.9.0 Beta below.

HTTP example

# Submit the prediction
curl -X POST "https://api.wavespeed.ai/api/v3/sync/lipsync-1.9.0-beta" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY" \
  -d '{
    "video": "https://example.com/your-input.mp4",
    "audio": "https://example.com/your-audio.mp3",
    "sync_mode": "cut_off"
}'

# Response includes a prediction id. Poll for the result:
curl -X GET "https://api.wavespeed.ai/api/v3/predictions/{request_id}/result" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY"

# When status is "completed", read the output from data.outputs[0].

Node.js example

// npm install wavespeed
const WaveSpeed = require('wavespeed');

const client = new WaveSpeed(); // reads WAVESPEED_API_KEY from env

const result = await client.run("sync/lipsync-1.9.0-beta", {
        "video": "https://example.com/your-input.mp4",
        "audio": "https://example.com/your-audio.mp3",
        "sync_mode": "cut_off"
});

console.log(result.outputs[0]); // → URL of the generated output

Python example

# pip install wavespeed
import wavespeed

output = wavespeed.run(
    "sync/lipsync-1.9.0-beta",
    {
    "video": "https://example.com/your-input.mp4",
    "audio": "https://example.com/your-audio.mp3",
    "sync_mode": "cut_off"
}
)

print(output["outputs"][0])  # → URL of the generated output

Lipsync 1.9.0 Beta API — Frequently asked questions

What is the Lipsync 1.9.0 Beta API?

Lipsync 1.9.0 Beta is a Sync model for talking-avatar generation, exposed as a REST API on WaveSpeedAI. Generate realistic lip-sync animations from audio using advanced algorithms for high-quality facial synchronization. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing. You can call it programmatically or try it from the playground above.

How do I call the Lipsync 1.9.0 Beta API?

POST your input parameters to the model's REST endpoint (shown in the API tab of this playground) with your WaveSpeedAI API key in the Authorization header. Submission returns a prediction ID; poll the prediction endpoint until status flips to "completed", then read the output URL from the result. The playground generates a ready-to-paste code sample in Python, JavaScript, or cURL for whatever inputs you've set. Full request/response shape is documented at https://wavespeed.ai/docs/docs-api/sync/sync-lipsync-1.9.0-beta.

How much does Lipsync 1.9.0 Beta cost per run?

Lipsync 1.9.0 Beta starts at $0.025 per run. That figure is the base price — the final charge scales with the parameters you set in the form (output size, length, count, references, or whatever knobs this model exposes), so a higher-quality or larger output costs more than a minimal one. The exact cost for your current input is shown live next to the Generate button before you submit, and the actual per-call charge is recorded on the prediction afterwards.

What inputs does Lipsync 1.9.0 Beta accept?

Key inputs: `video`, `audio`, `sync_mode`. The full JSON schema (types, defaults, allowed values) is rendered above the Generate button and mirrored in the API reference at https://wavespeed.ai/docs/docs-api/sync/sync-lipsync-1.9.0-beta.

How long does Lipsync 1.9.0 Beta take to generate?

Average end-to-end generation time on WaveSpeedAI is around 341 seconds per request — measured across recent runs. Queue time scales with global demand; live status is visible in the prediction record.

Can I use Lipsync 1.9.0 Beta outputs commercially?

Commercial usage rights depend on the model's license, set by its provider (Sync). The license summary appears on the model card above; see WaveSpeedAI's Terms of Service for platform-level conditions.

ExamplesView all

Related Models

README