Sync Lipsync 2 Pro

Sync Lipsync 2 Pro

Playground

Lipsync-2-pro creates studio-grade lip synchronization for video-to-video editing in minutes, not weeks. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

Features

sync/lipsync-2-pro — Pro Audio-to-Lipsync

Lipsync-2-pro is a zero-shot model for generating realistic lip movements that match spoken audio. It works out of the box—no training or fine-tuning—and preserves the speaker’s natural style across languages, cameras, and video types. From live-action footage to animated or AI-generated faces, it brings broadcast-grade dubbing and dialogue editing into a simple API call.

What it does

• Zero-shot lipsync – Just provide a video and an audio track; the model automatically re-animates the mouth to match the speech.
• Style preservation – Learns each speaker’s characteristic timing and articulation and keeps that “signature delivery” even when the language changes.
• Cross-domain support – Works on real humans, 2D/3D animation, and synthetic/AI avatars.
• Flexible workflows – Use it for dubbing, rewriting individual lines in post, or re-animating entire performances.

Key capabilities

• Expressiveness control – Internally balances how “subtle vs. animated” the lipsync is, so results can match calm talking-head news, energetic vlogs, or stylised characters.
• Active speaker detection – In multi-person scenes, the system can focus lipsync on the currently speaking face instead of blindly animating everyone.
• High-fidelity animation – Preserves identity, lighting, background and facial structure; only the mouth and local expressions are changed.
• Record once, edit forever – Change lines after shooting without new takes; keep the original performance and camera work.
• AI dubbing for any video – Pair with TTS or translation models to localise existing content into new languages.

Parameters

• video* Input video to be re-synced (URL or upload). Works best with relatively stable talking-head or upper-body shots.

• audio* Target speech (URL or upload). The new lip motion will follow this track.

• sync_mode Controls how audio and video lengths are aligned:

  • cut_off – Trim to the shorter of audio or video (default, safest).
  • loop – Loop the shorter track until the longer one finishes.
  • bounce – Ping-pong the video when looping (forward–back–forward…).
  • silence – Pad missing audio with silence.
  • remap – Time-warp to better match durations.

Output: a new MP4 video with updated lipsync.

How to use

1. Upload or paste URLs for video and audio.
2. Choose an appropriate sync_mode based on whether you want trimming, looping, or padding.
3. Submit the job and wait for processing to complete.
4. Download the result and review; if needed, adjust audio, sync_mode or source video and re-run.

Pricing

Billing is purely based on audio length.

• Base rate: $0.08 per second of audio

You can estimate other costs by multiplying the audio duration (in seconds) by $0.08/s; charges scale linearly with length.

More Models to Try

• WaveSpeedAI / InfiniteTalk WaveSpeedAI’s single-avatar talking-head model that turns one photo plus audio into smooth, lip-synced digital presenter videos for tutorials, marketing, and social content.

• WaveSpeedAI / InfiniteTalk Multi Multi-avatar version of InfiniteTalk that drives several characters in one scene from separate audio tracks, ideal for dialog-style explainers, interviews, and role-play videos.

• Kwaivgi / Kling V2 AI Avatar Standard Cost-effective Kling-based AI avatar model that generates natural talking-face videos from a single reference image and voice track, suitable for everyday content and customer support.

• Kwaivgi / Kling V2 AI Avatar Pro Higher-fidelity Kling V2 avatar model for premium digital humans, offering smoother motion, better lip-sync, and more stable faces for commercials, brand spokespeople, and product demos.

# Submit the task
curl --location --request POST "https://api.wavespeed.ai/api/v3/sync/lipsync-2-pro" \
--header "Content-Type: application/json" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}" \
--data-raw '{
    "sync_mode": "cut_off"
}'

# Get the result
curl --location --request GET "https://api.wavespeed.ai/api/v3/predictions/${requestId}/result" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}"