Seedance 1.5 Pro is Live Now!Try Now!
Home/Explore/Kling Models/kwaivgi/kling-lipsync/audio-to-video
scenario-marketing

scenario-marketing

Kwaivgi Kling LipSync Model

kwaivgi/kling-lipsync/audio-to-video

Kling LipSync converts audio into talking head video by generating lifelike lip movements perfectly synced to the input audio. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

Hint: You can drag and drop a file or click to upload

Hint: You can drag and drop a file or click to upload

Idle

Your request will cost $0.15 per run.

For $10 you can run this model approximately 66 times.

ExamplesView all

README

Kling LipSync — Audio-to-Video Lip Synchronization

Kling LipSync is an advanced audio-to-video model that drives natural, lifelike lip movements to match any input audio. Give it a clean voice or singing track plus a video, and it reanimates the mouth region so your character looks like they are truly speaking or singing those lines.

What Kling LipSync does

  • Synchronizes lip movements in a video to match provided speech or singing.
  • Works perfectly with videos generated by Kling AI or other sources.
  • Preserves the original background, body motion, and camera work.
  • Produces realistic, production-ready talking or singing footage.

Key Features

  • Natural, highly matched lip motion Mouth shapes line up closely with phonemes in the audio, while respecting each character’s facial structure. This yields expressive, believable speech and singing instead of robotic mouth flapping.

  • Accurate facial muscle response Lip animation also drives cheeks, jawline, and surrounding muscles. Subtle stretches and contractions are reflected in real time, greatly improving realism and immersion.

  • Non-destructive background and body Only the face region is re-rendered. Clothing, hands, environment, and lighting outside the face stay consistent with the original video, preserving continuity and avoiding unwanted artifacts.

Inputs and Outputs

Required inputs

  • audio: The target voice or singing track (locally recorded or generated). Duration of this audio controls billing and should roughly match the video length.

  • video: The source video whose character(s) will be lip-synced to the audio.

Output

  • A new video where the character’s lip movements and facial micro-motions are synchronized with the provided audio while the rest of the frame remains unchanged.

Pricing

Billing is based on the audio duration with a 5-second minimum and a cap at 600 seconds.

From this:

  • Effective price per second: 0.15 / 5 = $0.03 per second
  • Minimum billed duration: 5 seconds → minimum charge $0.15
  • Maximum billed duration: 600 seconds → maximum charge $18.00

Summary table:

MetricValue
Price per second$0.030
Minimum billed duration5 seconds
Minimum total price$0.15
Maximum billed duration600 seconds
Maximum total price per run$18.00

Example costs:

Audio lengthBilled secondsTotal price
4 s5 s$0.15
10 s10 s$0.30
60 s60 s$1.80
180 s180 s$5.40
600 s600 s$18.00
900 s600 s (capped)$18.00

How to Use

  1. Upload or paste the URL of your audio track.
  2. Upload or paste the URL of the video to be lip-synced.
  3. Ensure the audio length is close to the video duration for best results.
  4. Click Run.
  5. Preview the output video, then download it for editing or publishing.

Tips for Best Quality

  • Use clean, high-quality audio without heavy background noise or music.
  • Keep the audio and video durations aligned; large mismatches can cause timing drift.
  • Choose videos with clear views of the speaker’s face and minimal occlusions.
  • Avoid extreme motion blur or rapid cuts during key speaking moments.

Note

  • Please note that the length of the input audio and video must be at least 2 seconds, otherwise a compilation error will occur.