Kwaivgi Kling Lipsync Audio To Video

Kwaivgi Kling Lipsync Audio To Video

Playground

Kling LipSync converts audio into talking head video by generating lifelike lip movements perfectly synced to the input audio. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

Features

Kling LipSync is an advanced audio-to-video model that drives natural, lifelike lip movements to match any input audio. Give it a clean voice or singing track plus a video, and it reanimates the mouth region so your character looks like they are truly speaking or singing those lines.

What Kling LipSync does

• Synchronizes lip movements in a video to match provided speech or singing.
• Works perfectly with videos generated by Kling AI or other sources.
• Preserves the original background, body motion, and camera work.
• Produces realistic, production-ready talking or singing footage.

Key Features

• Natural, highly matched lip motion Mouth shapes line up closely with phonemes in the audio, while respecting each character’s facial structure. This yields expressive, believable speech and singing instead of robotic mouth flapping.

• Accurate facial muscle response Lip animation also drives cheeks, jawline, and surrounding muscles. Subtle stretches and contractions are reflected in real time, greatly improving realism and immersion.

• Non-destructive background and body Only the face region is re-rendered. Clothing, hands, environment, and lighting outside the face stay consistent with the original video, preserving continuity and avoiding unwanted artifacts.

Inputs and Outputs

Required inputs

• audio: The target voice or singing track (locally recorded or generated). Duration of this audio controls billing and should roughly match the video length.

• video: The source video whose character(s) will be lip-synced to the audio.

Output

• A new video where the character’s lip movements and facial micro-motions are synchronized with the provided audio while the rest of the frame remains unchanged.

Pricing

Billing is based on the audio duration with a 5-second minimum and a cap at 600 seconds.

From this:

• Effective price per second: 0.15 / 5 = $0.03 per second
• Minimum billed duration: 5 seconds → minimum charge $0.15
• Maximum billed duration: 600 seconds → maximum charge $18.00

Summary table:

Example costs:

How to Use

1. Upload or paste the URL of your audio track.
2. Upload or paste the URL of the video to be lip-synced.
3. Ensure the audio length is close to the video duration for best results.
4. Click Run.
5. Preview the output video, then download it for editing or publishing.

Tips for Best Quality

• Use clean, high-quality audio without heavy background noise or music.
• Keep the audio and video durations aligned; large mismatches can cause timing drift.
• Choose videos with clear views of the speaker’s face and minimal occlusions.
• Avoid extreme motion blur or rapid cuts during key speaking moments.

Note

• Please note that the length of the input audio and video must be at least 2 seconds, otherwise a compilation error will occur.

Authentication

For authentication details, please refer to the Authentication Guide.

API Endpoints

Submit Task & Query Result

set -euo pipefail

export WAVESPEED_API_KEY="your-api-key"

REQUEST_BODY=$(cat <<'JSON'
{
  "audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
  "video": "https://interactive-examples.mdn.mozilla.net/media/cc0-videos/flower.mp4"
}
JSON
)

# 1. Submit the prediction.
SUBMIT_RESPONSE=$(curl --silent --show-error --fail-with-body \
  -X POST "https://api.wavespeed.ai/api/v3/kwaivgi/kling-lipsync/audio-to-video" \
  -H "Authorization: Bearer ${WAVESPEED_API_KEY}" \
  -H "Content-Type: application/json" \
  -d "${REQUEST_BODY}")

TASK=$(printf '%s' "${SUBMIT_RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
PREDICTION_ID=$(printf '%s' "${TASK}" | jq -r '.id // empty')
if [ -z "${PREDICTION_ID}" ]; then
  printf 'Submission response did not contain a prediction id
' >&2
  exit 1
fi
RESULT_URL=$(printf '%s' "${TASK}" | jq -r '.urls.get // empty')
if [ -z "${RESULT_URL}" ]; then RESULT_URL="https://api.wavespeed.ai/api/v3/predictions/${PREDICTION_ID}/result"; fi

# 2. Poll until the prediction finishes.
while true; do
  RESPONSE=$(curl --silent --show-error --fail-with-body \
    "${RESULT_URL}" \
    -H "Authorization: Bearer ${WAVESPEED_API_KEY}")
  RESULT=$(printf '%s' "${RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
  STATUS=$(printf '%s' "${RESULT}" | jq -r '.status // empty')

  case "${STATUS}" in
    completed) printf '%s\n' "${RESULT}" | jq '.outputs'; break ;;
    failed|cancelled|timeout) printf '%s\n' "${RESULT}" | jq . >&2; exit 1 ;;
    created|processing) sleep 2 ;;
    *) printf 'Unexpected status: %s
' "${STATUS}" >&2; exit 1 ;;
  esac
done

Parameters

Task Submission Parameters

Request Parameters

Response Parameters

Result Request Parameters

Result Response Parameters