Infinitetalk Video To Video Multi

Infinitetalk Video To Video Multi

Playground

InfiniteTalk Video-to-Video Multi converts a video and two audio inputs into multi-character talking or singing videos at up to 720p. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

Features

InfiniteTalk Video-to-Video Multi creates lip-synced videos for multiple characters by combining an input video with two audio tracks. It maintains identity across unlimited-length videos, ensuring precise lip synchronization while matching head, face, and body movements to each audio source — perfect for dialogues, interviews, and multi-speaker content.

Why Choose This?

• Multi-character lip sync Synchronizes lip motion precisely with audio for two characters simultaneously.

• Flexible speaking order Choose left-to-right, right-to-left, or simultaneous (meanwhile) speaking patterns.

• Full-body coherence Captures head movements, facial expressions, and posture changes beyond the lips.

• Identity preservation Maintains consistent facial identity and visual style across all frames.

• Mask control Optional mask images define which regions can move for precise control.

• Long-form support Process videos up to 10 minutes in length with consistent quality.

Parameters

How to Use

1. Upload your video — provide a video clearly showing two people.
2. Upload left audio — add audio file for the left character.
3. Upload right audio — add audio file for the right character.
4. Add mask image (optional) — define which regions should animate.
5. Write prompt (optional) — guide scene, pose, or behavior.
6. Select speaking order — choose meanwhile (simultaneous), left_right, or right_left.
7. Choose resolution — 480p for faster processing, 720p for higher quality.
8. Run — submit and download your lip-synced video.

Pricing

Billing Rules

• Minimum charge: 5 seconds ($0.15 at 480p, $0.30 at 720p)
• Maximum duration: 600 seconds (10 minutes)
• Duration calculation:
• Sequential (left_right / right_left): left_audio + right_audio
• Simultaneous (meanwhile): max(left_audio, right_audio)

Best Use Cases

• Dialogue Scenes — Create realistic conversations between two characters.
• Interview Content — Generate interviewer-interviewee videos with synced audio.
• Podcast Visuals — Add visual elements to two-person podcast recordings.
• Educational Content — Create instructor dialogues and Q&A sessions.
• Digital Presenters — Build multi-character presentation videos.

Pro Tips

• Ensure both characters are clearly visible in the source video.
• Use “meanwhile” for overlapping dialogue or simultaneous speech.
• Use “left_right” or “right_left” for sequential conversation flow.
• Mask only the regions you want to animate — uploading the full image as mask will result in a black output.
• Higher quality source videos produce better lip-sync results.

Notes

• Maximum video length: 10 minutes (600 seconds).
• Processing time: approximately 10–30 seconds per 1 second of video.
• Mask safety: Do not upload the full image as mask — only cover animatable regions.
• Ensure uploaded file URLs are publicly accessible.

Related Models

• InfiniteTalk Video-to-Video — Single-character video-to-video lip sync.
• InfiniteTalk Multi — Multi-character image-to-video.
• InfiniteTalk — Single-character image-to-video lip sync.

Reference

• Build your own digital human

Authentication

For authentication details, please refer to the Authentication Guide.

API Endpoints

Submit Task & Query Result

set -euo pipefail

export WAVESPEED_API_KEY="your-api-key"

REQUEST_BODY=$(cat <<'JSON'
{
  "video": "https://interactive-examples.mdn.mozilla.net/media/cc0-videos/flower.mp4",
  "left_audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
  "right_audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
  "order": "meanwhile",
  "resolution": "480p",
  "seed": -1
}
JSON
)

# 1. Submit the prediction.
SUBMIT_RESPONSE=$(curl --silent --show-error --fail-with-body \
  -X POST "https://api.wavespeed.ai/api/v3/wavespeed-ai/infinitetalk/video-to-video-multi" \
  -H "Authorization: Bearer ${WAVESPEED_API_KEY}" \
  -H "Content-Type: application/json" \
  -d "${REQUEST_BODY}")

TASK=$(printf '%s' "${SUBMIT_RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
PREDICTION_ID=$(printf '%s' "${TASK}" | jq -r '.id // empty')
if [ -z "${PREDICTION_ID}" ]; then
  printf 'Submission response did not contain a prediction id
' >&2
  exit 1
fi
RESULT_URL=$(printf '%s' "${TASK}" | jq -r '.urls.get // empty')
if [ -z "${RESULT_URL}" ]; then RESULT_URL="https://api.wavespeed.ai/api/v3/predictions/${PREDICTION_ID}/result"; fi

# 2. Poll until the prediction finishes.
while true; do
  RESPONSE=$(curl --silent --show-error --fail-with-body \
    "${RESULT_URL}" \
    -H "Authorization: Bearer ${WAVESPEED_API_KEY}")
  RESULT=$(printf '%s' "${RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
  STATUS=$(printf '%s' "${RESULT}" | jq -r '.status // empty')

  case "${STATUS}" in
    completed) printf '%s\n' "${RESULT}" | jq '.outputs'; break ;;
    failed|cancelled|timeout) printf '%s\n' "${RESULT}" | jq . >&2; exit 1 ;;
    created|processing) sleep 2 ;;
    *) printf 'Unexpected status: %s
' "${STATUS}" >&2; exit 1 ;;
  esac
done

Parameters

Task Submission Parameters

Request Parameters

Response Parameters

Result Request Parameters

Result Response Parameters