Seedream 5.0 Pro 提供開始 | 画像ジェネレーターで試す →
ホーム/探索/WaveSpeed/Infinitetalk/Video To Video Multi

Infinitetalk Video to Video Multi

wavespeed-ai /

InfiniteTalk Video-to-Video Multi converts a video and two audio inputs into multi-character talking or singing videos at up to 720p. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

digital-human
入力

待機中

$0.151回あたり·~66 / $10

サンプルすべて表示

関連モデル

README

InfiniteTalk Video-to-Video Multi

InfiniteTalk Video-to-Video Multi creates lip-synced videos for multiple characters by combining an input video with two audio tracks. It maintains identity across unlimited-length videos, ensuring precise lip synchronization while matching head, face, and body movements to each audio source — perfect for dialogues, interviews, and multi-speaker content.

Why Choose This?

  • Multi-character lip sync Synchronizes lip motion precisely with audio for two characters simultaneously.

  • Flexible speaking order Choose left-to-right, right-to-left, or simultaneous (meanwhile) speaking patterns.

  • Full-body coherence Captures head movements, facial expressions, and posture changes beyond the lips.

  • Identity preservation Maintains consistent facial identity and visual style across all frames.

  • Mask control Optional mask images define which regions can move for precise control.

  • Long-form support Process videos up to 10 minutes in length with consistent quality.

Parameters

ParameterRequiredDescription
videoYesSource video with two visible characters
left_audioYesAudio track for the left character
right_audioYesAudio track for the right character
mask_imageNoMask defining animatable regions
promptNoText prompt to guide scene or behavior
orderNoSpeaking order: meanwhile, left_right, or right_left
resolutionNoOutput resolution: 480p (default) or 720p
seedNoRandom seed for reproducibility (-1 for random)

How to Use

  1. Upload your video — provide a video clearly showing two people.
  2. Upload left audio — add audio file for the left character.
  3. Upload right audio — add audio file for the right character.
  4. Add mask image (optional) — define which regions should animate.
  5. Write prompt (optional) — guide scene, pose, or behavior.
  6. Select speaking order — choose meanwhile (simultaneous), left_right, or right_left.
  7. Choose resolution — 480p for faster processing, 720p for higher quality.
  8. Run — submit and download your lip-synced video.

Pricing

ResolutionCost per 5sPer-Second Rate
480p$0.15$0.03/s
720p$0.30$0.06/s

Billing Rules

  • Minimum charge: 5 seconds ($0.15 at 480p, $0.30 at 720p)
  • Maximum duration: 600 seconds (10 minutes)
  • Duration calculation:
  • Sequential (left_right / right_left): left_audio + right_audio
  • Simultaneous (meanwhile): max(left_audio, right_audio)

Best Use Cases

  • Dialogue Scenes — Create realistic conversations between two characters.
  • Interview Content — Generate interviewer-interviewee videos with synced audio.
  • Podcast Visuals — Add visual elements to two-person podcast recordings.
  • Educational Content — Create instructor dialogues and Q&A sessions.
  • Digital Presenters — Build multi-character presentation videos.

Pro Tips

  • Ensure both characters are clearly visible in the source video.
  • Use "meanwhile" for overlapping dialogue or simultaneous speech.
  • Use "left_right" or "right_left" for sequential conversation flow.
  • Mask only the regions you want to animate — uploading the full image as mask will result in a black output.
  • Higher quality source videos produce better lip-sync results.

Notes

  • Maximum video length: 10 minutes (600 seconds).
  • Processing time: approximately 10–30 seconds per 1 second of video.
  • Mask safety: Do not upload the full image as mask — only cover animatable regions.
  • Ensure uploaded file URLs are publicly accessible.

Related Models

Reference

注記:本サイトは第三者が提供するAIモデルを使用しています。

Infinitetalk Video To Video Multi API — Quick start

Grab a WaveSpeedAI API key, then call POST https://api.wavespeed.ai/api/v3/wavespeed-ai/infinitetalk/video-to-video-multi with your input as JSON. The endpoint returns a prediction id. Start polling the result endpoint around every 2 seconds, increase the interval for long-running tasks, and stop on any terminal status. On completed, read output values from data.outputs. Examples for Infinitetalk Video To Video Multi below.

HTTP example
set -euo pipefail

: "${WAVESPEED_API_KEY:?Set WAVESPEED_API_KEY}"

REQUEST_BODY=$(cat <<'JSON'
{
    "video": "https://interactive-examples.mdn.mozilla.net/media/cc0-videos/flower.mp4",
    "left_audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
    "right_audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
    "order": "meanwhile",
    "resolution": "480p",
    "seed": -1
}
JSON
)

# 1. Submit the prediction.
SUBMIT_RESPONSE=$(curl --silent --show-error --fail-with-body \
  -X POST "https://api.wavespeed.ai/api/v3/wavespeed-ai/infinitetalk/video-to-video-multi" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY" \
  -d "$REQUEST_BODY")

TASK=$(printf '%s' "$SUBMIT_RESPONSE" | jq 'if has("data") then .data else . end')
PREDICTION_ID=$(printf '%s' "$TASK" | jq -r '.id')
if [ -z "$PREDICTION_ID" ] || [ "$PREDICTION_ID" = "null" ]; then
  printf 'Submission response did not contain a prediction id
' >&2
  exit 1
fi
RESULT_URL=$(printf '%s' "$TASK" | jq -r '.urls.get // empty')
if [ -z "$RESULT_URL" ]; then
  RESULT_URL="https://api.wavespeed.ai/api/v3/predictions/$PREDICTION_ID/result"
fi

# 2. Poll until the prediction finishes.
while true; do
  RESPONSE=$(curl --silent --show-error --fail-with-body "$RESULT_URL" \
    -H "Authorization: Bearer $WAVESPEED_API_KEY")
  RESULT=$(printf '%s' "$RESPONSE" | jq 'if has("data") then .data else . end')
  STATUS=$(printf '%s' "$RESULT" | jq -r '.status')
  case "$STATUS" in
    completed) printf '%s\n' "$RESULT" | jq '.outputs'; break ;;
    failed|cancelled|timeout) printf '%s\n' "$RESULT" | jq . >&2; exit 1 ;;
    created|processing) sleep 2 ;;
    *) printf 'Unexpected status: %s
' "$STATUS" >&2; exit 1 ;;
  esac
done
Node.js example
const submitUrl = "https://api.wavespeed.ai/api/v3/wavespeed-ai/infinitetalk/video-to-video-multi";
const apiKey = process.env.WAVESPEED_API_KEY;
if (!apiKey) throw new Error('Set WAVESPEED_API_KEY');

async function requestJson(url, options = {}) {
  const response = await fetch(url, options);
  if (!response.ok) throw new Error(await response.text());
  return response.json();
}

// 1. Submit the prediction.
const body = await requestJson(submitUrl, {
  method: "POST",
  headers: {
    "Authorization": `Bearer ${apiKey}`,
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
        "video": "https://interactive-examples.mdn.mozilla.net/media/cc0-videos/flower.mp4",
        "left_audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
        "right_audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
        "order": "meanwhile",
        "resolution": "480p",
        "seed": -1
}),
});
const task = body.data ?? body;
if (!task.id) throw new Error("Submission response did not contain a prediction id");
const resultUrl = task.urls?.get ||
  `https://api.wavespeed.ai/api/v3/predictions/${task.id}/result`;

// 2. Poll until the prediction finishes.
while (true) {
  const resultBody = await requestJson(resultUrl, {
    headers: { "Authorization": `Bearer ${apiKey}` },
  });
  const result = resultBody.data ?? resultBody;
  if (result.status === "completed") {
    console.log(result.outputs);
    break;
  }
  if (["failed", "cancelled", "timeout"].includes(result.status)) throw new Error(JSON.stringify(result));
  if (!["created", "processing"].includes(result.status)) throw new Error("Unexpected status: " + result.status);
  await new Promise(resolve => setTimeout(resolve, 2000));
}
Python example
import json
import os
import time
from urllib.request import Request, urlopen

api_key = os.environ["WAVESPEED_API_KEY"]
headers = {"Authorization": f"Bearer {api_key}", "Content-Type": "application/json"}
payload = {
    "video": "https://interactive-examples.mdn.mozilla.net/media/cc0-videos/flower.mp4",
    "left_audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
    "right_audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
    "order": "meanwhile",
    "resolution": "480p",
    "seed": -1
}

def request_json(url, data=None):
    request = Request(url, data=data, headers=headers, method="POST" if data else "GET")
    with urlopen(request) as response:
        return json.load(response)

# 1. Submit the prediction.
body = request_json("https://api.wavespeed.ai/api/v3/wavespeed-ai/infinitetalk/video-to-video-multi", json.dumps(payload).encode())
task = body.get("data", body)
if not task.get("id"):
    raise RuntimeError("Submission response did not contain a prediction id")
result_url = task.get("urls", {}).get("get") or f"https://api.wavespeed.ai/api/v3/predictions/{task['id']}/result"

# 2. Poll until the prediction finishes.
while True:
    result_body = request_json(result_url)
    result = result_body.get("data", result_body)
    status = result.get("status")
    if status == "completed":
        print(result.get("outputs", []))
        break
    if status in {"failed", "cancelled", "timeout"}:
        raise RuntimeError(result)
    if status not in {"created", "processing"}:
        raise RuntimeError(f"Unexpected status: {status}")
    time.sleep(2)

Infinitetalk Video To Video Multi API — Frequently asked questions

What is the Infinitetalk Video To Video Multi API?

Infinitetalk Video To Video Multi is a WaveSpeedAI model for talking-avatar generation, exposed as a REST API on WaveSpeedAI. InfiniteTalk Video-to-Video Multi converts a video and two audio inputs into multi-character talking or singing videos at up to 720p. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing. You can call it programmatically or try it from the playground above.

How do I call the Infinitetalk Video To Video Multi API?

POST your input parameters to the model's REST endpoint (shown in the API tab of this playground) with your WaveSpeedAI API key in the Authorization header. Submission returns a prediction ID. Poll the result endpoint starting around every 2 seconds, increase the interval for long-running tasks, and stop on any terminal status. The playground generates production-oriented Python, JavaScript, and cURL examples with timeouts, transient-error handling, and safe GET retries. Full request/response shape is documented at https://wavespeed.ai/docs/docs-api/wavespeed-ai/infinitetalk-video-to-video-multi.

How much does Infinitetalk Video To Video Multi cost per run?

Infinitetalk Video To Video Multi starts at $0.15 per run. That figure is the base price — the final charge scales with the parameters you set in the form (output size, length, count, references, or whatever knobs this model exposes), so a higher-quality or larger output costs more than a minimal one. The exact cost for your current input is shown live next to the Generate button before you submit, and the actual per-call charge is recorded on the prediction afterwards.

What inputs does Infinitetalk Video To Video Multi accept?

Key inputs: `prompt`, `video`, `resolution`, `seed`, `left_audio`, `order`. The full JSON schema (types, defaults, allowed values) is rendered above the Generate button and mirrored in the API reference at https://wavespeed.ai/docs/docs-api/wavespeed-ai/infinitetalk-video-to-video-multi.

How long does Infinitetalk Video To Video Multi take to generate?

Median end-to-end generation time on WaveSpeedAI is around 532 seconds per request, based on recent successful runs. Queue time varies with global demand; live status is visible in the prediction record.

Can I use Infinitetalk Video To Video Multi outputs commercially?

Commercial usage rights depend on the model's license, set by its provider (WaveSpeedAI). The license summary appears on the model card above; see WaveSpeedAI's Terms of Service for platform-level conditions.

Infinitetalk Video to Video Multi | AI Digital Human API | WaveSpeedAI