Seedream 5.0 Pro अब लाइव है | Image Generator में आज़माएं →
साइन इन

Multitalk

wavespeed-ai /

MultiTalk converts one image and audio into audio-driven talking/singing videos (Image-to-Video), supporting up to 10 minutes. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

image-to-video
इनपुट

निष्क्रिय

$0.15प्रति रन·~66 / $10

आगे:

उदाहरणसभी देखें

A realistic, brightly lit scene of a cute cat standing like a human on a concert stage, passionately singing into a microphone. The cat wears a sparkly jacket, surrounded by stage lights and a cheering audience. Dramatic spotlight, expressive eyes, dynamic pose, full of emotion, vibrant colors, high detail, cinematic atmosphere.

संबंधित मॉडल

README

MultiTalk

Generate realistic talking videos from a single photo with MultiTalk — MeiGen-AI's revolutionary audio-driven conversational video framework. Unlike traditional talking head methods that only animate facial movements, MultiTalk creates lifelike videos with perfect lip synchronization, natural expressions, and dynamic body language.

Why It Looks Great

  • Perfect lip sync: Advanced audio analysis ensures precise mouth movements matching every syllable.
  • Full-body animation: Goes beyond faces — animates natural body movements and gestures.
  • Camera dynamics: Built-in Uni3C controlnet enables subtle camera movements for professional results.
  • Instruction following: Control scene, pose, and behavior through text prompts while maintaining sync.
  • Multi-person support: Animate conversations with multiple speakers in the same scene.
  • Extended duration: Generate videos up to 10 minutes long.

How It Works

MultiTalk combines three powerful technologies for optimal results:

ComponentFunction
Wav2Vec Audio EncoderAnalyzes speech nuances including rhythm, tone, and pronunciation patterns
Wan2.1 Video DiffusionUnderstands human anatomy, facial expressions, and body movements
Uni3C ControlnetEnables dynamic camera movements and professional scene control

Through sophisticated attention mechanisms, MultiTalk perfectly aligns lip movements with audio while maintaining natural facial expressions and body language.

Parameters

ParameterRequiredDescription
imageYesPortrait image of the person to animate (upload or public URL).
audioYesAudio file for lip synchronization (upload or public URL).

How to Use

  1. Upload your image — a clear portrait photo works best.
  2. Upload your audio — speech, singing, or any vocal audio.
  3. Run — click the button to generate.
  4. Download — preview and save your talking video.

Pricing

Per 5-second billing based on audio duration.

DurationCost
5 seconds$0.15
30 seconds$0.90
1 minute$1.80
5 minutes$9.00
10 minutes (max)$18.00

Best Use Cases

  • Virtual Presenters — Create AI spokespeople for videos and training content.
  • Content Localization — Dub content into different languages with matching lip movements.
  • Music Videos — Generate singing performances from static photos.
  • E-learning — Produce instructor-led courses without filming.
  • Social Media — Create engaging talking-head content at scale.
  • Multi-person Conversations — Animate group discussions and dialogues.

Pro Tips for Best Results

  • Use clear, front-facing portrait photos with good lighting.
  • Ensure faces are clearly visible without obstructions.
  • High-quality audio with minimal background noise produces better sync.
  • Neutral or slightly open mouth expressions in source images work best.
  • For conversations, provide distinct audio tracks for each speaker.
  • Test with shorter clips before generating longer videos.

Related Workflows

Notes

  • Maximum supported video length is 10 minutes.
  • If using URLs, ensure they are publicly accessible.
  • Processing time scales with audio duration.
  • Best results come from portrait-style images with clear facial features.
नोट:यह वेबसाइट तृतीय पक्षों द्वारा प्रदान किए गए AI मॉडलों का उपयोग करती है।

Multitalk API — Quick start

Grab a WaveSpeedAI API key, then call POST https://api.wavespeed.ai/api/v3/wavespeed-ai/multitalk with your input as JSON. The endpoint returns a prediction id. Start polling the result endpoint around every 2 seconds, increase the interval for long-running tasks, and stop on any terminal status. On completed, read output values from data.outputs. Examples for Multitalk below.

HTTP example
set -euo pipefail

: "${WAVESPEED_API_KEY:?Set WAVESPEED_API_KEY}"

REQUEST_BODY=$(cat <<'JSON'
{
    "image": "https://interactive-examples.mdn.mozilla.net/media/cc0-images/painted-hand-298-332.jpg",
    "audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
    "seed": -1
}
JSON
)

# 1. Submit the prediction.
SUBMIT_RESPONSE=$(curl --silent --show-error --fail-with-body \
  -X POST "https://api.wavespeed.ai/api/v3/wavespeed-ai/multitalk" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY" \
  -d "$REQUEST_BODY")

TASK=$(printf '%s' "$SUBMIT_RESPONSE" | jq 'if has("data") then .data else . end')
PREDICTION_ID=$(printf '%s' "$TASK" | jq -r '.id')
if [ -z "$PREDICTION_ID" ] || [ "$PREDICTION_ID" = "null" ]; then
  printf 'Submission response did not contain a prediction id
' >&2
  exit 1
fi
RESULT_URL=$(printf '%s' "$TASK" | jq -r '.urls.get // empty')
if [ -z "$RESULT_URL" ]; then
  RESULT_URL="https://api.wavespeed.ai/api/v3/predictions/$PREDICTION_ID/result"
fi

# 2. Poll until the prediction finishes.
while true; do
  RESPONSE=$(curl --silent --show-error --fail-with-body "$RESULT_URL" \
    -H "Authorization: Bearer $WAVESPEED_API_KEY")
  RESULT=$(printf '%s' "$RESPONSE" | jq 'if has("data") then .data else . end')
  STATUS=$(printf '%s' "$RESULT" | jq -r '.status')
  case "$STATUS" in
    completed) printf '%s\n' "$RESULT" | jq '.outputs'; break ;;
    failed|cancelled|timeout) printf '%s\n' "$RESULT" | jq . >&2; exit 1 ;;
    created|processing) sleep 2 ;;
    *) printf 'Unexpected status: %s
' "$STATUS" >&2; exit 1 ;;
  esac
done
Node.js example
const submitUrl = "https://api.wavespeed.ai/api/v3/wavespeed-ai/multitalk";
const apiKey = process.env.WAVESPEED_API_KEY;
if (!apiKey) throw new Error('Set WAVESPEED_API_KEY');

async function requestJson(url, options = {}) {
  const response = await fetch(url, options);
  if (!response.ok) throw new Error(await response.text());
  return response.json();
}

// 1. Submit the prediction.
const body = await requestJson(submitUrl, {
  method: "POST",
  headers: {
    "Authorization": `Bearer ${apiKey}`,
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
        "image": "https://interactive-examples.mdn.mozilla.net/media/cc0-images/painted-hand-298-332.jpg",
        "audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
        "seed": -1
}),
});
const task = body.data ?? body;
if (!task.id) throw new Error("Submission response did not contain a prediction id");
const resultUrl = task.urls?.get ||
  `https://api.wavespeed.ai/api/v3/predictions/${task.id}/result`;

// 2. Poll until the prediction finishes.
while (true) {
  const resultBody = await requestJson(resultUrl, {
    headers: { "Authorization": `Bearer ${apiKey}` },
  });
  const result = resultBody.data ?? resultBody;
  if (result.status === "completed") {
    console.log(result.outputs);
    break;
  }
  if (["failed", "cancelled", "timeout"].includes(result.status)) throw new Error(JSON.stringify(result));
  if (!["created", "processing"].includes(result.status)) throw new Error("Unexpected status: " + result.status);
  await new Promise(resolve => setTimeout(resolve, 2000));
}
Python example
import json
import os
import time
from urllib.request import Request, urlopen

api_key = os.environ["WAVESPEED_API_KEY"]
headers = {"Authorization": f"Bearer {api_key}", "Content-Type": "application/json"}
payload = {
    "image": "https://interactive-examples.mdn.mozilla.net/media/cc0-images/painted-hand-298-332.jpg",
    "audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3",
    "seed": -1
}

def request_json(url, data=None):
    request = Request(url, data=data, headers=headers, method="POST" if data else "GET")
    with urlopen(request) as response:
        return json.load(response)

# 1. Submit the prediction.
body = request_json("https://api.wavespeed.ai/api/v3/wavespeed-ai/multitalk", json.dumps(payload).encode())
task = body.get("data", body)
if not task.get("id"):
    raise RuntimeError("Submission response did not contain a prediction id")
result_url = task.get("urls", {}).get("get") or f"https://api.wavespeed.ai/api/v3/predictions/{task['id']}/result"

# 2. Poll until the prediction finishes.
while True:
    result_body = request_json(result_url)
    result = result_body.get("data", result_body)
    status = result.get("status")
    if status == "completed":
        print(result.get("outputs", []))
        break
    if status in {"failed", "cancelled", "timeout"}:
        raise RuntimeError(result)
    if status not in {"created", "processing"}:
        raise RuntimeError(f"Unexpected status: {status}")
    time.sleep(2)

Multitalk API — Frequently asked questions

What is the Multitalk API?

Multitalk is a WaveSpeedAI model for video generation from images, exposed as a REST API on WaveSpeedAI. MultiTalk converts one image and audio into audio-driven talking/singing videos (Image-to-Video), supporting up to 10 minutes. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing. You can call it programmatically or try it from the playground above.

How do I call the Multitalk API?

POST your input parameters to the model's REST endpoint (shown in the API tab of this playground) with your WaveSpeedAI API key in the Authorization header. Submission returns a prediction ID. Poll the result endpoint starting around every 2 seconds, increase the interval for long-running tasks, and stop on any terminal status. The playground generates production-oriented Python, JavaScript, and cURL examples with timeouts, transient-error handling, and safe GET retries. Full request/response shape is documented at https://wavespeed.ai/docs/docs-api/wavespeed-ai/multitalk.

How much does Multitalk cost per run?

Multitalk starts at $0.15 per run. That figure is the base price — the final charge scales with the parameters you set in the form (output size, length, count, references, or whatever knobs this model exposes), so a higher-quality or larger output costs more than a minimal one. The exact cost for your current input is shown live next to the Generate button before you submit, and the actual per-call charge is recorded on the prediction afterwards.

What inputs does Multitalk accept?

Key inputs: `prompt`, `image`, `audio`, `seed`. The full JSON schema (types, defaults, allowed values) is rendered above the Generate button and mirrored in the API reference at https://wavespeed.ai/docs/docs-api/wavespeed-ai/multitalk.

How long does Multitalk take to generate?

Median end-to-end generation time on WaveSpeedAI is around 407 seconds per request, based on recent successful runs. Queue time varies with global demand; live status is visible in the prediction record.

Can I use Multitalk outputs commercially?

Commercial usage rights depend on the model's license, set by its provider (WaveSpeedAI). The license summary appears on the model card above; see WaveSpeedAI's Terms of Service for platform-level conditions.

Multitalk | Fast Image-to-Video API | WaveSpeedAI