Bytedance Omni Human 2.0 API Documentation

Bytedance Omni Human 2.0 API Documentation

Playground

OmniHuman 2.0 Talking Avatar turns a portrait image and audio recording into a lifelike talking-avatar video, making it suitable for digital humans, virtual presenters, dubbing, social content, and avatar video workflows. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

Features

OmniHuman 2.0 creates a talking-avatar video from a portrait image and an audio recording. The image defines the character’s appearance, while the supplied audio drives the speaking performance and timing.

Use an optional prompt to guide the avatar’s movement, expression, or overall performance style. It is designed for virtual presenters, digital humans, explainers, social content, and other speech-driven avatar workflows.

Why Choose This?

• Image-and-audio avatar generation
  Turn a portrait image and speech recording into a talking-avatar video.

• Audio-driven performance
  Use the supplied audio to drive the avatar’s speaking performance and timing.

• Prompt-guided motion
  Add optional instructions for expression, movement, or performance style.

• Long-form avatar video
  Process up to the first 300 seconds of an audio recording; longer recordings are trimmed automatically.

• Simple workflow
  Provide an image and audio recording, then generate the completed avatar video.

Parameters

How to Use

1. Upload a portrait — Provide a clear image with the subject’s face visible. Images are converted to JPEG and fitted to the supported dimensions; extreme aspect ratios are center-cropped.
2. Upload speech audio — Supply the recording that should drive the avatar performance.
3. Add a prompt optional — Describe the desired movement, expression, or performance style.
4. Submit — Generate and retrieve the talking-avatar video.

Pricing

Pricing is based on the original audio duration capped at 300 seconds; padding does not add charges beyond the 4-second minimum.

The rate is $0.10 per billed second.

Audio duration is rounded up to the next whole second, with a minimum billed duration of 4 seconds and a maximum of 300 seconds.

Best Use Cases

• Virtual presenters — Create presenter-style videos from portrait images and recorded speech.
• Digital humans — Animate portrait characters for speech-driven content.
• Product explainers — Turn narration into avatar-led product presentations.
• Educational content — Create instructor or presenter videos for courses and training.
• Social media content — Generate talking-character clips from existing portraits.
• Localized content — Reuse the same portrait with different audio recordings for multiple versions.

Pro Tips

• Use a clear, well-lit portrait with the face clearly visible.
• Use clean speech audio with minimal background noise.
• Keep the prompt focused on natural expressions and movement.
• Avoid overly complex or conflicting motion instructions.
• Use shorter audio samples when testing a new portrait or prompt before generating longer videos.

Notes

• image and audio are required.
• Long recordings are automatically trimmed to their first 300 seconds. Nonempty recordings shorter than 4 seconds are padded with trailing silence for generation.
• Billing duration is rounded up to the next whole second.
• The minimum billed duration is 4 seconds.
• The maximum billed duration is 300 seconds.
• prompt is optional.

Related Models

• Seedance 2.5 Talking Avatar — Create talking-avatar videos from a portrait image and speech audio.
• InfiniteTalk — Generate speech-driven talking-character videos from image and audio inputs.

Authentication

For authentication details, please refer to the Authentication Guide.

API Endpoints

Submit Task & Query Result

set -euo pipefail

export WAVESPEED_API_KEY="your-api-key"

REQUEST_BODY=$(cat <<'JSON'
{
  "image": "https://interactive-examples.mdn.mozilla.net/media/cc0-images/painted-hand-298-332.jpg",
  "audio": "https://interactive-examples.mdn.mozilla.net/media/cc0-audio/t-rex-roar.mp3"
}
JSON
)

# 1. Submit the prediction once. Never retry this request automatically:
# a retry after an unclear failure can create a second, billed task.
CHECK='The task may already exist. Check History or the predictions list before submitting again.'
if ! SUBMIT_RESPONSE=$(curl --silent --show-error --fail-with-body \
  --connect-timeout 10 --max-time 60 \
  -X POST "https://api.wavespeed.ai/api/v3/bytedance/omni-human-2.0" \
  -H "Authorization: Bearer ${WAVESPEED_API_KEY}" \
  -H "Content-Type: application/json" \
  -d "${REQUEST_BODY}"); then
  printf 'Submit failed. %s\n' "${CHECK}" >&2
  exit 1
fi

TASK=$(printf '%s' "${SUBMIT_RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
PREDICTION_ID=$(printf '%s' "${TASK}" | jq -r '.id // empty')
if [ -z "${PREDICTION_ID}" ]; then
  printf 'Submission response did not contain a prediction id. %s\n' "${CHECK}" >&2
  exit 1
fi
RESULT_URL="https://api.wavespeed.ai/api/v3/predictions/${PREDICTION_ID}/result"

# 2. Poll until the prediction reaches a final status.
BODY_FILE=$(mktemp)
trap 'rm -f "${BODY_FILE}"' EXIT
while true; do
  # Transient errors (429, 5xx) are retried, honoring Retry-After.
  HTTP_CODE=$(curl --silent --show-error --fail-with-body \
    --connect-timeout 10 --max-time 60 --retry 5 --retry-delay 2 \
    --output "${BODY_FILE}" --write-out '%{http_code}' \
    "${RESULT_URL}" \
    -H "Authorization: Bearer ${WAVESPEED_API_KEY}" || true)
  case "${HTTP_CODE}" in
    2??) ;;
    000|429|5??)  # dropped connection or temporary error: keep polling
      printf 'Task %s: HTTP %s, polling again in 10s\n' "${PREDICTION_ID}" "${HTTP_CODE}" >&2
      sleep 10; continue ;;
    *) printf 'Task %s: HTTP %s\n' "${PREDICTION_ID}" "${HTTP_CODE}" >&2
      cat "${BODY_FILE}" >&2; exit 1 ;;
  esac
  RESULT=$(jq 'if type == "object" and has("data") then .data else . end' "${BODY_FILE}")
  STATUS=$(printf '%s' "${RESULT}" | jq -r '.status // empty')

  case "${STATUS}" in
    completed) printf '%s\n' "${RESULT}" | jq '.outputs'; break ;;
    failed|cancelled|timeout|deleted)
      printf 'Task %s ended with status %s\n' "${PREDICTION_ID}" "${STATUS}" >&2
      printf '%s\n' "${RESULT}" | jq . >&2; exit 1 ;;
    *) sleep 2 ;;
  esac
done

Parameters

Task Submission Parameters

Request Parameters

Every model also accepts the global request options enable_sync_mode and enable_base64_output; see their pages for details.

Response Parameters

Result Request Parameters

Result Response Parameters