Avatar Omni Human 1.5 | AI Digital Human API

Avatar Omni-Human 1.5

Avatar Omni-Human 1.5 is an advanced vision-audio fusion model designed to animate avatars through cognitive and emotional simulation. By combining image and audio inputs, it brings static portraits to life — generating natural facial expressions, synchronized lip movements, and realistic emotional responses.

🧠 Concept

Inspired by the paper “Instilling an Active Mind in Avatars via Cognitive Simulation”, the model simulates attention, emotion, and cognition to create avatars that don’t just move — they react intelligently.

🌟 Key Features

Audio-Driven Realism Generates precise lip-sync and emotional nuance directly from voice input.
Expressive Cognitive Simulation Models subtle eye movements, micro-expressions, and reactive behavior to emulate human presence.
Universal Avatar Adaptation Works with any static portrait or illustration to create consistent, lifelike performance.
Cross-Domain Support Handles both photorealistic and stylized avatars, adapting its realism to the visual style.
Flexible Output Encoding Choose between URL output or BASE64 encoding for seamless integration via API.

⚙️ Parameters

Parameter	Description
image*	Upload a reference portrait or character image (JPG / PNG).
audio*	Upload or link to an audio file (WAV / MP3) for lip-sync and emotion mapping.

💰 Pricing

Metric	Price
Per second of generated audio	$0.25 / s

💡 Use Cases

Digital Avatars & VTubing — Drive realistic avatars from real voices in real time.
Virtual Humans & NPCs — Give game or metaverse characters believable cognitive reactions.
Marketing & Storytelling — Create expressive digital spokespeople or narrators.
AI Companions & Education — Build avatars that engage naturally in learning or dialogue contexts.

📝 Notes

The longer the audio, the higher the total cost (calculated per second).
For best results, use clear, high-quality audio and well-lit frontal images.
BASE64 output is API-only, useful for direct embedding into web applications.

Avatar Omni Human 1.5 API — Quick start

Grab a WaveSpeedAI API key, then call POST https://api.wavespeed.ai/api/v3/bytedance/avatar-omni-human-1.5 with your input as JSON. The endpoint returns a prediction id. Start polling the result endpoint around every 2 seconds, increase the interval for long-running tasks, and stop on any terminal status. On completed, read URLs from data.outputs. Examples for Avatar Omni Human 1.5 below.

HTTP example

# Submit the prediction
curl --fail-with-body --connect-timeout 10 --max-time 60 \
  -X POST "https://api.wavespeed.ai/api/v3/bytedance/avatar-omni-human-1.5" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY" \
  -d '{
    "image": "https://example.com/your-input.jpg",
    "audio": "https://example.com/your-audio.mp3",
    "enable_base64_output": false
}'

# Wait at least 2 seconds, then poll. Safe GET requests may be retried.
curl --fail-with-body --connect-timeout 10 --max-time 30 \
  --retry 4 --retry-all-errors --retry-delay 1 \
  -X GET "https://api.wavespeed.ai/api/v3/predictions/{request_id}/result" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY"

# Start at 2 seconds and increase the interval for long-running tasks.
# Stop on completed, failed, cancelled, or timeout.

Node.js example

// npm install wavespeed
const { Client } = require('wavespeed');

const apiKey = process.env.WAVESPEED_API_KEY;
if (!apiKey) throw new Error('Set WAVESPEED_API_KEY');
const client = new Client(apiKey);

try {
  const result = await client.run("bytedance/avatar-omni-human-1.5", {
        "image": "https://example.com/your-input.jpg",
        "audio": "https://example.com/your-audio.mp3",
        "enable_base64_output": false
}, {
    timeout: 3600,
    pollInterval: 2.0,
  });
  console.log(result.outputs);
} catch (error) {
  console.error('Generation failed:', error);
  process.exitCode = 1;
}

Python example

# pip install wavespeed
import os
from wavespeed import Client

client = Client(api_key=os.environ["WAVESPEED_API_KEY"])

try:
    output = client.run(
        "bytedance/avatar-omni-human-1.5",
        {
    "image": "https://example.com/your-input.jpg",
    "audio": "https://example.com/your-audio.mp3",
    "enable_base64_output": false
},
        timeout=3600.0,
        poll_interval=2.0,
    )
    print(output["outputs"])
except Exception as error:
    raise SystemExit(f"Generation failed: {error}") from error

Avatar Omni Human 1.5 API — Frequently asked questions

What is the Avatar Omni Human 1.5 API?

Avatar Omni Human 1.5 is a ByteDance model for talking-avatar generation, exposed as a REST API on WaveSpeedAI. OmniHuman 1.5 converts audio and visual cues into lifelike avatar animations for virtual humans, storytelling, and interactive agents. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing. You can call it programmatically or try it from the playground above.

How do I call the Avatar Omni Human 1.5 API?

POST your input parameters to the model's REST endpoint (shown in the API tab of this playground) with your WaveSpeedAI API key in the Authorization header. Submission returns a prediction ID. Poll the result endpoint starting around every 2 seconds, increase the interval for long-running tasks, and stop on any terminal status. The playground generates production-oriented Python, JavaScript, and cURL examples with timeouts, transient-error handling, and safe GET retries. Full request/response shape is documented at https://wavespeed.ai/docs/docs-api/bytedance/bytedance-avatar-omni-human-1.5.

How much does Avatar Omni Human 1.5 cost per run?

Avatar Omni Human 1.5 starts at $0.16 per run. That figure is the base price — the final charge scales with the parameters you set in the form (output size, length, count, references, or whatever knobs this model exposes), so a higher-quality or larger output costs more than a minimal one. The exact cost for your current input is shown live next to the Generate button before you submit, and the actual per-call charge is recorded on the prediction afterwards.

What inputs does Avatar Omni Human 1.5 accept?

Key inputs: `image`, `audio`, `enable_base64_output`. The full JSON schema (types, defaults, allowed values) is rendered above the Generate button and mirrored in the API reference at https://wavespeed.ai/docs/docs-api/bytedance/bytedance-avatar-omni-human-1.5.

How long does Avatar Omni Human 1.5 take to generate?

Average end-to-end generation time on WaveSpeedAI is around 261 seconds per request — measured across recent runs. Queue time scales with global demand; live status is visible in the prediction record.

Can I use Avatar Omni Human 1.5 outputs commercially?

Commercial usage rights depend on the model's license, set by its provider (ByteDance). The license summary appears on the model card above; see WaveSpeedAI's Terms of Service for platform-level conditions.

ExamplesView all

Related Models

README