Avatar Omni Human 1.5 | AI Digital Human API

Avatar Omni-Human 1.5

Avatar Omni-Human 1.5 is an advanced vision-audio fusion model designed to animate avatars through cognitive and emotional simulation. By combining image and audio inputs, it brings static portraits to life — generating natural facial expressions, synchronized lip movements, and realistic emotional responses.

🧠 Concept

Inspired by the paper “Instilling an Active Mind in Avatars via Cognitive Simulation”, the model simulates attention, emotion, and cognition to create avatars that don’t just move — they react intelligently.

🌟 Key Features

Audio-Driven Realism Generates precise lip-sync and emotional nuance directly from voice input.
Expressive Cognitive Simulation Models subtle eye movements, micro-expressions, and reactive behavior to emulate human presence.
Universal Avatar Adaptation Works with any static portrait or illustration to create consistent, lifelike performance.
Cross-Domain Support Handles both photorealistic and stylized avatars, adapting its realism to the visual style.
Flexible Output Encoding Choose between URL output or BASE64 encoding for seamless integration via API.

⚙️ Parameters

Parameter	Description
image*	Upload a reference portrait or character image (JPG / PNG).
audio*	Upload or link to an audio file (WAV / MP3) for lip-sync and emotion mapping.

💰 Pricing

Metric	Price
Per second of generated audio	$0.25 / s

💡 Use Cases

Digital Avatars & VTubing — Drive realistic avatars from real voices in real time.
Virtual Humans & NPCs — Give game or metaverse characters believable cognitive reactions.
Marketing & Storytelling — Create expressive digital spokespeople or narrators.
AI Companions & Education — Build avatars that engage naturally in learning or dialogue contexts.

📝 Notes

The longer the audio, the higher the total cost (calculated per second).
For best results, use clear, high-quality audio and well-lit frontal images.
BASE64 output is API-only, useful for direct embedding into web applications.

Avatar Omni Human 1.5 API — Quick start

Grab a WaveSpeedAI API key, then call POST https://api.wavespeed.ai/api/v3/bytedance/avatar-omni-human-1.5 with your input as JSON. The endpoint returns a prediction id; poll the prediction endpoint until status flips to completed, then read the output URL from data.outputs[0]. Examples for Avatar Omni Human 1.5 below.

HTTP example

# Submit the prediction
curl -X POST "https://api.wavespeed.ai/api/v3/bytedance/avatar-omni-human-1.5" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY" \
  -d '{
    "image": "https://example.com/your-input.jpg",
    "audio": "https://example.com/your-audio.mp3",
    "enable_base64_output": false
}'

# Response includes a prediction id. Poll for the result:
curl -X GET "https://api.wavespeed.ai/api/v3/predictions/{request_id}/result" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY"

# When status is "completed", read the output from data.outputs[0].

Node.js example

// npm install wavespeed
const WaveSpeed = require('wavespeed');

const client = new WaveSpeed(); // reads WAVESPEED_API_KEY from env

const result = await client.run("bytedance/avatar-omni-human-1.5", {
        "image": "https://example.com/your-input.jpg",
        "audio": "https://example.com/your-audio.mp3",
        "enable_base64_output": false
});

console.log(result.outputs[0]); // → URL of the generated output

Python example

# pip install wavespeed
import wavespeed

output = wavespeed.run(
    "bytedance/avatar-omni-human-1.5",
    {
    "image": "https://example.com/your-input.jpg",
    "audio": "https://example.com/your-audio.mp3",
    "enable_base64_output": false
}
)

print(output["outputs"][0])  # → URL of the generated output

Avatar Omni Human 1.5 API — Frequently asked questions

What is the Avatar Omni Human 1.5 API?

Avatar Omni Human 1.5 is a ByteDance model for talking-avatar generation, exposed as a REST API on WaveSpeedAI. OmniHuman 1.5 converts audio and visual cues into lifelike avatar animations for virtual humans, storytelling, and interactive agents. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing. You can call it programmatically or try it from the playground above.

How do I call the Avatar Omni Human 1.5 API?

POST your input parameters to the model's REST endpoint (shown in the API tab of this playground) with your WaveSpeedAI API key in the Authorization header. Submission returns a prediction ID; poll the prediction endpoint until status flips to "completed", then read the output URL from the result. The playground generates a ready-to-paste code sample in Python, JavaScript, or cURL for whatever inputs you've set. Full request/response shape is documented at https://wavespeed.ai/docs/docs-api/bytedance/bytedance-avatar-omni-human-1.5.

How much does Avatar Omni Human 1.5 cost per run?

Avatar Omni Human 1.5 starts at $0.16 per run. That figure is the base price — the final charge scales with the parameters you set in the form (output size, length, count, references, or whatever knobs this model exposes), so a higher-quality or larger output costs more than a minimal one. The exact cost for your current input is shown live next to the Generate button before you submit, and the actual per-call charge is recorded on the prediction afterwards.

What inputs does Avatar Omni Human 1.5 accept?

Key inputs: `image`, `audio`, `enable_base64_output`. The full JSON schema (types, defaults, allowed values) is rendered above the Generate button and mirrored in the API reference at https://wavespeed.ai/docs/docs-api/bytedance/bytedance-avatar-omni-human-1.5.

How long does Avatar Omni Human 1.5 take to generate?

Average end-to-end generation time on WaveSpeedAI is around 261 seconds per request — measured across recent runs. Queue time scales with global demand; live status is visible in the prediction record.

Can I use Avatar Omni Human 1.5 outputs commercially?

Commercial usage rights depend on the model's license, set by its provider (ByteDance). The license summary appears on the model card above; see WaveSpeedAI's Terms of Service for platform-level conditions.

BeispieleAlle anzeigen

Ähnliche Modelle

README