Vidu Reference to Video 2.0
Create videos that align with reference subjects—like characters, objects, and environments—using the world’s first Multi-Entity Consistency feature.
Features
Vidu2.0 Reference to Video maintains the character and beauty of reference images for video production. The model keeps the facial and visual consistency of avatars, characters and logos.
Key Features
- Identity-locked generation
- Smooth temporal transitions
- Consistent character motion
- Visual style adherence
Use Cases
- Digital influencers & avatars
- Story-driven video characters
- Fashion or cosplay generation
- Personalization in marketing
Accelerated Inference
Our accelerated inference approach leverages advanced optimization technology from WavespeedAI. This innovative fusion technique significantly reduces computational overhead and latency, enabling rapid image generation without compromising quality. The entire system is designed to efficiently handle large-scale inference tasks while ensuring that real-time applications achieve an optimal balance between speed and accuracy. For further details, please refer to the blog post.
Authentication
For authentication details, please refer to the Authentication Guide.
API Endpoints
Submit Task & Query Result
# Submit the task
curl --location --request POST "https://api.wavespeed.ai/api/v3/vidu/reference-to-video-2.0" \
--header "Content-Type: application/json" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}" \
--data-raw '{
"images": [
"https://d2g64w682n9w0w.cloudfront.net/media/images/1745492230971199265_J3J5tO7p.jpg",
"https://d2g64w682n9w0w.cloudfront.net/media/images/1745492247387641003_Z3jDAxur.jpg"
],
"prompt": "the girl walks from the painting to the room, put the coffee cup on the table",
"aspect_ratio": "16:9",
"movement_amplitude": "auto",
"seed": 0
}'
# Get the result
curl --location --request GET "https://api.wavespeed.ai/api/v3/predictions/${requestId}/result" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}"
Parameters
Task Submission Parameters
Request Parameters
| Parameter | Type | Required | Default | Range | Description |
|---|---|---|---|---|---|
| images | array | Yes | https://d2g64w682n9w0w.cloudfront.net/media/images/1745492230971199265_J3J5tO7p.jpghttps://d2g64w682n9w0w.cloudfront.net/media/images/1745492247387641003_Z3jDAxur.jpg | - | The model will use the provided images as references to generate a video with consistent subjects. For fields that accept images: Accepts 1 to 3 images; Images Assets can be provided via URLs or Base64 encode; You must use one of the following codecs: PNG, JPEG, JPG, WebP; The dimensions of the images must be at least 128x128 pixels; The aspect ratio of the images must be less than 1:4 or 4:1; All images are limited to 50MB; The length of the base64 decode must be under 50MB, and it must include an appropriate content type string. |
| prompt | string | Yes | - | Text prompt: A textual description for video generation, with a maximum length of 1500 characters | |
| aspect_ratio | string | No | 16:9 | - | The aspect ratio of the output video. Defaults to 16:9, accepted: 16:9 9:16 1:1. |
| movement_amplitude | string | No | auto | - | The movement amplitude of objects in the frame. Defaults to auto, accepted value: auto, small, medium, large. |
| seed | integer | No | - | -1 ~ 2147483647 | The seed to use for generating the video. Random seed: Defaults to a random seed number; Manually set values will override the default random seed. |
Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data.id | string | Unique identifier for the prediction, Task Id |
| data.model | string | Model ID used for the prediction |
| data.outputs | array | Array of URLs to the generated content (empty when status is not completed) |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.has_nsfw_contents | array | Array of boolean values indicating NSFW detection for each output |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |
Result Query Parameters
Result Request Parameters
| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
| id | string | Yes | - | Task ID |
Result Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data | object | The prediction data object containing all details |
| data.id | string | Unique identifier for the prediction |
| data.model | string | Model ID used for the prediction |
| data.outputs | array | Array of URLs to the generated content (empty when status is not completed) |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.has_nsfw_contents | array | Array of boolean values indicating NSFW detection for each output |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |