Alibaba Wan 3.0 Reference To Video API Documentation

Alibaba Wan 3.0 Reference To Video API Documentation

Playground

Try it on WaveSpeedAI!

Wan 3.0 Reference to Video creates coherent videos from prompts and multimodal references, including images, videos, and audio, with flexible 2-30 second duration and aspect ratio control for subject consistency, motion guidance, timing control, and scene continuity. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

Features

Wan 3.0 Reference-to-Video combines reference images, videos, and audio with a prompt to create coherent video scenes. It supports multimodal reference guidance for character consistency, object control, motion direction, audio style, and scene composition.


Parameters

ParameterRequiredDescription
promptYesText prompt describing the desired scene, subject, motion, camera movement, lighting, and style.
reference_imagesConditionalUp to 10 reference images. At least one reference media array is required.
reference_videosConditionalUp to 5 reference video inputs. Each video must be MP4 or MOV, 1–15 seconds, 240–4096 pixels on each side, no more than 8:1 aspect ratio, and no more than 100 MB. Total reference video duration must not exceed 15 seconds.
reference_audiosConditionalUp to 5 reference audio files. Total reference audio duration must not exceed 15 seconds.
resolutionNoOutput resolution: 480p, 720p, or 1080p. Default: 720p.
aspect_ratioNoOutput aspect ratio. Default: 16:9.
durationNoOutput duration in seconds. Range: 2–30. Default: 5.
thinking_modeNoEnable deep-thinking mode for more deliberate prompt interpretation. Default: false.
enable_audioNoInclude audio in the output. Default: true.
seedNoRandom seed from 0 to 2147483647.

At least one of reference_images, reference_videos, or reference_audios is required.


How to Use

  1. Add reference media — Provide reference images, videos, audio, or a combination of them.
  2. Write your prompt — Describe the target scene, action, camera movement, lighting, style, and how the references should be used.
  3. Choose resolution — Use 480p for lower-cost drafts, 720p for balanced output, or 1080p for higher quality.
  4. Set aspect ratio — Select the output format that matches your target platform or creative direction.
  5. Set duration — Choose a duration from 2 to 30 seconds.
  6. Configure audio optional — Keep enable_audio enabled when audio is needed.
  7. Enable thinking mode optional — Use thinking_mode for complex prompts with multiple reference requirements.
  8. Submit — Generate the final reference-guided video.

Pricing

Pricing is based on output resolution and billed duration.

Billed duration is rounded up to the next whole second and clamped to the 2–30s range.

ResolutionPer 5sPer second
480p$0.35$0.07
720p$0.65$0.13
1080p$1.40$0.28

Example Costs

Resolution2s5s10s30s
480p$0.14$0.35$0.70$2.10
720p$0.26$0.65$1.30$3.90
1080p$0.56$1.40$2.80$8.40

Best Use Cases

  • Character-consistent storytelling — Generate scenes guided by character, face, outfit, or style references.
  • Multi-reference video generation — Combine people, objects, environments, motion, and audio references in one workflow.
  • Product and brand videos — Use reference assets to preserve product appearance or campaign style.
  • Audio-guided scenes — Use reference audio to guide mood, rhythm, ambience, or sound direction.
  • Social media content — Create short-form videos from multimodal references.
  • Creative prototyping — Test different scene directions while keeping reference-guided consistency.

Pro Tips

  • Use clear reference images when identity, product detail, or visual style matters.
  • Use reference videos when motion, pacing, gesture, or camera behavior matters.
  • Use reference audio when ambience, rhythm, voice style, or soundtrack direction matters.
  • Explain how each reference should influence the final video in the prompt.
  • Use 480p for quick drafts and 1080p for higher-quality output.
  • Enable thinking_mode for prompts that combine multiple references or detailed scene requirements.
  • Set a fixed seed when you want more reproducible results.

Authentication

For authentication details, please refer to the Authentication Guide.

API Endpoints

Submit Task & Query Result

set -euo pipefail

export WAVESPEED_API_KEY="your-api-key"

REQUEST_BODY=$(cat <<'JSON'
{
  "prompt": "A cinematic ocean wave at sunrise, highly detailed",
  "resolution": "720p",
  "aspect_ratio": "16:9",
  "duration": 5,
  "thinking_mode": false,
  "enable_audio": true
}
JSON
)

# 1. Submit the prediction.
SUBMIT_RESPONSE=$(curl --silent --show-error --fail-with-body \
  -X POST "https://api.wavespeed.ai/api/v3/alibaba/wan-3.0/reference-to-video" \
  -H "Authorization: Bearer ${WAVESPEED_API_KEY}" \
  -H "Content-Type: application/json" \
  -d "${REQUEST_BODY}")

TASK=$(printf '%s' "${SUBMIT_RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
PREDICTION_ID=$(printf '%s' "${TASK}" | jq -r '.id // empty')
if [ -z "${PREDICTION_ID}" ]; then
  printf 'Submission response did not contain a prediction id
' >&2
  exit 1
fi
RESULT_URL=$(printf '%s' "${TASK}" | jq -r '.urls.get // empty')
if [ -z "${RESULT_URL}" ]; then RESULT_URL="https://api.wavespeed.ai/api/v3/predictions/${PREDICTION_ID}/result"; fi

# 2. Poll until the prediction finishes.
while true; do
  RESPONSE=$(curl --silent --show-error --fail-with-body \
    "${RESULT_URL}" \
    -H "Authorization: Bearer ${WAVESPEED_API_KEY}")
  RESULT=$(printf '%s' "${RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
  STATUS=$(printf '%s' "${RESULT}" | jq -r '.status // empty')

  case "${STATUS}" in
    completed) printf '%s\n' "${RESULT}" | jq '.outputs'; break ;;
    failed|cancelled|timeout) printf '%s\n' "${RESULT}" | jq . >&2; exit 1 ;;
    created|processing) sleep 2 ;;
    *) printf 'Unexpected status: %s
' "${STATUS}" >&2; exit 1 ;;
  esac
done

Parameters

Task Submission Parameters

Request Parameters

ParameterTypeRequiredDefaultRangeDescription
promptstringYes-The positive prompt for the generation. Reference media are identified by their array order in the prompt.
reference_imagesarray<string>No-0 ~ 10 itemsArray of reference image URLs (up to 10). At least one reference image, video, or audio is required.
reference_videosarray<string>No-0 ~ 5 itemsArray of reference video URLs (up to 5). Each video must be MP4 or MOV, 1-15 seconds, 240-4096 pixels on each side, no more than 8:1 aspect ratio, and no more than 100 MB. Total input video duration must not exceed 15 seconds. Supports HTTP/HTTPS URLs and temporary OSS URLs.
reference_audiosarray<string>No-0 ~ 5 itemsArray of reference audio URLs (up to 5). Total input audio duration must not exceed 15 seconds.
resolutionstringNo720p480p, 720p, 1080pThe resolution of the generated video.
aspect_ratiostringNo16:916:9, 9:16, 1:1, 4:3, 3:4The aspect ratio of the generated video.
durationintegerNo52 ~ 30The duration of the generated media in seconds (2-30s).
thinking_modebooleanNofalse-Whether to enable deep-thinking mode for complex prompts and richer scene understanding.
enable_audiobooleanNotrue-Whether to include audio in the generated video.
seedintegerNo-0 ~ 2147483647The random seed to use for the generation. Must be between 0 and 2147483647. If omitted, a random seed will be used.

Response Parameters

ParameterTypeDescription
codeintegerHTTP status code (e.g., 200 for success)
messagestringStatus message (e.g., “success”)
data.idstringUnique identifier for the prediction, Task Id
data.modelstringModel ID used for the prediction
data.outputsarrayOutput values, usually URL strings; some models return text strings or structured result objects (empty when status is not completed)
data.urlsobjectObject containing related API endpoints
data.urls.getstringURL to retrieve the prediction result
data.statusstringStatus of the task: created, processing, completed, or failed
data.created_atstringISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”)
data.errorstringError message (empty if no error occurred)
data.timingsobjectObject containing timing details
data.timings.inferenceintegerInference time in milliseconds

Result Request Parameters

ParameterTypeRequiredDefaultDescription
idstringYes-Task ID

Result Response Parameters

ParameterTypeDescription
codeintegerHTTP status code (e.g., 200 for success)
messagestringStatus message (e.g., “success”)
dataobjectThe prediction data object containing all details
data.idstringUnique identifier for the prediction
data.modelstringModel ID used for the prediction
data.outputsarray<string | object>Array of generated outputs (empty when status is not completed). Items are usually URL strings, but may be text strings or structured result objects, depending on the model.
data.urlsobjectObject containing related API endpoints
data.urls.getstringURL to poll for the prediction result
data.statusstringStatus: created, processing, completed, or failed
data.created_atstringISO timestamp of when the request was created
data.errorstringError message (empty if no error occurred)
data.timingsobjectObject containing timing details
data.timings.inferenceintegerInference time in milliseconds
© 2026 WaveSpeedAI. All rights reserved.