Minimax H3 Reference To Video LoRA API Documentation
Playground
Try it on WaveSpeedAI!MiniMax H3 Open Weights Reference to Video with custom LoRA support generates coherent 480P / 768P videos from prompts and multimodal references, guided by up to 9 reference images, 3 reference videos, and 3 reference audios, with native stereo audio and flexible reference-based video generation on WaveSpeedAI infrastructure. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.
Features
Run the open-weights edition of MiniMax H3 on WaveSpeedAI’s own GPU infrastructure. This endpoint is separate from the official minimax/h3 API: same model family, independently hosted, with its own 480p/768p resolutions and per-second pricing.
MiniMax H3 is an omni-modal video model that generates picture and native stereo audio in a single pass. In reference-to-video mode you guide the generation with up to 9 reference images, 3 reference videos, and 3 reference audio tracks, then tell the model — in the prompt — what each reference is for.
How to Use References
Refer to every input in the prompt with an angle-bracket tag: <Picture 1>, <Video 1>, <Audio 1>, and so on. The tags must be written exactly like that, with the brackets — plain text such as Picture 1 is treated as ordinary words, not a reference.
Assign a job to each reference. Explicit assignments work far better than leaving the model to guess:
> “Use the character from <Picture 1>, place them in the setting from <Picture 2>, and match the camera motion of <Video 1>.”
Numbering
- Tags are numbered per type, in the order the inputs are provided: images are
<Picture 1>…<Picture 9>, standalone audios are<Audio 1>…, videos are<Video 1>…<Video 3>. - A reference video’s own soundtrack is used automatically and occupies the earliest
<Audio …>slots; any standalonereference_audiosyou provide are numbered after the video soundtracks. If you only need the video’s audio, refer to it via its<Video …>tag.
Rules
- At least one reference image or video is required. Audio cannot be provided alone.
reference_videosis available only at 480p output resolution.- Reference video soundtracks are picked up automatically; total reference-video duration shares a 15-second budget and longer inputs are trimmed fairly.
How to Write a Great Prompt
Write the prompt as a timeline with a schedule, and weave the reference tags into it:
- Style & references — establish the look and say which reference drives identity, style, motion, or voice.
- Timeline — timestamped beats: “[0s-3s]
<Picture 1>stands on the balcony from<Picture 2>… [3s-6s] turns toward camera and smiles …”. - Camera — explicit movement, including when to hold: “slow orbit, no cuts”.
- Audio — an
Audio:line with entrance cues; reference an input voice or track by tag if you want it matched. - On-screen text — spell out readable words in quotes and add “no subtitles, do not add other text.”
Parameters
| Parameter | Required | Description |
|---|---|---|
| prompt | Yes | Desired video with references addressed as <Picture 1>, <Video 1>, <Audio 1>, plus an Audio: line for the soundtrack. |
| reference_images | No | Up to 9 reference image URLs. |
| reference_videos | No | Up to 3 reference video URLs. 480p output only. Their soundtracks are used automatically. |
| reference_audios | No | Up to 3 standalone reference audio URLs (each trimmed to 15s). |
| aspect_ratio | No | 16:9, 9:16, 1:1, 4:3, 3:4, 21:9, or 9:21. Default: 16:9. |
| resolution | No | 480p (faster, lower cost) or 768p (native canvas). Default: 480p. |
| duration | No | Output length in seconds, 3–15. Default: 5. |
| seed | No | Fixed seed for reproducible output. |
| loras | No | Up to 3 LoRA weights, each {path, scale}; path is a LoRA file URL. |
At least one of reference_images, reference_videos, or reference_audios is required.
Specifications
| Item | Detail |
|---|---|
| Output | MP4 with native stereo audio |
| Frame rate | 24 fps |
| Resolution | 480p or 768p |
| Duration | 3–15 seconds (snaps to the model’s frame grid, so a 5s request lands at ~5.2s) |
| Reference images | Up to 9 |
| Reference videos | Up to 3, 480p output only, 15s total budget |
| Reference audio | Up to 3, trimmed to 15s each |
| Seed | Supported |
Pricing
Output video is billed per generated second, plus per-reference charges:
| Item | Price |
|---|---|
| Output video (480p) | $0.06 / second |
| Output video (768p) | $0.15 / second |
| Reference image | $0.02 each |
| Reference audio | $0.02 each |
| Reference video (480p) | $0.06 / second |
Explore the MiniMax H3 Open Weights Family
- MiniMax H3 Text-to-Video Open Weights — Generate video with native stereo audio directly from a text prompt.
- MiniMax H3 Image-to-Video Open Weights — Animate a first-frame image with prompt-guided motion and audio.
- MiniMax H3 Reference-to-Video Open Weights — Generate video from image, video, or audio references with prompt guidance.
Authentication
For authentication details, please refer to the Authentication Guide.
API Endpoints
Submit Task & Query Result
set -euo pipefail
export WAVESPEED_API_KEY="your-api-key"
REQUEST_BODY=$(cat <<'JSON'
{
"prompt": "A cinematic ocean wave at sunrise, highly detailed",
"aspect_ratio": "16:9",
"resolution": "480p",
"duration": 5,
"seed": -1
}
JSON
)
# 1. Submit the prediction.
SUBMIT_RESPONSE=$(curl --silent --show-error --fail-with-body \
-X POST "https://api.wavespeed.ai/api/v3/wavespeed-ai/minimax-h3/reference-to-video-lora" \
-H "Authorization: Bearer ${WAVESPEED_API_KEY}" \
-H "Content-Type: application/json" \
-d "${REQUEST_BODY}")
TASK=$(printf '%s' "${SUBMIT_RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
PREDICTION_ID=$(printf '%s' "${TASK}" | jq -r '.id // empty')
if [ -z "${PREDICTION_ID}" ]; then
printf 'Submission response did not contain a prediction id
' >&2
exit 1
fi
RESULT_URL=$(printf '%s' "${TASK}" | jq -r '.urls.get // empty')
if [ -z "${RESULT_URL}" ]; then RESULT_URL="https://api.wavespeed.ai/api/v3/predictions/${PREDICTION_ID}/result"; fi
# 2. Poll until the prediction finishes.
while true; do
RESPONSE=$(curl --silent --show-error --fail-with-body \
"${RESULT_URL}" \
-H "Authorization: Bearer ${WAVESPEED_API_KEY}")
RESULT=$(printf '%s' "${RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
STATUS=$(printf '%s' "${RESULT}" | jq -r '.status // empty')
case "${STATUS}" in
completed) printf '%s\n' "${RESULT}" | jq '.outputs'; break ;;
failed|cancelled|timeout) printf '%s\n' "${RESULT}" | jq . >&2; exit 1 ;;
created|processing) sleep 2 ;;
*) printf 'Unexpected status: %s
' "${STATUS}" >&2; exit 1 ;;
esac
doneParameters
Task Submission Parameters
Request Parameters
| Parameter | Type | Required | Default | Range | Description |
|---|---|---|---|---|---|
| prompt | string | Yes | - | Text description of the desired video. Refer to reference inputs as <Picture 1>..<Picture 9>, <Video 1>..<Video 3>, and <Audio 1>..<Audio 3>. Audio is generated natively together with the video. | |
| reference_images | array<string> | No | - | 0 ~ 9 items | Reference image URLs (up to 9). At least one reference input is required. |
| reference_videos | array<string> | No | - | 0 ~ 3 items | Reference video URLs (up to 3, only supported at 480p resolution). Their soundtracks are used automatically. Total reference video duration is budgeted to 15 seconds; longer inputs are truncated fairly. |
| reference_audios | array<string> | No | - | 0 ~ 3 items | Standalone reference audio URLs (up to 3, trimmed to 15 seconds each). |
| aspect_ratio | string | No | 16:9 | 16:9, 9:16, 1:1, 4:3, 3:4, 21:9, 9:21 | Output aspect ratio. |
| resolution | string | No | 480p | 480p, 768p | Output video resolution. 768p is the model's native canvas; 480p is a faster, lower-cost tier. |
| duration | integer | No | 5 | 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15 | Output video duration in seconds. |
| seed | integer | No | -1 | - | The random seed to use for the generation. -1 means a random seed will be used. |
| loras | array<object> | No | 0 ~ 3 items | List of LoRAs to apply (max 3). |
Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data.id | string | Unique identifier for the prediction, Task Id |
| data.model | string | Model ID used for the prediction |
| data.outputs | array | Output values, usually URL strings; some models return text strings or structured result objects (empty when status is not completed) |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |
Result Request Parameters
| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
| id | string | Yes | - | Task ID |
Result Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data | object | The prediction data object containing all details |
| data.id | string | Unique identifier for the prediction |
| data.model | string | Model ID used for the prediction |
| data.outputs | array<string | object> | Array of generated outputs (empty when status is not completed). Items are usually URL strings, but may be text strings or structured result objects, depending on the model. |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to poll for the prediction result |
| data.status | string | Status: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |