Google Gemini Omni 1.1 Flash Reference To Video API Documentation

Google Gemini Omni 1.1 Flash Reference To Video API Documentation

Playground

Try it on WaveSpeedAI!

Gemini Omni 1.1 Flash Reference to Video creates synchronized audiovisual clips from a prompt plus optional image and video references at resolutions from 360p to 4K. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

Features

Create a synchronized audiovisual scene from a prompt plus multimodal references. Combine still images for identity, character, or environment guidance with short video references for motion and visual context.

Why Choose This?

  • Image and video guidance — Combine up to 10 images with up to 3 short reference videos.
  • Character and context consistency — Preserve recognizable subjects and visual context while directing a new scene.
  • Motion guidance — Use video references to communicate dances, gestures, camera behavior, or other movement that is difficult to describe with text alone.
  • Draft-to-production workflow — Prototype at 360p and render selected results at 1080p or 4K.

Parameters

ParameterRequiredDescription
promptYesExplain the desired scene and the role of each reference.
imagesNoUp to 10 reference image URLs.
reference_videosNoUp to 3 reference video URLs; each must be no longer than 3 seconds.
aspect_ratioNo16:9 or 9:16. Default: 16:9.
resolutionNo360p, 720p, 1080p, or 4k. Default: 720p.
durationNo3–10 seconds. Default: 8 seconds.

Pricing

ResolutionPrice per second
360p$0.048
720p$0.16
1080p$0.24
4K$0.48

Billing is based on generated duration and the selected resolution.

Authentication

For authentication details, please refer to the Authentication Guide.

API Endpoints

Submit Task & Query Result

set -euo pipefail

export WAVESPEED_API_KEY="your-api-key"

REQUEST_BODY=$(cat <<'JSON'
{
  "prompt": "A cinematic ocean wave at sunrise, highly detailed",
  "aspect_ratio": "16:9",
  "resolution": "720p",
  "duration": 8
}
JSON
)

# 1. Submit the prediction.
SUBMIT_RESPONSE=$(curl --silent --show-error --fail-with-body \
  -X POST "https://api.wavespeed.ai/api/v3/google/gemini-omni-1.1-flash/reference-to-video" \
  -H "Authorization: Bearer ${WAVESPEED_API_KEY}" \
  -H "Content-Type: application/json" \
  -d "${REQUEST_BODY}")

TASK=$(printf '%s' "${SUBMIT_RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
PREDICTION_ID=$(printf '%s' "${TASK}" | jq -r '.id // empty')
if [ -z "${PREDICTION_ID}" ]; then
  printf 'Submission response did not contain a prediction id
' >&2
  exit 1
fi
RESULT_URL="https://api.wavespeed.ai/api/v3/predictions/${PREDICTION_ID}/result"

# 2. Poll until the prediction finishes.
while true; do
  RESPONSE=$(curl --silent --show-error --fail-with-body \
    "${RESULT_URL}" \
    -H "Authorization: Bearer ${WAVESPEED_API_KEY}")
  RESULT=$(printf '%s' "${RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
  STATUS=$(printf '%s' "${RESULT}" | jq -r '.status // empty')

  case "${STATUS}" in
    completed) printf '%s\n' "${RESULT}" | jq '.outputs'; break ;;
    failed|cancelled|timeout|deleted) printf '%s\n' "${RESULT}" | jq . >&2; exit 1 ;;
    *) sleep 2 ;;
  esac
done

Parameters

Task Submission Parameters

Request Parameters

ParameterTypeRequiredDefaultRangeDescription
promptstringYes-Text prompt describing the video and how the reference media should guide the result.
imagesarray<string>No-0 ~ 10 itemsReference image URLs to incorporate into the video.
reference_videosarray<string>No-0 ~ 3 itemsUp to three reference video URLs. Each video must be no longer than 3 seconds.
aspect_ratiostringNo16:916:9, 9:16Aspect ratio of the generated video.
resolutionstringNo720p360p, 720p, 1080p, 4kResolution of the generated video.
durationintegerNo83, 4, 5, 6, 7, 8, 9, 10Duration of the generated video in seconds.

Response Parameters

ParameterTypeDescription
codeintegerHTTP status code (e.g., 200 for success)
messagestringStatus message (e.g., “success”)
data.idstringUnique identifier for the prediction, Task Id
data.modelstringModel ID used for the prediction
data.outputsarrayOutput values, usually URL strings; some models return text strings or structured result objects (empty when status is not completed)
data.urlsobjectObject containing related API endpoints
data.statusstringTask status. completed is successful; failed, cancelled, timeout, and deleted are failure terminal statuses.
data.created_atstringISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”)
data.errorstringError message (empty if no error occurred)
data.timingsobjectObject containing timing details
data.timings.inferenceintegerInference time in milliseconds

Result Request Parameters

ParameterTypeRequiredDefaultDescription
idstringYes-Task ID

Result Response Parameters

ParameterTypeDescription
codeintegerHTTP status code (e.g., 200 for success)
messagestringStatus message (e.g., “success”)
dataobjectThe prediction data object containing all details
data.idstringUnique identifier for the prediction
data.modelstringModel ID used for the prediction
data.outputsarray<string | object>Array of generated outputs (empty when status is not completed). Items are usually URL strings, but may be text strings or structured result objects, depending on the model.
data.urlsobjectObject containing related API endpoints
data.statusstringStatus: completed is successful; failed, cancelled, timeout, and deleted are failure terminal statuses
data.created_atstringISO timestamp of when the request was created
data.errorstringError message (empty if no error occurred)
data.timingsobjectObject containing timing details
data.timings.inferenceintegerInference time in milliseconds
© 2026 WaveSpeedAI. All rights reserved.