Mirelo AI Sfx V1 Video To Audio
Playground
Try it on WaveSpeedAI!Mirelo SFX V1 Video-to-Audio generates synchronized sound effects from video input with text prompt guidance. Supports multiple sample generation and customizable duration. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.
Features
Mirelo SFX V1 Video-to-Audio generates synchronized sound effects directly from video input, with optional text prompt guidance to steer the audio content. Upload a video, describe the sound you want, and get realistic, scene-matched audio output — multiple samples per run for easy A/B selection.
Why Choose This?
-
Video-synchronized sound effects Analyzes video content and generates audio that matches the on-screen action, environment, and pacing.
-
Text prompt guidance Optionally describe the desired sound to steer the output — useful for ambiguous scenes or specific audio requirements.
-
Multiple sample generation Generate several audio variations in one run and pick the best result without re-submitting.
-
Adjustable duration Control how many seconds of audio to generate, up to 10 seconds per run.
-
Reproducible results Use the seed parameter to lock in a specific output for exact reproduction.
Parameters
| Parameter | Required | Description |
|---|---|---|
| video | Yes | Input video to generate sound effects for (URL or file upload). |
| prompt | No | Text description to guide the style or content of the generated audio. |
| num_samples | No | Number of audio variations to generate per run. Default: 2. |
| duration | No | Length of audio to generate in seconds. Range: 2–10. Default: 5. |
| seed | No | Random seed for reproducible results. Use -1 for a random seed. |
How to Use
- Upload your video — provide the clip you want to generate sound for via URL or drag-and-drop.
- Write a prompt (optional) — describe the type of sound or atmosphere you want. Use the Prompt Enhancer for better results.
- Set num_samples — choose how many audio variations to generate in one run.
- Set duration — choose how many seconds of audio to generate (2–10 seconds).
- Set seed (optional) — fix the seed to reproduce a specific result, or leave at -1 for random.
- Submit — generate and download your synchronized audio.
Pricing
Billed at $0.007 per second per sample, with a minimum billable duration of 2 seconds and a maximum of 10 seconds.
| Duration | 1 Sample | 2 Samples | 4 Samples |
|---|---|---|---|
| 2s | $0.014 | $0.028 | $0.056 |
| 5s | $0.035 | $0.070 | $0.140 |
| 10s | $0.070 | $0.140 | $0.280 |
Billing Rules
- Rate: $0.007 per second per sample
- Minimum billable duration: 2 seconds
- Maximum billable duration: 10 seconds
- Total cost = billed duration × num_samples × $0.007
Best Use Cases
- Film & Video Post-Production — Add realistic ambient sound, foley, and environmental audio to silent or poorly recorded footage.
- Social Media Content — Enhance short-form videos with matching sound effects for higher engagement.
- Game & Interactive Media — Generate contextual sound effects from in-game or recorded footage.
- Advertising — Quickly produce polished audio for product videos and promotional clips.
- Content Automation — Batch-generate synchronized audio for high-volume video workflows via the REST API.
Pro Tips
- Leave the prompt empty to let the model infer audio purely from the video content.
- Use the prompt to override or refine the default interpretation — for example, specifying “rain on window glass” for an ambiguous indoor scene.
- Generate 3–4 samples per run to maximize variation and increase the chance of a perfect match.
- Fix the seed once you find a result you like to reproduce it exactly in future runs.
- Match duration to the key action window in your video for the most focused and accurate audio.
Notes
- video is the only required field; all other parameters are optional.
- Billable duration is clamped between 2 and 10 seconds regardless of actual video length.
- Ensure video URLs are publicly accessible if using a link rather than a direct upload.
Related Models
- Hunyuan Video Foley — Generate foley-style synchronized audio from video using Hunyuan’s audio model.
- Mirelo SFX V1.5 Video-to-Audio — Next-generation SFX model with improved audio quality and synchronization.
Authentication
For authentication details, please refer to the Authentication Guide.
API Endpoints
Submit Task & Query Result
set -euo pipefail
export WAVESPEED_API_KEY="your-api-key"
REQUEST_BODY=$(cat <<'JSON'
{
"video": "https://interactive-examples.mdn.mozilla.net/media/cc0-videos/flower.mp4",
"num_samples": 2,
"duration": 5,
"seed": -1
}
JSON
)
# 1. Submit the prediction.
SUBMIT_RESPONSE=$(curl --silent --show-error --fail-with-body \
-X POST "https://api.wavespeed.ai/api/v3/mirelo-ai/sfx-v1/video-to-audio" \
-H "Authorization: Bearer ${WAVESPEED_API_KEY}" \
-H "Content-Type: application/json" \
-d "${REQUEST_BODY}")
TASK=$(printf '%s' "${SUBMIT_RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
PREDICTION_ID=$(printf '%s' "${TASK}" | jq -r '.id // empty')
if [ -z "${PREDICTION_ID}" ]; then
printf 'Submission response did not contain a prediction id
' >&2
exit 1
fi
RESULT_URL=$(printf '%s' "${TASK}" | jq -r '.urls.get // empty')
if [ -z "${RESULT_URL}" ]; then RESULT_URL="https://api.wavespeed.ai/api/v3/predictions/${PREDICTION_ID}/result"; fi
# 2. Poll until the prediction finishes.
while true; do
RESPONSE=$(curl --silent --show-error --fail-with-body \
"${RESULT_URL}" \
-H "Authorization: Bearer ${WAVESPEED_API_KEY}")
RESULT=$(printf '%s' "${RESPONSE}" | jq 'if type == "object" and has("data") then .data else . end')
STATUS=$(printf '%s' "${RESULT}" | jq -r '.status // empty')
case "${STATUS}" in
completed) printf '%s\n' "${RESULT}" | jq '.outputs'; break ;;
failed|cancelled|timeout) printf '%s\n' "${RESULT}" | jq . >&2; exit 1 ;;
created|processing) sleep 2 ;;
*) printf 'Unexpected status: %s
' "${STATUS}" >&2; exit 1 ;;
esac
doneParameters
Task Submission Parameters
Request Parameters
| Parameter | Type | Required | Default | Range | Description |
|---|---|---|---|---|---|
| video | string | Yes | - | The video for generating the output. | |
| prompt | string | No | - | Text prompt to guide sound effect generation | |
| num_samples | integer | No | 2 | 1 ~ 8 | Number of sound effects to generate |
| duration | number | No | 5 | 2 ~ 10 | Number of sound effects to generate |
| seed | integer | No | -1 | - | The random seed to use for the generation. -1 means a random seed will be used. |
Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data.id | string | Unique identifier for the prediction, Task Id |
| data.model | string | Model ID used for the prediction |
| data.outputs | array | Output values, usually URL strings; some models return text strings or structured result objects (empty when status is not completed) |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |
Result Request Parameters
| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
| id | string | Yes | - | Task ID |
Result Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data | object | The prediction data object containing all details |
| data.id | string | Unique identifier for the prediction |
| data.model | string | Model ID used for the prediction |
| data.outputs | array<string | object> | Array of generated outputs (empty when status is not completed). Items are usually URL strings, but may be text strings or structured result objects, depending on the model. |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to poll for the prediction result |
| data.status | string | Status: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |