Framepack

Playground

Try it on WavespeedAI!

Framepack is an efficient Image-to-video model that autoregressively generates videos.

Features

Framepack

FramePack is a next-frame (next-frame-section) prediction neural network structure that generates videos progressively.

FramePack compresses input contexts to a constant length so that the generation workload is invariant to video length.

FramePack can process a very large number of frames with 13B models even on laptop GPUs.

FramePack can be trained with a much larger batch size, similar to the batch size for image diffusion training.

Authentication

For authentication details, please refer to the Authentication Guide.

API Endpoints

Submit Task & Query Result


# Submit the task
curl --location --request POST "https://api.wavespeed.ai/api/v3/wavespeed-ai/framepack" \
--header "Content-Type: application/json" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}" \
--data-raw '{
    "image": "https://d3gnftk2yhz9lr.wavespeed.ai/media/images/1745337597019716935_RS1XUQMI.jpg",
    "prompt": "A fierce female warrior swings a long sword with full strength. Her expression is intense and focused, and her long hair flows dramatically through the air with the force of her movement",
    "negative_prompt": "",
    "aspect_ratio": "16:9",
    "resolution": "720p",
    "seed": 0,
    "num_inference_steps": 25,
    "num_frames": 180,
    "guidance_scale": 10,
    "enable_safety_checker": true
}'

# Get the result
curl --location --request GET "https://api.wavespeed.ai/api/v3/predictions/${requestId}/result" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}"

Parameters

Task Submission Parameters

Request Parameters

Parameter	Type	Required	Default	Range	Description
image	string	Yes		-	The URL of the video to generate the audio for.
prompt	string	Yes		-	Prompt for generating video.
negative_prompt	string	No		-	The negative prompt to generate the audio for.
aspect_ratio	string	No	16:9	-	The aspect ratio of the video to generate.
resolution	string	No	720p	-	The resolution of the video to generate. 720p generations cost 1.5x more than 480p generations.
seed	integer	No	-	-1 ~ 2147483647	The random seed to use for the generation.
num_inference_steps	integer	No	25	4 ~ 50	The number of inference steps to perform.
num_frames	integer	No	180	30 ~ 1800	The duration of the audio to generate.
guidance_scale	number	No	10	0 ~ 32	The guidance scale to use for the generation.
enable_safety_checker	boolean	No	true	-	If set to true, the safety checker will be enabled.

Response Parameters

Parameter	Type	Description
code	integer	HTTP status code (e.g., 200 for success)
message	string	Status message (e.g., “success”)
data.id	string	Unique identifier for the prediction, Task Id
data.model	string	Model ID used for the prediction
data.outputs	array	Array of URLs to the generated content (empty when status is not `completed`)
data.urls	object	Object containing related API endpoints
data.urls.get	string	URL to retrieve the prediction result
data.has_nsfw_contents	array	Array of boolean values indicating NSFW detection for each output
data.status	string	Status of the task: `created`, `processing`, `completed`, or `failed`
data.created_at	string	ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”)
data.error	string	Error message (empty if no error occurred)
data.timings	object	Object containing timing details
data.timings.inference	integer	Inference time in milliseconds

Result Query Parameters

Result Request Parameters

Parameter	Type	Required	Default	Description
id	string	Yes	-	Task ID

Result Response Parameters

Parameter	Type	Description
code	integer	HTTP status code (e.g., 200 for success)
message	string	Status message (e.g., “success”)
data	object	The prediction data object containing all details
data.id	string	Unique identifier for the prediction, the ID of the prediction to get
data.model	string	Model ID used for the prediction
data.outputs	array	Array of URLs to the generated content (empty when status is not `completed`)
data.urls	object	Object containing related API endpoints
data.urls.get	string	URL to retrieve the prediction result
data.has_nsfw_contents	array	Array of boolean values indicating NSFW detection for each output
data.status	string	Status of the task: `created`, `processing`, `completed`, or `failed`
data.created_at	string	ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”)
data.error	string	Error message (empty if no error occurred)
data.timings	object	Object containing timing details
data.timings.inference	integer	Inference time in milliseconds

Flux Schnell Lora Ghibli