Llama 3.1 8B Instruct | Meta Lightweight LLM API

Name: Llama 3.1 8b Instruct API
Brand: meta-llama
Price: 0.02 USD
Availability: InStock

API 使用

使用以下代码示例接入我们的 API：

from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="https://llm.wavespeed.ai/v1"
)

response = client.chat.completions.create(
    model="meta-llama/llama-3.1-8b-instruct",
    messages=[
        {"role": "user", "content": "Hello!"}
    ]
)

print(response.choices[0].message.content)

模型介绍

Meta-Llama llama-3.1-8b-instruct

Meta's latest class of model (Llama 3

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Why It Looks Great

Large Language Model architecture for efficient processing
16384 context window for long document handling
Competitive pricing at $0.0/$0.0 per million tokens

Key Features

Context Window: 16384 tokens
Max Output: 16384 tokens
Vision: Supported
Function Calling: Supported

Specifications

Specification	Value
Provider	Meta-Llama
Model Type	Large Language Model (LLM)
Architecture	N/A
Context Window	16384 tokens
Max Output	16384 tokens
Input	Text
Output	Text
Vision	Supported
Function Calling	Supported

Pricing

Token Type	Cost per Million Tokens
Input	$0.0
Output	$0.0

How to Use

Write your prompt — describe the task, provide context, and specify desired output format.
Submit — the model processes your request and returns the response.

API Integration

Base URL: https://llm.wavespeed.ai/v1 API Endpoint: chat/completions Model ID: meta-llama/llama-3.1-8b-instruct

API Usage

Python SDK

from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="https://llm.wavespeed.ai/v1"
)

response = client.chat.completions.create(
    model="meta-llama/llama-3.1-8b-instruct",
    messages=[
        {"role": "user", "content": "Hello!"}
    ]
)

print(response.choices[0].message.content)

cURL

curl https://llm.wavespeed.ai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -d '{
    "model": "meta-llama/llama-3.1-8b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Notes

Model: meta-llama/llama-3.1-8b-instruct
Provider: Meta-Llama

关于 Llama 3.1 8b Instruct 的常见问题

Llama 3.1 8b Instruct API 多少钱?+

WaveSpeedAI 定价:输入每百万 token $0.02,输出每百万 token $0.05。Prompt 缓存和批处理单独计费,可显著降低长上下文、高重复任务的实际成本。

Llama 3.1 8b Instruct 的上下文窗口是多大?+

Llama 3.1 8b Instruct 单次请求最多支持 16K 上下文 token,输出最多 16K token。

Llama 3.1 8b Instruct 是否兼容 OpenAI?+

是的。WaveSpeedAI 通过 https://llm.wavespeed.ai/v1 的 OpenAI 兼容端点提供 Llama 3.1 8b Instruct。把官方 OpenAI SDK 的 base URL 指向该地址,使用 WaveSpeedAI 的 API Key 即可,无需任何其他代码改动。

如何开始使用 Llama 3.1 8b Instruct?+

登录 WaveSpeedAI,在 Access Keys 中生成 API Key,使用上方显示的 model id 向 https://llm.wavespeed.ai/v1/chat/completions 发送请求。新账户可获得免费额度,用于试用 Llama 3.1 8b Instruct。

定价