meta-llama/llama-3.1-8b-instruct
Release date: 2024-07-23
131,072 context · $0.22/M input tokens · $0.22/M output tokens
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
Pricing
Pay-per-use
No upfront costs, pay only for what you use
Try the model
API Usage
Use the following code examples to integrate with our API:
import OpenAI from 'openai';
if (!process.env.WAVESPEED_API_KEY) throw new Error('Set WAVESPEED_API_KEY');
const client = new OpenAI({
apiKey: process.env.WAVESPEED_API_KEY,
baseURL: 'https://llm.wavespeed.ai/v1',
timeout: 120_000,
maxRetries: 0,
});
try {
const response = await client.chat.completions.create({
model: 'meta-llama/llama-3.1-8b-instruct',
messages: [{ role: 'user', content: 'Hello!' }],
});
const body = response as typeof response & { error?: { message?: string } };
if (body.error) throw new Error(body.error.message || 'LLM generation failed');
console.log(response.choices[0]?.message?.content ?? '');
} catch (error) {
console.error('LLM request failed:', error);
process.exitCode = 1;
}import OpenAI from 'openai';
if (!process.env.WAVESPEED_API_KEY) throw new Error('Set WAVESPEED_API_KEY');
const client = new OpenAI({
apiKey: process.env.WAVESPEED_API_KEY,
baseURL: 'https://llm.wavespeed.ai/v1',
timeout: 120_000,
maxRetries: 0,
});
try {
const response = await client.chat.completions.create({
model: 'meta-llama/llama-3.1-8b-instruct',
messages: [{ role: 'user', content: 'Hello!' }],
});
const body = response as typeof response & { error?: { message?: string } };
if (body.error) throw new Error(body.error.message || 'LLM generation failed');
console.log(response.choices[0]?.message?.content ?? '');
} catch (error) {
console.error('LLM request failed:', error);
process.exitCode = 1;
}Model Introduction
Meta: Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
This model is available through the WaveSpeed AI OpenAI-compatible API for chat completions and compatible application workflows.
Why It Looks Great
- text->text architecture for Text to Text workloads
- 131072 context window for long prompts, document analysis, and multi-turn workflows
- Function calling and tool-use support for agentic application workflows
- Structured output support for JSON responses and schema-constrained generation
Key Features
- Context Window: 131072 tokens
- Max Input: 114688 tokens
- Max Output: 16384 tokens
- Vision: Not listed
- Function Calling: Supported
- Structured Outputs: Supported
- Image Generation: Not listed
- Audio Input: Not listed
- Supported Parameters: frequency_penalty, logit_bias, logprobs, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_logprobs, top_p
Specifications
| Specification | Value |
|---|---|
| Provider | meta |
| Model Type | Chat Completions model |
| Architecture | text->text |
| Context Window | 131072 tokens |
| Max Input | 114688 tokens |
| Max Output | 16384 tokens |
| Input | Text |
| Output | Text |
| Vision | Not listed |
| Function Calling | Supported |
| Structured Outputs | Supported |
| Release Date | July 23, 2024 |
How to Use
- Write your prompt - describe the task, provide context, and specify the desired output format.
- Submit - the model processes your request and returns the response.
API Integration
Base URL: https://llm.wavespeed.ai/v1 API Endpoint: chat/completions Model ID: meta-llama/llama-3.1-8b-instruct
API Usage
Python SDK
from openai import OpenAI
client = OpenAI(
api_key="YOUR_API_KEY",
base_url="https://llm.wavespeed.ai/v1"
)
response = client.chat.completions.create(
model="meta-llama/llama-3.1-8b-instruct",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)cURL
curl https://llm.wavespeed.ai/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer YOUR_API_KEY" \
-d '{
"model": "meta-llama/llama-3.1-8b-instruct",
"messages": [{"role": "user", "content": "Hello!"}]
}'Notes
- Model: meta-llama/llama-3.1-8b-instruct
- Provider: meta
Info
Supported Functionality
API Access Guide
Llama 3.1 8b Instruct API
meta-llama/llama-3.1-8b-instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
Input
$0.22 /M
Output
$0.22 /M
Context
131K
Max Output
16K
Tool Use
Supported
Try Llama 3.1 8b Instruct on WaveSpeedAI
Access Llama 3.1 8b Instruct through our unified API — OpenAI-compatible, no cold starts, transparent pricing.
Frequently Asked Questions about Llama 3.1 8b Instruct
How much does Llama 3.1 8b Instruct cost via the API?+
Pricing on WaveSpeedAI: $0.22 per million input tokens and $0.22 per million output tokens. Prompt caching and batch processing are billed separately and reduce effective cost on long, repetitive workloads.
What is the context window of Llama 3.1 8b Instruct?+
Llama 3.1 8b Instruct supports up to 131K tokens of context with up to 16K tokens of output per request.
Is Llama 3.1 8b Instruct OpenAI-compatible?+
WaveSpeedAI exposes Llama 3.1 8b Instruct at https://llm.wavespeed.ai/v1 through the OpenAI-compatible Chat Completions interface. Most OpenAI SDK clients work by changing the base URL and API key; optional fields depend on the selected model.
How do I get started with Llama 3.1 8b Instruct?+
Sign in to WaveSpeedAI, create an API key in Access Keys, then send a request to https://llm.wavespeed.ai/v1/chat/completions with the model id shown above. Check the current model catalog for availability, capabilities, and pricing.