Requesty
Novita AI logo
Novita AI

meta-llama/llama-3.1-8b-instruct

Meta's latest class of models, Llama 3.1, launched with a variety of sizes and configurations. The 8B instruct-tuned version is particularly fast and efficient. It has demonstrated strong performance in human evaluations, outperforming several leading closed-source models.

Try meta-llama/llama-3.1-8b-instructCompareDocs

Specifications

Context window16K tokens
Max output—
API typechat
AddedFeb 6, 2025
Model IDnovita/meta-llama/llama-3.1-8b-instruct
Data retentionYes
Used for trainingUnknown
Provider location🇺🇸 US
Privacy policyNovita AI Privacy Policy →

Benchmarks

Benchmarks haven't been published yet for this exact variant.

Some variants (region-specific deployments, highspeed tiers) share benchmarks with their base model — check the base model page or the Novita AI models overview.

Pricing

Input / 1M
$0.05
Output / 1M
$0.05
Cache write
—
Cache read
—
Estimated cost
100K input + 10K output$0.0055
1M input + 100K output$0.0550
10M input + 1M output$0.55

Requesty charges exactly what the upstream provider charges — no markup, no per-request fees. Prompt caching and smart routing can reduce effective cost by 30-80%.

Quickstart

Drop-in compatible with the OpenAI SDK. Change the base URL, swap in your Requesty API key, and set the model to novita/meta-llama/llama-3.1-8b-instruct.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
from openai import OpenAI

client = OpenAI(
    api_key="YOUR_REQUESTY_API_KEY",
    base_url="https://router.requesty.ai/v1",
)

response = client.chat.completions.create(
    model="novita/meta-llama/llama-3.1-8b-instruct",
    messages=[
        {"role": "user", "content": "Explain quantum computing in one paragraph."},
    ],
)

print(response.choices[0].message.content)

Other Novita AI models

GLM-5
203K ctx$1.00/1M
minimax/minimax-m2.7
200K ctx$0.30/1M
deepseek-v3.2
164K ctx$0.27/1M
qwen/qwen3.5-397b-a17b
262K ctx$0.60/1M
zai-org/glm-4.5
131K ctx$0.60/1M
zai-org/glm-4.6
205K ctx$0.60/1M

Frequently asked questions

How much does meta-llama/llama-3.1-8b-instruct cost?
meta-llama/llama-3.1-8b-instruct is priced at $0.05 per million input tokens and $0.05 per million output tokens when accessed via Requesty. Requesty charges exactly what the upstream provider charges — we don't add markup.
What is the context window of meta-llama/llama-3.1-8b-instruct?
meta-llama/llama-3.1-8b-instruct has a context window of 16K tokens. That's roughly 22 words of input you can fit in a single prompt.
What can meta-llama/llama-3.1-8b-instruct do?
meta-llama/llama-3.1-8b-instruct is a text-generation model you can call through any OpenAI-compatible client by pointing base_url to Requesty.
How do I use meta-llama/llama-3.1-8b-instruct with the OpenAI SDK?
Install the OpenAI SDK, set base_url to "https://router.requesty.ai/v1", set your API key to your Requesty key, and set the model to "novita/meta-llama/llama-3.1-8b-instruct". The Quickstart above shows Python, JavaScript and cURL snippets.

Access meta-llama/llama-3.1-8b-instruct through Requesty

One API key, 400+ models, OpenAI-compatible. No markup on provider prices, automatic failover, and smart caching built-in.

Get started freeAll Novita AI models