Requesty
Novita AI logo
Novita AI

meta-llama/llama-3.1-8b-instruct

Meta's latest class of models, Llama 3.1, launched with a variety of sizes and configurations. The 8B instruct-tuned version is particularly fast and efficient. It has demonstrated strong performance in human evaluations, outperforming several leading closed-source models.

CompareDocs

Specifications

Context window16K tokens
Max outputN/A
API typechat
AddedFeb 6, 2025
Model IDnovita/meta-llama/llama-3.1-8b-instruct
Data retentionYes
Used for trainingUnknown
Provider location🇺🇸 US
Privacy policyNovita AI Privacy Policy→

Benchmarks

Benchmarks haven't been published yet for this exact variant.

Some variants (region-specific deployments, highspeed tiers) share benchmarks with their base model. Check the base model page or the Novita AI models overview.

Pricing

Prices updated July 24, 2026
Input / 1M
$0.05
Output / 1M
$0.05
Cache write
N/A
Cache read
N/A
Estimated cost
100K input + 10K output$0.0055
1M input + 100K output$0.0550
10M input + 1M output$0.55

Requesty charges exactly what the upstream provider charges, no markup, no per-request fees. Prompt caching and smart routing can reduce effective cost by 30-80%.

Quickstart

Drop-in compatible with the OpenAI SDK. Change the base URL, swap in your Requesty API key, and set the model to novita/meta-llama/llama-3.1-8b-instruct.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
from openai import OpenAI

client = OpenAI(
    api_key="YOUR_REQUESTY_API_KEY",
    base_url="https://router.requesty.ai/v1",
)

response = client.chat.completions.create(
    model="novita/meta-llama/llama-3.1-8b-instruct",
    messages=[
        {"role": "user", "content": "Explain quantum computing in one paragraph."},
    ],
)

print(response.choices[0].message.content)

Other Novita AI models

tencent/hy3
262K ctx$0.14/1M
Coding 59
stepfun/step-3.7-flash
262K ctx$0.20/1M
Coding 40
zai-org/glm-5.1
205K ctx$1.38/1M
Coding 56
minimax/minimax-m2.7-highspeed
205K ctx$0.60/1M
kwaipilot/kat-coder-pro
256K ctx$0.30/1M
inclusionai/ring-2.6-1t
262K ctx$0.30/1M
Coding 43

Frequently asked questions

How much does meta-llama/llama-3.1-8b-instruct cost?
meta-llama/llama-3.1-8b-instruct is priced at $0.05 per million input tokens and $0.05 per million output tokens when accessed via Requesty. Requesty charges exactly what the upstream provider charges, we don't add markup.
What is the context window of meta-llama/llama-3.1-8b-instruct?
meta-llama/llama-3.1-8b-instruct has a context window of 16K tokens. That's roughly 22 words of input you can fit in a single prompt.
What can meta-llama/llama-3.1-8b-instruct do?
meta-llama/llama-3.1-8b-instruct is a text-generation model you can call through any OpenAI-compatible client by pointing base_url to Requesty.
How do I use meta-llama/llama-3.1-8b-instruct with the OpenAI SDK?
Install the OpenAI SDK, set base_url to "https://router.requesty.ai/v1", set your API key to your Requesty key, and set the model to "novita/meta-llama/llama-3.1-8b-instruct". The Quickstart above shows Python, JavaScript and cURL snippets.
Can I run meta-llama/llama-3.1-8b-instruct through Requesty?
Yes. meta-llama/llama-3.1-8b-instruct runs through Requesty's OpenAI-compatible API, served from Novita AI. You do not host the model yourself: point base_url at Requesty, set the model to "novita/meta-llama/llama-3.1-8b-instruct", and requests are routed to the upstream provider with automatic failover. The same key gives you 600+ other models too.

Access meta-llama/llama-3.1-8b-instruct through Requesty

One API key, 600+ models, OpenAI-compatible. No markup on provider prices, automatic failover, and smart caching built-in.

All Novita AI models