llama-3.1-8b-instruct
Meta/Open weights/1 provider
Meta's latest class of models, Llama 3.1, launched with a variety of sizes and configurations. The 8B instruct-tuned version is particularly fast and efficient. It has demonstrated strong performance in human evaluations, outperforming several leading closed-source models.MoreLess
Which id to call
novita/meta-llama/llama-3.1-8b-instructThis model has no managed policy yet, so call the provider endpoint directly. Every id in the endpoints table works the same way.
From /1M input
$0.05
Novita AI
Context
16K
tokens
Endpoints
1
1 region
Regions
1
chat
Capabilities 0/8
1 endpoint / 1 region
Providers serving llama-3.1-8b-instruct
Provider prices, per 1M tokens. Pay as you go adds 5%, or 0% on your own keys.
| Rank | Privacy | ||||||
|---|---|---|---|---|---|---|---|
| 1 |  Novita AI | Global | 16K | $0.05 | $0.05 | $0.05 | zdr |
A column is blank where no qualifying sample exists, and every row links to that provider's endpoint page.
model=
Which id to call
One base url, https://router.requesty.ai/v1, and one key for every id here.
novita/meta-llama/llama-3.1-8b-instructThis model has no managed policy yet, so call the provider endpoint directly. Every id in the endpoints table works the same way.
OpenAI compatible
Call it in three lines
Change the base url, use your Requesty key, set the model to any id on the left. Existing OpenAI SDK code needs no other edit.
123456789101112131415from openai import OpenAI client = OpenAI( api_key="YOUR_REQUESTY_API_KEY", base_url="https://router.requesty.ai/v1", ) response = client.chat.completions.create( model="novita/meta-llama/llama-3.1-8b-instruct", messages=[ {"role": "user", "content": "Explain quantum computing in one paragraph."}, ], ) print(response.choices[0].message.content)
6
More from Meta
muse-glimmer-30b
131K ctx/from free/2 providers
llama-4-maverick-17b-128e-instruct
1.0M ctx/from $0.20/1 provider
llama-3.3-70b-instruct
131K ctx/from $0.13/3 providers
llama-3.3-70b-instruct-turbo
131K ctx/from $0.08/1 provider
llama-3.2-90b-vision-instruct
131K ctx/from $0.35/1 provider
meta-llama-3.1-405b-instruct
131K ctx/from $0.80/1 provider
Reference
llama-3.1-8b-instruct questions
Which providers serve llama-3.1-8b-instruct?
llama-3.1-8b-instruct is available from 1 provider through Requesty: Novita AI. All endpoints share one OpenAI-compatible API and one key, and Requesty fails over between them automatically.
How much does llama-3.1-8b-instruct cost?
Pricing starts at $0.05 per million input tokens and $0.05 per million output tokens on Novita AI, the cheapest endpoint. Prices vary by provider and region; the table above shows every endpoint. Those are the upstream provider rates: pay as you go adds 5% on top, or 0% if you bring your own provider keys.
Is llama-3.1-8b-instruct open weights?
Yes. llama-3.1-8b-instruct is an open-weights model from Meta, which is why multiple inference providers can host it. Provider choice affects price, latency, and data-privacy terms, all compared above.
What is the context window of llama-3.1-8b-instruct?
llama-3.1-8b-instruct supports up to 16K tokens of context. Some providers expose a smaller window; check the per-endpoint context column above.
How do I use llama-3.1-8b-instruct with the OpenAI SDK?
Install the OpenAI SDK, set base_url to "https://router.requesty.ai/v1", set your API key to your Requesty key, and set the model to "novita/meta-llama/llama-3.1-8b-instruct" or any endpoint id from the table above. The quickstart section shows Python, JavaScript and cURL snippets.
Route llama-3.1-8b-instruct through one endpoint
One key for 1 provider on this model and 600+ others. No markup on provider prices, automatic failover, caching built in.