meta-llama/llama-3.1-8b-instructNovita AI
- api
- chat
- hosting
- US
- model lab
- Meta
- weights
- open
- added
- July 2024
- model id
- novita/meta-llama/llama-3.1-8b-instruct
capabilities 0/8
- input
- $0.05
- output
- $0.05
- cache write
- -
- cache read
- -
worked cost
| volume | cost |
|---|---|
| 100K in + 10K out | $0.0055 |
| 1M in + 100K out | $0.0550 |
| 10M in + 1M out | $0.55 |
Requesty charges what the upstream provider charges, with no markup and no per-request fee. Prompt caching and smart routing cut the effective cost further on repeated context. Gateway pricing
no measured traffic for this endpoint yet. pricing above is the provider's own
no published scores for this exact variant. region deployments and highspeed tiers usually share the base model's results
- retention
- none
- trains on prompts
- no
- hosted in
- US
Terms are the provider's, not Requesty's: routing a request here puts it under them. Novita AI Privacy Policy
Need every request to stay in one jurisdiction? EU hosting routes only through EU-hosted providers.
novita/meta-llama/llama-3.1-8b-instructthis id pins the novita ai deployment, with no routing and no failover. the managed id on the canonical page routes across all 1 providers instead
from openai import OpenAI client = OpenAI( api_key="YOUR_REQUESTY_API_KEY", base_url="https://router.requesty.ai/v1",) response = client.chat.completions.create( model="novita/meta-llama/llama-3.1-8b-instruct", messages=[ {"role": "user", "content": "Explain quantum computing in one paragraph."}, ],) print(response.choices[0].message.content)
Change the base url to https://router.requesty.ai/v1, use your Requesty key, set the model to the id above. Existing OpenAI SDK code needs no other edit, and the same key reaches every other model in the catalog. Browse all models
Meta's latest class of models, Llama 3.1, launched with a variety of sizes and configurations. The 8B instruct-tuned version is particularly fast and efficient. It has demonstrated strong performance in human evaluations, outperforming several leading closed-source models.
questions 5
How much does meta-llama/llama-3.1-8b-instruct cost?
What is the context window of meta-llama/llama-3.1-8b-instruct?
What can meta-llama/llama-3.1-8b-instruct do?
How do I use meta-llama/llama-3.1-8b-instruct with the OpenAI SDK?
Can I run meta-llama/llama-3.1-8b-instruct through Requesty?
more from novita ai 8
| endpoint | ctx | in /M |
|---|---|---|
| deepseek-v4.1-flash | 1.0M | $0.30 |
| glm-5.3-flash | 1.0M | $0.15 |
| inclusionai/ling-3.0-tiny | 262K | free |
| qwen/qwen3.8-max | 1M | $2.00 |
| deepseek-v4-flash-0731 | 1.0M | $0.14 |
| tencent/hy3 | 262K | $0.14 |
| stepfun/step-3.7-flash | 262K | $0.20 |
| inclusionai/ring-2.6-1t | 262K | $0.30 |
call meta-llama/llama-3.1-8b-instruct through one endpoint
One key for this endpoint and 600+ other models. No markup on provider prices, automatic failover when a provider degrades, and prompt caching built in. Methodology