Requesty

meta-llama/llama-3.2-3b-instruct

The Meta Llama 3.2 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction-tuned generative models in 1B and 3B sizes (text in/text out)

πŸ”§Tool calling

Specifications

Context window33K tokens
Max outputβ€”
API typechat
AddedFeb 6, 2025
Model IDnovita/meta-llama/llama-3.2-3b-instruct
Data retentionYes
Used for trainingUnknown
Provider locationπŸ‡ΊπŸ‡Έ US

Benchmarks

MMLU Proknowledge
63.4%

Massive Multitask Language Understanding across 57 academic subjects.

Scores are sourced from official model cards, Artificial Analysis, and public leaderboards. Benchmarks measure specific skills and do not capture every aspect of model quality β€” always test on your own workload.

Pricing

Input / 1M
$0.03
Output / 1M
$0.05
Cache write
β€”
Cache read
β€”
Estimated cost
100K input + 10K output$0.0035
1M input + 100K output$0.0350
10M input + 1M output$0.35

Requesty charges exactly what the upstream provider charges β€” no markup, no per-request fees. Prompt caching and smart routing can reduce effective cost by 30-80%.

Quickstart

Drop-in compatible with the OpenAI SDK. Change the base URL, swap in your Requesty API key, and set the model to novita/meta-llama/llama-3.2-3b-instruct.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
from openai import OpenAI client = OpenAI( api_key="YOUR_REQUESTY_API_KEY", base_url="https://router.requesty.ai/v1", ) response = client.chat.completions.create( model="novita/meta-llama/llama-3.2-3b-instruct", messages=[ {"role": "user", "content": "Explain quantum computing in one paragraph."}, ], ) print(response.choices[0].message.content)

Other Novita AI models

Frequently asked questions

How much does meta-llama/llama-3.2-3b-instruct cost?
meta-llama/llama-3.2-3b-instruct is priced at $0.03 per million input tokens and $0.05 per million output tokens when accessed via Requesty. Requesty charges exactly what the upstream provider charges β€” we don't add markup.
What is the context window of meta-llama/llama-3.2-3b-instruct?
meta-llama/llama-3.2-3b-instruct has a context window of 33K tokens. That's roughly 44 words of input you can fit in a single prompt.
How does meta-llama/llama-3.2-3b-instruct perform on benchmarks?
meta-llama/llama-3.2-3b-instruct scores 64.1% on HumanEval, 63.4% on MMLU Pro, 48.0% on MATH. See the full benchmark chart above for results across MMLU Pro, GPQA Diamond, SWE-Bench Verified, HumanEval, MATH, AIME, MMMU, and LiveBench.
What can meta-llama/llama-3.2-3b-instruct do?
meta-llama/llama-3.2-3b-instruct supports tool calling. You can call it through any OpenAI-compatible client by pointing base_url to Requesty.
How do I use meta-llama/llama-3.2-3b-instruct with the OpenAI SDK?
Install the OpenAI SDK, set base_url to "https://router.requesty.ai/v1", set your API key to your Requesty key, and set the model to "novita/meta-llama/llama-3.2-3b-instruct". The Quickstart above shows Python, JavaScript and cURL snippets.

Access meta-llama/llama-3.2-3b-instruct through Requesty

One API key, 400+ models, OpenAI-compatible. No markup on provider prices, automatic failover, and smart caching built-in.