Requesty

wizardlm-2-8x22b

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models.

Specifications

Context window66K tokens
Max outputN/A
API typechat
AddedFeb 6, 2025
Model IDnovita/microsoft/wizardlm-2-8x22b
Data retentionYes
Used for trainingUnknown
Provider location🇺🇸 US

Benchmarks

Benchmarks haven't been published yet for this exact variant.

Some variants (region-specific deployments, highspeed tiers) share benchmarks with their base model. Check the base model page or the Novita AI models overview.

Pricing

Input / 1M
$0.62
Output / 1M
$0.62
Cache write
N/A
Cache read
N/A
Estimated cost
100K input + 10K output$0.0682
1M input + 100K output$0.68
10M input + 1M output$6.82

Requesty charges exactly what the upstream provider charges, no markup, no per-request fees. Prompt caching and smart routing can reduce effective cost by 30-80%.

Quickstart

Drop-in compatible with the OpenAI SDK. Change the base URL, swap in your Requesty API key, and set the model to novita/microsoft/wizardlm-2-8x22b.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
from openai import OpenAI client = OpenAI( api_key="YOUR_REQUESTY_API_KEY", base_url="https://router.requesty.ai/v1", ) response = client.chat.completions.create( model="novita/microsoft/wizardlm-2-8x22b", messages=[ {"role": "user", "content": "Explain quantum computing in one paragraph."}, ], ) print(response.choices[0].message.content)

Other Novita AI models

Frequently asked questions

How much does wizardlm-2-8x22b cost?
wizardlm-2-8x22b is priced at $0.62 per million input tokens and $0.62 per million output tokens when accessed via Requesty. Requesty charges exactly what the upstream provider charges, we don't add markup.
What is the context window of wizardlm-2-8x22b?
wizardlm-2-8x22b has a context window of 66K tokens. That's roughly 87 words of input you can fit in a single prompt.
What can wizardlm-2-8x22b do?
wizardlm-2-8x22b is a text-generation model you can call through any OpenAI-compatible client by pointing base_url to Requesty.
How do I use wizardlm-2-8x22b with the OpenAI SDK?
Install the OpenAI SDK, set base_url to "https://router.requesty.ai/v1", set your API key to your Requesty key, and set the model to "novita/microsoft/wizardlm-2-8x22b". The Quickstart above shows Python, JavaScript and cURL snippets.
Can I run wizardlm-2-8x22b through Requesty?
Yes. wizardlm-2-8x22b runs through Requesty's OpenAI-compatible API, served from Novita AI. You do not host the model yourself: point base_url at Requesty, set the model to "novita/microsoft/wizardlm-2-8x22b", and requests are routed to the upstream provider with automatic failover. The same key gives you 400+ other models too.

Access wizardlm-2-8x22b through Requesty

One API key, 400+ models, OpenAI-compatible. No markup on provider prices, automatic failover, and smart caching built-in.