Requesty

wizardlm-2-8x22b

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models.

Specifications

Context window66K tokens
Max outputβ€”
API typechat
AddedFeb 6, 2025
Model IDnovita/microsoft/wizardlm-2-8x22b
Data retentionYes
Used for trainingUnknown
Provider locationπŸ‡ΊπŸ‡Έ US

Benchmarks

Benchmarks haven't been published yet for this exact variant.

Some variants (region-specific deployments, highspeed tiers) share benchmarks with their base model β€” check the base model page or the Novita AI models overview.

Pricing

Input / 1M
$0.62
Output / 1M
$0.62
Cache write
β€”
Cache read
β€”
Estimated cost
100K input + 10K output$0.0682
1M input + 100K output$0.68
10M input + 1M output$6.82

Requesty charges exactly what the upstream provider charges β€” no markup, no per-request fees. Prompt caching and smart routing can reduce effective cost by 30-80%.

Quickstart

Drop-in compatible with the OpenAI SDK. Change the base URL, swap in your Requesty API key, and set the model to novita/microsoft/wizardlm-2-8x22b.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
from openai import OpenAI client = OpenAI( api_key="YOUR_REQUESTY_API_KEY", base_url="https://router.requesty.ai/v1", ) response = client.chat.completions.create( model="novita/microsoft/wizardlm-2-8x22b", messages=[ {"role": "user", "content": "Explain quantum computing in one paragraph."}, ], ) print(response.choices[0].message.content)

Other Novita AI models

Frequently asked questions

How much does wizardlm-2-8x22b cost?
wizardlm-2-8x22b is priced at $0.62 per million input tokens and $0.62 per million output tokens when accessed via Requesty. Requesty charges exactly what the upstream provider charges β€” we don't add markup.
What is the context window of wizardlm-2-8x22b?
wizardlm-2-8x22b has a context window of 66K tokens. That's roughly 87 words of input you can fit in a single prompt.
What can wizardlm-2-8x22b do?
wizardlm-2-8x22b is a text-generation model you can call through any OpenAI-compatible client by pointing base_url to Requesty.
How do I use wizardlm-2-8x22b with the OpenAI SDK?
Install the OpenAI SDK, set base_url to "https://router.requesty.ai/v1", set your API key to your Requesty key, and set the model to "novita/microsoft/wizardlm-2-8x22b". The Quickstart above shows Python, JavaScript and cURL snippets.

Access wizardlm-2-8x22b through Requesty

One API key, 400+ models, OpenAI-compatible. No markup on provider prices, automatic failover, and smart caching built-in.