wizardlm-2-8x22b
Novita AI/🇺🇸 US/chat
WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models.MoreLess
Which id to call
novita/microsoft/wizardlm-2-8x22bThis exact deployment on Novita AI, with no routing and no failover. Send it as the model field.
Input /1M
$0.62
Novita AI
Output /1M
$0.62
1.0x input
Context
66K
tokens
Added
Apr 2024
chat
Capabilities 0/8
Provider rates
What wizardlm-2-8x22b costs
Provider prices per 1M tokens, updated September 12, 2026.moreless
These are the upstream provider rates. Pay as you go adds 5%, or 0% if you bring your own keys, and there is no per-request fee. Prompt caching and routing change what you pay against these rates, not the rates themselves.
Input /1M
$0.62
Output /1M
$0.62
Cache write /1M
-
Cache read /1M
-
What a workload costs
- 100K input + 10K output
- $0.0682
- 1M input + 100K output
- $0.68
- 10M input + 1M output
- $6.82
At the rates above. This endpoint does not offer prompt caching, so repeated context is billed as new input every time.
OpenAI compatible
Call it in three lines
Change the base url, use your Requesty key, set the model to novita/microsoft/wizardlm-2-8x22b. Existing OpenAI SDK code needs no other edit.
123456789101112131415from openai import OpenAI client = OpenAI( api_key="YOUR_REQUESTY_API_KEY", base_url="https://router.requesty.ai/v1", ) response = client.chat.completions.create( model="novita/microsoft/wizardlm-2-8x22b", messages=[ {"role": "user", "content": "Explain quantum computing in one paragraph."}, ], ) print(response.choices[0].message.content)
Reference
Specs and data terms
What the catalog reports for this deployment, and what the provider does with the traffic.
Public leaderboards
Benchmark scores
Benchmarks measure the model, not this endpoint, so they are the same wherever these weights are served.
No benchmarks are published for this exact variant yet.
Region-specific deployments and highspeed tiers usually share scores with their base model. Try the base model page or the Novita AI models overview.
Same provider
More from Novita AI
Newest first, on the same provider and the same key.
Reference
wizardlm-2-8x22b questions
How much does wizardlm-2-8x22b cost?
wizardlm-2-8x22b is priced at $0.62 per million input tokens and $0.62 per million output tokens when accessed via Requesty. Those are the upstream provider rates: pay as you go adds 5% on top, or 0% if you bring your own provider keys.
What is the context window of wizardlm-2-8x22b?
wizardlm-2-8x22b has a context window of 66K tokens. That's roughly 87 words of input you can fit in a single prompt.
What can wizardlm-2-8x22b do?
wizardlm-2-8x22b is a text-generation model you can call through any OpenAI-compatible client by pointing base_url to Requesty.
How do I use wizardlm-2-8x22b with the OpenAI SDK?
Install the OpenAI SDK, set base_url to "https://router.requesty.ai/v1", set your API key to your Requesty key, and set the model to "novita/microsoft/wizardlm-2-8x22b". The Quickstart above shows Python, JavaScript and cURL snippets.
Can I run wizardlm-2-8x22b through Requesty?
Yes. wizardlm-2-8x22b runs through Requesty's OpenAI-compatible API, served from Novita AI. You do not host the model yourself: point base_url at Requesty, set the model to "novita/microsoft/wizardlm-2-8x22b", and requests are routed to the upstream provider with automatic failover. The same key gives you 600+ other models too.
Call wizardlm-2-8x22b through one endpoint
One key for this endpoint and 600+ other models. No markup on provider prices, automatic failover, caching built in.