Routing

Every post tagged Routing.

All143 Best Practices73 Integrations58 Agents37 Requesty Features31 Routing29 Observability13 Security9 Cost Optimization6 Infrastructure4 AI Models4 LLM Routing3 AI Agents3 AI Gateway3 Industry2

2026

12 posts

Why AI gateways should be built in Go: a language audit of every major gateway

Routing JUL '26

OpenRouter Is Down? How to Fail Over to a Backup Provider in 2 Minutes

Routing JUL '26

OpenRouter Rate Limits: Why They Happen and How Multi Provider Fallback Fixes Them

Routing JUL '26

The supply side is exploding: 136 providers, 502 models, and 2,084 client apps in a single…

AI Models JUL '26

Why Traditional Latency Routing Fails and How We Fixed It With One Formula

Routing JUL '26

No model stays #1: the leader's share of gateway traffic fell from 29% to 8% in eight mont…

AI Models JUN '26

Inside Sakana Fugu Ultra: We Reverse Engineered Its Multi Agent Architecture

AI Models MAY '26

How to route LLM requests by cost and latency

Routing MAY '26

What the gateway saw in April 2026: agents live on Anthropic, open-source models got fast,…

Observability APR '26

Agentic routing, benchmarked: Requesty adds 16ms of overhead, OpenRouter adds 55ms

Designing fallback retries: why Requesty uses 500ms → 4s with jitter

Routing JAN '26

Routing policies 101: fallback, load balancing, and latency in production

2025

17 posts

Case Study: How E-commerce Chatbots Scale to Black Friday Traffic with Requesty

Best Practices JUL '25

Cross-Provider Caching Deep Dive: Maximize Performance Across Your Stack

Best Practices JUL '25

LLM Gateway vs Direct API Calls: Benchmarking Latency & Uptime

Best Practices JUL '25

Rate-Limiting, Retries & 429s: Bullet-Proofing Your AI Pipeline

Routing JUL '25

Smart Routing Demystified: Choosing the Fastest-Cheapest Model per Request

Routing JUL '25

Solving Provider Outages: Real-World Failover War Stories

Routing JUL '25

The Future of LLM Routing: On-device, Edge AI, and Federated Models

Routing JUL '25

Top 7 Smart-Routing Strategies (with YAML/JSON Examples)

Routing MAY '25

Smarter-Than-Human Model Picking: Introducing Requesty Smart Routing

Routing MAR '25

Intelligent LLM Routing in Enterprise AI: Uptime, Cost Efficiency, and Model Selection

Routing MAR '25

Introducing Smart Routing: Smart AI Model Selection!

Routing MAR '25

Supercharging Cline with Requesty: Models, Fallbacks, and Optimizations

Integrations MAR '25

Handling LLM Platform Outages: What to Do When OpenAI, Anthropic, DeepSeek, or Others Go D…

Routing MAR '25

Implementing Zero-Downtime LLM Architecture: Beyond Basic Fallbacks

Routing JAN '25

Claude-3-5-Sonnet: Save Over 50% on AI Costs with Cline & Requesty Router

Integrations JAN '25

Switching LLM Providers: Why It’s Harder Than It Seems

Best Practices JAN '25

What is LLM Routing?