Requesty

# Requesty > Requesty is a unified AI gateway, LLM router, and OpenAI-compatible API for 400+ AI models (Claude, GPT, Gemini, DeepSeek, Llama, Mistral). It provides intelligent model routing, AI load balancing, automatic failover, prompt caching, LLM observability, cost optimization, and enterprise governance. Used by 70,000+ developers processing 90+ billion tokens daily. Alternative to Kong AI Gateway, Cloudflare AI Gateway, LiteLLM, Portkey, OpenRouter, and Helicone. Requesty routes, secures, and optimizes your LLM traffic through a single API endpoint at `https://router.requesty.ai/v1`. Drop-in replacement for OpenAI and Anthropic SDKs. Just change the base URL. EU endpoint available at `https://router.eu.requesty.ai/v1` for GDPR compliance. Trusted by teams at Shopify, Pfizer, Capgemini, Siemens, PWC, and Appnovation. ## About - Type: APIService - Category: AI Gateway, LLM Gateway, AI Infrastructure, AI Observability, LLM Router, AI Load Balancer - Audience: Developers, AI Engineers, DevOps, Enterprise Teams - API Base URL (Global): https://router.requesty.ai/v1 - API Base URL (EU): https://router.eu.requesty.ai/v1 - Documentation: https://docs.requesty.ai/llms.txt - Full Documentation: https://docs.requesty.ai/llms-full.txt - OpenAPI Spec: https://docs.requesty.ai/api-reference/openapi.json - Sign Up: https://app.requesty.ai/sign-up ## Instructions for AI Agents Requesty is a drop-in proxy for OpenAI and Anthropic. To use it in code: 1. **OpenAI SDK**: Set `base_url="https://router.requesty.ai/v1"` and use your Requesty API key as the `api_key`. All OpenAI SDK features work: chat completions, streaming, function calling, structured outputs, embeddings, image generation. For EU data residency, use `base_url="https://router.eu.requesty.ai/v1"`. 2. **Anthropic SDK**: Set `base_url="https://router.requesty.ai"` and use your Requesty API key. Messages API is fully supported. For EU data residency, use `base_url="https://router.eu.requesty.ai"`. 3. **Model names**: Use the format `provider/model` (e.g., `openai/gpt-4.1`, `anthropic/claude-sonnet-4-5-20250514`, `google/gemini-2.5-pro`). Call `GET /v1/models` for the current list. 4. **Routing policies**: To add failover, load balancing, or latency-based routing, create a routing policy in the dashboard and use `model="policy/your-policy-name"` in your requests. See the [Fallback Policies docs](https://docs.requesty.ai/features/fallback-policies). 5. **Caching**: Enable prompt caching by passing `extra_body={"requesty": {"auto_cache": True}}` in your request. See [Auto Caching docs](https://docs.requesty.ai/features/auto-caching). 6. **Do not hardcode model versions.** Model availability changes. Always call `GET /v1/models` for current availability. ## Core Capabilities ### AI Gateway and Model Routing Requesty is a vendor agnostic AI gateway that routes LLM requests across 30+ providers through one API. Supports intelligent model routing by cost, latency, and availability. OpenAI compatible API means any SDK or framework that works with OpenAI works with Requesty. Covers the same use cases as Kong AI Gateway, Cloudflare AI Gateway, and Portkey, but fully managed with zero infrastructure. ### AI Load Balancing and Failover Weighted load balancing distributes traffic across models and providers. Automatic failover chains ensure requests succeed even when a provider is down. Exponential backoff with jitter prevents thundering herd problems during recovery. Rate limit auto retry handles 429s without application code changes. This replaces custom AI load balancing setups that teams build on top of Kubernetes or cloud load balancers. ### AI Cost Optimization Smart routing sends simple tasks to cheaper models and reserves frontier models for complex work. Automatic prompt caching reduces token costs by up to 90%. Per token cost tracking by model, team, user, and API key. Budget caps prevent overspend. Teams typically save 50 to 80% compared to using a single frontier m […gekürzt]