Intelligent routing now in beta

One endpoint. Every model.
Your region. Your rules.

The intelligent LLM gateway that grows with you. Smart routing, per-user quotas, and data residency — all through a single OpenAI-compatible API.

No credit card required • OpenAI-compatible

Drop-in replacement for OpenAI

Just change your base URL. Use your existing SDK and code patterns.

curl https://api.llmrelai.com/v1/chat/completions \
  -H "Authorization: Bearer $RELAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "anthropic/claude-sonnet-4",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Built for production AI apps

Everything you need to ship AI features with confidence.

Smart Routing

Route by capability, cost, or latency. Use aliases like reasoning/cheapest and let Relai pick the best model for your needs.

Per-User Quotas

Set spending limits per end-user. Track usage and costs by user ID without building your own metering infrastructure.

Regional Residency

Keep EU data in Frankfurt, US data in Virginia. Automatic routing enforces data residency without code changes.

Pay list price. No markup.

We profit from scale, not by marking up your API costs. You pay standard Bedrock and Azure rates — we add no additional per-token fees.

$0
Platform fee
List price
Per-token cost

Your data, your region

Choose where your requests are processed. EU keys stay in Frankfurt, US keys stay in Virginia. Data residency enforced at the infrastructure level.

EU RegionFrankfurt

GDPR-compliant. Data never leaves EU boundaries.

US RegionVirginia

Low-latency for US workloads. Full model availability.

EU
US

Frontier labs never see your data

We route all inference through private cloud deployments on Bedrock and Azure. Your prompts and completions never touch Anthropic, OpenAI, or other AI company servers.

Private cloud inference

All requests route through Amazon Bedrock and Azure OpenAI — never to frontier lab servers. Your data stays in enterprise cloud boundaries.

Zero training on your data

Anthropic, OpenAI, and other AI labs never see or train on your prompts. Contractual guarantees from AWS and Microsoft.

No logging by AI labs

Unlike public API endpoints, private cloud deployments don't log your conversations for model improvement or analysis.

Enterprise compliance

SOC2, HIPAA, and ISO 27001 certifications. DPAs with cloud providers — not frontier labs who may change policies.

Start with $5 free credit

No credit card required. Get started in minutes with our OpenAI-compatible API.