AI Gateway — Fallback Routing

What happens when your primary LLM provider goes down? Watch AI Gateway automatically route to the fallback. Zero downtime for your users.

The problem: Last year OpenAI had a 4-hour outage. Anthropic had outages too. Every LLM provider has incidents. If your app calls these APIs directly, your app goes down with them. AI Gateway sits between your code and any AI provider — when the primary fails or rate-limits, traffic flows to a fallback automatically. Your users never see the outage.
Ready. Click a button above to run.

Primary

First choice
@cf/meta/llama-3.1-8b-instruct-fast
Waiting...
if fails

Fallback

Backup if primary fails
@cf/meta/llama-3.2-3b-instruct
Waiting...

Routing Decision

Final response delivered to user
← Back to demo dashboard