Skip to content

Developer tools

Portkey AI Gateway

Free softwareOpen sourceLocal

Proxy model requests with routing, retries and fallbacks.

What you can use it for

Proxy model requests with routing, retries and fallbacks.

  • Run a unified LLM API gateway on your own infrastructure instead of paying for a managed gateway workflow. LLM Gateway also offers free BYOK; this does not make already-free BYOK a paid feature. Provider tokens and hosting are separate costs. Reported use covers the model proxy, not every self-hosted feature.
Workflow coverage and comparison notes

For the gateway and routing slice of OpenRouter: use Portkey's open-source gateway with your own provider keys. It does not include OpenRouter's hosted model catalogue or its free-model quota. Hosting and model calls cost extra. The use report covers the hosted proxy; the current self-hosted route is documented separately and was not hands-on tested by us.

Before you switch

Use the open-source gateway, not an assumed unlimited Portkey Cloud plan. Unlike OpenRouter, it has no hosted model catalogue or free-model quota. Self-hosting, maintenance and model calls cost extra. The use report covers the hosted proxy; the current self-hosted route is separately documented, not tested by us.

Alternatives to these paid apps

Each comparison covers the workflow described above, rather than every paid feature.