
Experiential
Open source AI gateway and router that exposes hosted, BYOK, local, and custom models through one OpenAI-compatible API.
Open source alternative to:

Experiential is an open source gateway and router for AI agent workflows. It gives you one OpenAI-compatible API in front of hosted models, your own provider keys (BYOK), local models, and custom fine-tuned models, so agents and apps call a single endpoint instead of juggling provider SDKs. A setup wizard (pip install experiential, then exp) walks you through connecting providers, issuing keys, and setting a default spend budget, and a hosted version at platform.experientiallabs.ai serves the same API — OpenAI-compatible plus Anthropic Messages — if you don't want to run the gateway yourself.
Beyond proxying requests, Experiential acts as a control plane: you decide which users and agents can use which models, for which use cases, and how much they can spend. It collects OpenTelemetry traces from your agent traffic, and exp build uses those traces to simulate your workload and fit a custom router optimized for quality, speed, and cost. You can go a step further with exp optimize model, which fine-tunes an open source model on your traces via Thinking Machines' Tinker.
Compared to hosted routers like OpenRouter, Experiential is Apache-2.0 licensed and can run entirely on your own machine, so keys and prompts never have to leave your infrastructure. Compared to gateway platforms like Portkey or Cloudflare AI Gateway, it focuses on agent workflows — per-identity budgets, trace-driven routing, and turning production traffic into custom routers or fine-tuned models you own.
Categories:
Build with:
Frequently Asked Questions
Which model providers can Experiential connect to?
Out of the box it supports connecting your own keys for OpenAI, Anthropic, Gemini, Azure, Bedrock, Fireworks, and OpenRouter, alongside hosted, local, and custom models. Everything is exposed through one OpenAI-compatible API, and the hosted gateway also speaks the Anthropic Messages API.
Can I point coding agents like Claude Code or Cursor at Experiential?
Yes. The repository's SETUP.md includes copy-paste prompts you hand to coding agents such as Claude Code, Cursor, Codex, Aider, and Conductor, and the agent performs the setup and repoints the tool at your gateway.
How does Experiential control who can use which models and how much they spend?
Requests are tied to identities and public model aliases. You decide which users and agents can use which models, for which use cases, and set spending limits per identity. The setup wizard, for example, issues a default 50 dollar command budget when it prints your first key.
Can Experiential train a custom model from my traffic?
Yes. It ingests OpenTelemetry traces from your agent, the exp build command replays them as a simulation and fits a router optimized for quality, speed, and cost, and exp optimize model fine-tunes an open source model on those traces using Tinker.
Does Experiential collect telemetry, and can I turn it off?
Anonymous aggregate product telemetry via PostHog is on by default. It never includes prompts, traces, model names, credentials, or raw content, and you can disable it with exp config telemetry disable.
Project Details
Repository details
Updated 8/28/2026, 10:00:18 AM
View Repository

