ARBR

ARBR is an open AI gateway and control plane that routes, observes, and governs requests across every model provider.

ARBR is an open AI gateway and control plane designed to manage routing, observability, budgets, and governance across multiple model providers. It provides a single OpenAI-compatible endpoint that allows existing applications and SDKs to route tasks, enforce policies, and monitor token usage without changing their stack. The platform evaluates traffic using LLM judges, runs canary deployments for new models, and exports structured events to local dashboards or OpenTelemetry tools like Datadog, Grafana, and Prometheus. Administrators can set budgets, rate limits, output guardrails, and prompt-injection checks directly in the request path. It is built for engineering teams seeking centralized operational control over their entire AI stack.

ARBR at a glance

Best for: Software engineer, Founder
Runs on: self-hosted, open source
Pricing: Freemium
Released: September 2026
Category: AI agent tool
Website: projectarbr.org

Key features

Normalize access across model providers
Route tasks based on difficulty and cost
Enforce budgets and rate limits
Monitor costs, latency, and tokens
Evaluate live traffic with an LLM judge
Canary and shadow new models safely
Export structured events to OpenTelemetry

Use it for

Route each task to the optimal AI model
Enforce cost and security policies before inference
Track AI spend and performance by team and user
Test new models safely using live traffic

Alternatives to ARBR

OpenSquilla — Maximizes AI intelligence density while minimizing token costs through smart routing.
OrcaRouter — Route requests to the best models without paying token markups.
BrowserOS — Runs entirely locally and lets AI agents use real user logins to complete tasks.
OpenRMM — Self-hosted infrastructure with complete data privacy and human approval for every action.
Hybro — Orchestrates local and remote agents using the open Agent2Agent protocol.
OpenBot — Runs entirely on your own infrastructure with strict document permissions and custom.
Rakazo — Complete ownership of data, models, and execution environment.
OpenRouter — Access over 500 models and 80 providers through one unified API.
OpenHarness — Manages Claude Code, Codex, and Hermes from a single command center.
Argus — Enforces strict budgets and permissions for long-running autonomous agents.
OpenAgent — Self-hosted single binary with MCP support, 30+ model providers, and zero data leakage.
FastRouter.ai — Optimizes AI cost and reliability across 200+ models with zero model markup.

All ARBR alternatives