agentgateway

Agentgateway is an open-source gateway that handles AI traffic, LLM routing, MCP, and HTTP in a single data plane.

Agentgateway is an open-source HTTP and gRPC gateway designed to handle traditional application traffic and AI-native protocols in one data plane. It routes, secures, observes, and governs services, LLM provider traffic, MCP tools, and agent-to-agent communication. It supports routing to OpenAI, Anthropic, Gemini, Vertex, Bedrock, and self-hosted models running on vLLM, TGI, or Triton. It is built for platform teams and developers who need to secure and observe AI agents, enforce token budgets, and apply cost controls. The platform features native protocol support for the Model Context Protocol, OpenTelemetry integration, and policy enforcement on every hop.

agentgateway at a glance

Best for: Software engineer
Runs on: open source
Pricing: Free
Released: March 2025
Category: AI coding tool
Website: agentgateway.dev

Key features

Route to OpenAI, Claude, Gemini, and self-hosted models
Native protocol support for Model Context Protocol
OpenTelemetry integration for metrics and traces
Token budgets and semantic caching
Hard caps on API keys and teams
JWT validation and OIDC login flow
Rate limiting keyed on request attributes

Use it for

Route LLM traffic and handle failover
Discover and secure MCP servers
Manage agent-to-agent communication
Monitor token usage and USD costs

Alternatives to agentgateway

Open Connector — Connects 1500 plus SaaS apps to AI agents with open-source auth and gateway tools.
Agent2api — It combines multiple AI desktop client accounts into one local OpenAI-compatible API.
Agent Middleware — Requires signed permits and provides offline-verifiable receipts for tool calls.
Manifest LLM Gateway — It autofixes bad requests and routes calls across multiple providers with zero downtime.
GoRoute — Consumes 5.1MB of RAM with sub-10ms latency for coding agents.
AG-UI — Standardizes agent-user interactions and generative UI for applications.
ARBR — Unifies routing, budgets, and governance behind one OpenAI-compatible endpoint.
Agentloop — Provides a clean agent loop with provider-agnostic LLM access, hooks, and safety budgets.
LiteLLM — One OpenAI-format API for 100+ LLM providers
OrcaRouter — Route requests to the best models without paying token markups.
AgentTrust — Enforces zero-trust policy rules and maintains an immutable cryptographic audit ledger.
Casdoor — It integrates authentication for both human users and AI agent workflows.

All agentgateway alternatives