whereismyai
Octopus
Octopus is an API aggregation service that connects multiple LLM provider channels with unified management.
Octopus is an LLM API aggregation service designed for individuals to manage multiple provider channels from a single platform. It converts protocols between OpenAI Chat, OpenAI Responses, and Anthropic API formats while automatically syncing model pricing and available lists. The system features automatic failover to switch channels when an upstream channel fails, along with real-time end-to-end request visualization and upstream error shielding. It provides comprehensive analytics for request statistics, token consumption, and cost tracking through a web management panel. The application deploys as a lightweight single binary with support for SQLite, MySQL, and PostgreSQL databases.
Octopus at a glance
- Best for: Software engineer
- Runs on: self-hosted, open source
- Pricing: Free
- Released: November 2025
- Category: AI coding tool
- Website: github.com/bestruirui/octopus
Key features
- Multi-channel aggregation
- Protocol conversion
- Price synchronization
- Model list synchronization
- Automatic failover
- Real-time request visualization
- Upstream error shielding
- Request analytics and cost tracking
Use it for
- Manage multiple LLM provider channels with unified management
- Convert between OpenAI and Anthropic API formats
- Track token consumption and request costs
- Aggregate multiple channels into a unified external model name
Alternatives to Octopus
- llm-d — Deploys production-grade LLM serving on existing hardware clusters.
- FreeLLMAPI — Accesses hundreds of free LLM models and billions of tokens through one API key.
- LiteLLM — One OpenAI-format API for 100+ LLM providers
- AG-UI — Standardizes agent-user interactions and generative UI for applications.
- OpenLLM — Routes developer tools through multiple providers and local models with included inference.
- OpenCode — Works with 75+ model providers, local models, and existing subscriptions
- oMLX — It uses paged SSD KV caching to reduce agent TTFT to under 5 seconds.
- Opik — It offers comprehensive tracing, automated evaluations, and open-source flexibility.
- LangChain4j — Integrates LLMs and vector stores directly into Java applications.
- New Relic — Unified visibility across applications, infrastructure, and AI models.
- LLM Gauze — Remediates local language model errors and fixes malformed tool calls automatically.
- OpenLLMetry — Integrates into applications with just two lines of code.
All Octopus alternatives