whereismyai
SmallCode
SmallCode is an AI coding agent optimized for small local LLMs running on consumer hardware.
SmallCode is a terminal-native coding agent designed to extract useful work from local models with 8B to 35B parameters. It compensates for the limitations of small models through an intelligent architecture, including a budget-managed context engine, a forgiving multi-format tool call parser, and TODO-driven planning. The product is built for developers who want to run AI coding tasks locally without relying on cloud APIs or frontier models. Key architectural features include a MarrowScript cognition layer, a BoneScript integration, hybrid code search, and model escalation options. It supports prebuilt binaries for Windows, macOS, and Linux without requiring Node.js.
SmallCode at a glance
Key features
- Budget-managed and summarized context engine
- Forgiving multi-format tool call parser
- TODO-driven planning and step decomposition
- Hybrid code search combining exact matching and semantic ranking
- Search-and-replace patch-first editing
- Persistent shell sessions across calls
- Model escalation to cloud models on hard fail
Use it for
- Running AI coding tasks locally on consumer hardware
- Searching codebases using hybrid exact and semantic ranking
- Executing multi-step coding tasks with small local models
- Managing context limits and token budgets for local LLMs
Companions
Tools that articles about SmallCode recommend using with it, each with its job.
- Ollama — Run local models at zero marginal cost, with code kept on your machine.
- OpenRouter — Access over 500 models and 80 providers through one unified API.
- Context7 — Provides up-to-date documentation for AI agents and code editors.
- Daytona — Runs sessions in isolated sandboxes synced to git branches.
- Composio — Equips AI agents with tools, managed user auth, and sandboxes across 1,500+ apps
- Oh My OpenCode Slim — Lightweight multi-agent orchestration and background tasks.
Alternatives to SmallCode
- Little Coder — Optimized for small local models with built-in planning and research tools.
- mini-SWE-agent — It offers high performance with a simplified, minimal codebase.
- OpenCode — Works with 75+ model providers, local models, and existing subscriptions
- Strata — Runs large AI models locally on consumer gaming PCs without server reliance.
- Mcode Stack — Provides real everyday engineering habits and skills for AI coding agents.
- Local Code Community — Runs local offline models and built-in tools securely inside an app sandbox.
- ZCode — Integrates GLM-5.3 with multi-agent workflows and remote chat control.
- TRAE — It features an autonomous coding agent that drives the entire development process.
- MiniMax Code — Connects local files, tools, and browsers to complete desktop and remote tasks.
- Kilo Code — Open-source agent with any model and no markup on inference
- Freebuff — Access multiple coding AI models for free without subscriptions.
- Shim — It offers zero runtime dependencies, no telemetry, and a static binary.
All SmallCode alternatives