Rufous

Rufous is an AI agent tool that runs 2B to 12B models on local machines and checks their work.

Rufous is an agent tool built specifically for small language models between 2B and 12B parameters running locally. It keeps an uneditable record of every tool call the model makes and holds replies that miss expected actions or report false successes. The software starts with a small prefill of instructions and core tools, allowing models to load additional tools, memory, web search, and skills progressively. A safety gate with five distinct rings checks every tool call to sandbox sub-agents, block irreversible commands, ask for permission on environment changes, restrict paths, and keep actions reversible. It runs via a web interface, terminal, or inside editors supporting the Agent Client Protocol like Zed. It connects to Ollama, LM Studio, llama.cpp servers, and OpenAI-compatible endpoints without requiring user accounts or sending usage data.

Rufous at a glance

Best for: Software engineer
Runs on: Web, macOS, Windows, Linux
Pricing: Free and open source under Apache-2.0 license
Released: November 2026
Category: AI agent tool
Website: rufous.chat

Key features

Checks model reports against an uneditable tool call record
Starts with a small 1,250-token prefill of core tools and prompt
Uses a safety gate with five rings to control tool execution
Supports progressive disclosure of web, memory, and MCP tools
Runs locally via web UI, terminal, or ACP editor integration
Connects to Ollama, LM Studio, llama-server, and cloud endpoints
Includes offline mode to disable network tools and cloud providers

Use it for

Running local AI coding agents inside text editors
Executing multi-turn tasks with small language models
Managing local file edits and bash commands safely
Testing small open-source models with verified tool records

Alternatives to Rufous

Ruflo — Orchestrates models, agents, and tools to plan, execute, and verify complex tasks.
AgentFlux — Plans workflows from descriptions and runs locally in Docker.
Rakazo — Complete ownership of data, models, and execution environment.
ruOS — A private agentic desktop that starts instantly in your web browser.
Ruflo Console — Manages architecture decision records, swarms, and sessions inside Claude Code.
BrowserOS — Runs entirely locally and lets AI agents use real user logins to complete tasks.
Dify — Open-source visual builder for agents and RAG apps
Pinvou Agent — It runs local model inference and AI workflows on a desktop supercomputer.
Runway — Control Claude Code and Codex sessions on local or cloud machines from any phone.
Merlin — Run Claude Code and Codex on your own machines with your team.
OpenBot — Runs entirely on your own infrastructure with strict document permissions and custom.
Ouroboros — Pins the specification and verifies the coding result.

All Rufous alternatives