whereismyai › Distributed Llama
Distributed Llama alternatives
The 12 products closest to Distributed Llama in what they do and who they're for, best match first.
- Llama Windows — It runs open models offline with zero configuration. (Code, Free)
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- LLamaSharp — Runs large language models efficiently on local hardware using C#. (Code, Free)
- Mesh LLM — Run large local models across multiple machines through one OpenAI-compatible endpoint. (Code, Free)
- WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
- LlamaIndex — It provides hosted APIs for parsing documents and extracting typed data with one API key. (Code, Freemium)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- LlamaCoder — Generates functional applications directly from text descriptions. (Code, Free)
- llama-swap — It runs multiple local AI models with zero external dependencies. (Code, Free)
- OpenLLM — It simplifies infrastructure management and optimizes inference speed and cost. (Code, Free)
- LlamaFactory — Provides a code-free CLI and Web UI for training 100+ different LLMs. (Code, Free)