whereismyai › Scikit-LLM
Scikit-LLM alternatives
The 12 products closest to Scikit-LLM in what they do and who they're for, best match first.
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- GLiNER — Enables zero-shot entity extraction without labeled training data on consumer CPUs. (Code, Free)
- LLM CLI — It enables command-line interaction with remote APIs and local machine models. (Code, Free)
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware. (Code, Free)
- vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
- LLM Stats — Independent rankings updated continuously from live API metrics. (Research, Free)
- LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
- MLC LLM — Enables native optimization and deployment of AI models across platforms. (Code, Free)
- LitGPT — Readable single-file LLM code with tested finetuning recipes (Code, Free)
- Overview — Learn language models by running hands-on experiments without writing scripts (Research, Free)
- WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)