whereismyai › Liger Kernel
Liger Kernel alternatives
The 12 products closest to Liger Kernel in what they do and who they're for, best match first.
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- Soup — Fine-tune and align models like Llama-3.1-8B on a 4 GB laptop GPU. (Code, Free)
- LlamaFactory — Provides a code-free CLI and Web UI for training 100+ different LLMs. (Code, Free)
- Ludwig — Train and fine-tune complex AI models using a single YAML configuration file. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- NVIDIA Model Optimizer — Compress deep learning models to accelerate inference performance. (Code, Free)
- LitGPT — Readable single-file LLM code with tested finetuning recipes (Code, Free)
- MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware. (Code, Free)
- torchao — It speeds up training and inference while reducing memory usage with native PyTorch. (Code, Free)
- Enki LLM — Runs Llama-3.2 1B in pure Rust at 40 tok/s with live GPU to CPU migration. (Code, Free)