whereismyai › Neural Compressor
Neural Compressor alternatives
The 12 products closest to Neural Compressor in what they do and who they're for, best match first.
- MNN — It delivers high-performance inference and training with a lightweight footprint. (Code, Free)
- ncnn — No runtime dependencies and supports CPU and Vulkan GPU backends. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
- JFrog Boost — Lowers token usage for AI coding agents through input filtering. (Code, Free)
- NVIDIA Model Optimizer — Compress deep learning models to accelerate inference performance. (Code, Free)
- TensorRT — Speeds up inference by 36X compared to CPU-only platforms. (Code, Free)
- torchao — It speeds up training and inference while reducing memory usage with native PyTorch. (Code, Free)
- Billion Context — Compresses conversation history to run single AI coding sessions for days. (Code, Free)
- TensorZero — Combines an LLM gateway, observability, and optimization in one tool. (Code, Free)
- Cube Studio — An open source, end-to-end platform for MLOps and distributed model training. (Code, Free)