torchao alternatives

The 12 products closest to torchao in what they do and who they're for, best match first.

AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
Floret Torch — Trains word vectors up to twenty times faster than CPU floret. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
Soup — Fine-tune and align models like Llama-3.1-8B on a 4 GB laptop GPU. (Code, Free)
Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
TensorZero — Combines an LLM gateway, observability, and optimization in one tool. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
MNN — It delivers high-performance inference and training with a lightweight footprint. (Code, Free)
ncnn — No runtime dependencies and supports CPU and Vulkan GPU backends. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
Gradio — Builds web interfaces for machine learning models using only Python code. (Code, Freemium)
Ultralytics YOLO — Delivers high-speed and high-accuracy results in real-time. (Image, Free)