whereismyai › CTranslate2
CTranslate2 alternatives
The 12 products closest to CTranslate2 in what they do and who they're for, best match first.
- GLiNER — Enables zero-shot entity extraction without labeled training data on consumer CPUs. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- transcribe.cpp — Runs 16 model families and 60+ variants with GPU and CPU acceleration. (Audio, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- ESPnet — Provides reproducible recipes and hundreds of pretrained models for various speech tasks. (Audio, Free)
- Soup — Fine-tune and align models like Llama-3.1-8B on a 4 GB laptop GPU. (Code, Free)
- jevgrep — Reduces coding agent costs by providing targeted, relevant repository context. (Code, Free)
- Text Embeddings Inference — High-performance serving for open-source embedding models. (Code, Free)
- LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
- TensorRT — Speeds up inference by 36X compared to CPU-only platforms. (Code, Free)
- Hugging Face Transformers — It provides a unified API for over 1M+ pretrained model checkpoints on the Hub. (Code, Free)
- LangExtract — It maps every extraction to its exact location in the source text. (Code, Free)