whereismyai › Text Embeddings Inference
Text Embeddings Inference alternatives
The 12 products closest to Text Embeddings Inference in what they do and who they're for, best match first.
- Xinference — Supports a wide range of model types and hardware, including multi-node setups. (Code, Free)
- jevgrep — Reduces coding agent costs by providing targeted, relevant repository context. (Code, Free)
- Resin — Builds high-performance inference engines for complex models like DeepSeek and GLM. (Code, Free)
- FastEmbed — It uses ONNX Runtime for high speed and does not require a GPU or PyTorch. (Code, Free)
- TensorRT — Speeds up inference by 36X compared to CPU-only platforms. (Code, Free)
- GLiNER — Enables zero-shot entity extraction without labeled training data on consumer CPUs. (Code, Free)
- ZML — It enables Python-free inference while abstracting hardware complexities. (Code, Free)
- OpenLLM — It simplifies infrastructure management and optimizes inference speed and cost. (Code, Free)
- Flare Local Inference — Optimizes memory and bandwidth for workstations and compact systems. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- ncnn — No runtime dependencies and supports CPU and Vulkan GPU backends. (Code, Free)
- OptiLLM — Increases LLM reasoning accuracy by up to 10x without model training. (Code, Free)