whereismyai › LLM Test Server
LLM Test Server alternatives
The 12 products closest to LLM Test Server in what they do and who they're for, best match first.
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- LiteLLM — One OpenAI-format API for 100+ LLM providers (Code, Free)
- llmfit — Auto-detects hardware to recommend and score compatible open-source LLMs. (Code, Free)
- LLM CLI — It enables command-line interaction with remote APIs and local machine models. (Code, Free)
- LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
- WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
- FreeLLMAPI — Accesses hundreds of free LLM models and billions of tokens through one API key. (Code, Free)
- Applitools — Eliminates false positives and verifies AI-generated code with visual precision. (Code, Paid)
- LangChain4j — Integrates LLMs and vector stores directly into Java applications. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- llmspy.org — Self-host access to 530+ AI models across 24 providers with built-in tools. (Chat, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)