whereismyai
VoiceGremlin
VoiceGremlin is an end-to-end testing platform that places real phone calls to validate AI voice agents.
VoiceGremlin is an end-to-end testing platform designed for AI phone agents. It places real phone calls from a carrier line to test SIP integration, speech-to-text, text-to-speech, and functional behavior. Users pass plain English test cases to the REST API without managing a test case repository or using an SDK. An AI agent role-plays as a customer during the call, and a Judge evaluates the transcript against the test goal to produce a pass or fail result. Failed test notifications include the complete call transcript for immediate troubleshooting. It is built for developers and DevOps teams maintaining production voice agents.
VoiceGremlin at a glance
- Best for: Software engineer
- Runs on: Web, API
- Pricing: 100 free minutes; no credit card required
- Released: October 2026
- Category: AI agent tool
- Website: voicegremlin.com
Key features
- Test AI voice agents via REST API
- Place real phone calls from carrier lines
- Evaluate behavior with a Judge LLM
- Use plain English test descriptions
- Receive complete call transcripts on failure
- Integrate into CI pipelines with two API calls
Use it for
- Verify AI voice agent functionality in CI
- Test SIP and speech integration via phone calls
- Validate agent compliance and disclosures
Alternatives to VoiceGremlin
- Coval — Prove voice agent reliability through simulation and human-in-the-loop testing.
- NovaSynth — Tests voice agents on real calls and validates fixes automatically.
- Pipecat — Builds real-time voice and multimodal agents with frame-level control.
- Vapi — Provides scalable orchestration for voice AI agents with sub-500ms latency.
- Lampline — Runs locally with zero telemetry and connects to 20 model providers.
- voice-design-demo — It gives AI agents a voice that adapts to context.
- PhoneClaw — It executes AI agent tasks and system tool calls entirely on-device.
- NPCTalk — Adds real-time cloned NPC voice servers and AI agent skills for game mods.
- FastGPT — It uses hybrid retrieval and auto-cleansed data to prevent hallucinations.
- LangBot — Choose between free public beta cloud and dedicated production environments.
- Qwen Audio Agent — Separates voice conversation from task execution for continuous interaction.
- CallSitter — It automatically screens phone calls and sends real-time summaries to Telegram.
All VoiceGremlin alternatives