whereismyai
Lumina Guide
Lumina Guide is a wearable RGB-D navigation assistant prototype for visually impaired individuals running on NVIDIA Jetson.
Lumina Guide is a wearable RGB-D scene understanding and travel prompt prototype designed for visually impaired people. Built on NVIDIA Jetson Orin Nano Super and Orbbec Gemini 336L, it combines local perception, concise voice feedback, virtual vibration, and optional cloud understanding. The system uses C++ for frame acquisition and Python for perception tasks including YOLO11n object detection and geometric analysis. It features a unified debugging interface, state traceability, and a prompt feedback loop. The project currently operates as a research and engineering verification prototype to assist white cane users.
Lumina Guide at a glance
Key features
- RGB-D alignment and depth region diagnosis
- CUDA YOLO11n object detection
- Local voice alerts using Piper and eSpeak NG
- Six-channel virtual vibration feedback
- Real-time perception dashboard in browser
- Ground line adjustment and obstacle analysis
- Authorized image and question review
Use it for
- Standing observation of surrounding environments
- Walking alerts with risk priority and short sentences
- On-demand scene understanding through authorized images
Alternatives to Lumina Guide
- Fara — It operates visually to perform multi-step web tasks without accessibility trees.
- OpenGCUA — Lets models decide how to observe, act, and organize work dynamically.
- LoongForge-VLDA — Achieves high success rates on simulation benchmarks and real robots.
- AgentGarten — Runs executable code worlds with real-time neural rendering for agents.
- Dsh Aurabot Qq — Modular architecture allows custom extensions, prompt adjustments, and local service integrations.
- Cua — Scales computer fleets across four OS families with one MCP/CLI driver.
All Lumina Guide alternatives