whereismyai
Bluey By Riley
Bluey By Riley is an AI agent desktop and mobile assistant that points at screen elements, transcribes audio, and automates computer tasks.
Bluey is an AI assistant consisting of an iPhone app and a Mac menu bar app featuring a blueberry character who lives on the phone and interacts with the computer. Users interact through voice sessions powered by the OpenAI Realtime API over a WebSocket, allowing the assistant to answer questions, point at items on the screen, and execute computer actions like clicking, typing, and opening apps. The application records meeting audio in five-minute chunks, transcribes it with speaker labels, and saves session notes locally. It includes built-in safety guardrails such as requiring confirmation for difficult tasks and ignoring instructions found within on-screen text. Setup requires an OpenAI key, Xcode for the iOS app, and Accessibility permissions on the Mac.
Bluey By Riley at a glance
Key features
- Point at screen elements and track mouse movement
- Record and transcribe meeting audio with speaker labels
- Execute computer actions including clicks, keystrokes, and scrolling
- Stream text responses through speech bubbles
- Connect iPhone and Mac over local Wi-Fi via Bonjour
- Control settings through a Mac menu bar interface
- Enforce safety guardrails and action confirmations
Use it for
- Managing and transcribing daily meeting notes
- Controlling computer actions through voice commands
- Pointing out specific UI elements on the screen
- Automating navigation through apps and websites
Alternatives to Bluey By Riley
- iphone-use — Operates real iPhones via HTTP and MCP without touching the host screen.
- Peekaboo — Enables AI agents to interact with macOS applications directly.
- Iphone Use App — Runs directly on the iPhone with no computer needed at run time.
- Sidekeys — Turns an iPhone into an extra Mac display, app shortcut deck, and AI agent dashboard.
- agent-device — Token-efficient snapshots and semantic references for native mobile and TV apps.
- Droy — Executes phone tasks and operates apps via AI assistance.
- Sayonic — Controls Mac apps, files, and events using natural voice or text commands.
- Esp32 Iphone Agent — It uses standard AirPlay and a USB mouse bridge, requiring no Mac, jailbreak, or developer account.
- Pip — It sees your screen and points directly at the exact button to click.
- m’kay — Talk to your Mac's AI agents by voice from anywhere.
- Agibot — Runs continuously on your Mac and integrates with Telegram and Slack.
- sideOS — It reads the accessibility tree in about 50 ms and operates desktop apps directly.
All Bluey By Riley alternatives