whereismyai
Iphone Use App
Iphone Use App is an iPhone application that allows a vision language model to control the phone it runs on.
This application lets an AI model take control of an iPhone directly from the device itself. It mounts a developer image and uses a loopback VPN to take screenshots and perform actions like tapping, swiping, typing, and opening apps. Each step sends a screenshot to an OpenAI-compatible vision model or OpenRouter key, which responds with tool calls until the task is complete. A one-time setup using a Mac over USB generates a pairing file, but no Mac is needed afterward. It is built for users who want to automate tasks on their own devices using AI agents, complete with progress tracking via Live Activities and a chat history of every run.
Iphone Use App at a glance
- Best for: Software engineer, Founder
- Runs on: iOS, macOS, self-hosted, open source
- Pricing: Free
- Released: October 2026
- Category: AI agent tool
- Website: github.com/eliotandres/iphone-use-app
Key features
- Controls the iPhone directly from the device itself
- Starts from chat, Siri, Shortcuts, or URL schemes
- Uses OpenRouter or OpenAI-compatible vision models
- Shows progress with a Live Activity and Stop button
- Saves every run as a chat history
- Supports custom pairing files generated via Mac
Use it for
- Automate repetitive navigation tasks on iOS
- Test app layouts and user flows automatically
- Execute multi-step mobile workflows using prompts
Alternatives to Iphone Use App
- Esp32 Iphone Agent — It uses standard AirPlay and a USB mouse bridge, requiring no Mac, jailbreak, or developer account.
- CallMeMCP — It connects running artificial intelligence agents directly to phone calls.
- Simulator Use — It runs tests and reads screens fast with a token-efficient native engine.
- Mobilerun — Control real mobile devices and automate tasks with any large language model.
- AgentiLoop — A native Mac agent that works with 23 model providers or local models
- Phone Harness — Connects Claude Code or Codex to real iOS and Android devices.
- Anan Iphone Use — Enables physical iPhone control via USB and Bluetooth.
- agent-device — Token-efficient snapshots and semantic references for native mobile and TV apps.
- PhoneClaw — It executes AI agent tasks and system tool calls entirely on-device.
- sim-use — Provides token-efficient screen outlines and alias-cached taps for fast agent loops.
- Composio — Equips AI agents with tools, managed user auth, and sandboxes across 1,500+ apps
- Bluey By Riley — A blueberry character on an iPhone controls the Mac screen and manages meeting notes.
All Iphone Use App alternatives