mcpField
A
argent-ios-device-interact

argent-ios-device-interact

github.com/software-mansionTesting & quality3.1k11.7k installsUpdated today
Repository

About argent-ios-device-interact

A skill documenting Argent device interaction on physical iPhones, including observation behavior, supported tools, and hardware-specific limits. It helps automation operators choose supported actions and recover when the device or app state changes.

Key features

  1. 01List and launch apps on iPhone
  2. 02Inspect UI and capture screenshots
  3. 03Tap, swipe, and enter keyboard input
  4. 04Wait for UI elements or screen idle
  5. 05Run interaction sequences
  6. 06Document unsupported hardware actions

Use cases

  1. 01Automate app interactions on a physical iPhone
  2. 02Recheck UI after returning an app to the foreground
  3. 03Choose supported gestures for device hardware
  4. 04Diagnose failed or unsupported device actions

MCP support

The input describes Argent device-interaction tools but does not specify MCP behavior.

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/software-mansion/argent --skill argent-ios-device-interact

After installing, type/argent-ios-device-interactin Claude Code to confirm it loaded.

Details

From the project README

Physical iPhone interaction

Read this only for a physical iPhone. argent-device-interact still applies for everything not listed here.

Contract

  • Observation never changes the screen; mutation may. describe and await-ui-element fail on a backgrounded target instead of re-fronting it; await-screen-idle returns settled: false with no reason. The first describe within a second of button home can still return the old tree; describe again. Gestures and keyboard re-front it and return reactivated: true; re-describe before the next step.
  • launch-app, open-url and restart-app set the app under automation; reinstall-app clears it; a tool-server restart forgets it: launch again.
  • Each tool's description states its own hardware limits (named keys, gesture-custom shapes, buttons, edge swipes, tap counts). A gated tool fails with a bare not supported on ios device: the fix is in the list below, not in the error.

Tools on hardware

  • Only these exist: list-devices, launch-app, restart-app, reinstall-app, open-url, describe, screenshot, screenshot-diff, gesture-tap, gesture-swipe, gesture-custom, button (home, volumeUp, volumeDown, actionButton on models that have one), keyboard, await-ui-element, await-screen-idle, run-sequence, the e2e tools, stop-simulator-server and stop-all-simulator-servers (session end). Every other device tool fails with not supported on ios device.
  • No two-finger gestures, rotate, shake, paste, settings-permissions, screen recording, debugger-*, react-profiler-*, native-profiler-*, native-*, boot-device: drive the app's own zoom and rotate UI with taps and drags, move the phone by hand, type with keyboard, change permissions in the phone's Settings, and debug, profile or record on a simulator.
  • gesture-swipe: durationMs sets drag speed, not time; momentum:false only rests 300 ms at the end, no damping. open-url https lands in Safari, never in the app that owns the link: pass bundleId.

Comments

Markdown supported