Pause Flow
State: Frontmost
Reset
01 // MIRRORED PHONE
[BTN] CONNECT
X:0.12 Y:0.72
[TXT] INPUT TEXT
X:0.12 Y:0.52
[SWP] UNLOCK
X:0.12 Y:0.22
MIRROR STREAM: 60 FPS
02 // OCR EXTRACTION
OCR: "CONNECT"
CONF: 0.99 | [0.12, 0.72]
OCR: "INPUT TEXT"
CONF: 0.97 | [0.12, 0.52]
OCR: "UNLOCK"
CONF: 0.95 | [0.12, 0.22]
VNRecognizeTextRequest
03 // COORD MAPPING
FLIP Y: (1.0 - Y_VIS)
VISION (BL) -> MACOS (TL)
SCALE: NORM * BOUNDS
PIXEL COORDS CALCULATED
TARGET: FRONTMOST
MODE: GLOBAL CGEVENT
04 // ACTION EXECUTION
TAP (CGPostMouseEvent)
EVENT: LEFT CLICK DOWN/UP
TYPE (CGEventKeyboard)
EVENT: INJECT TEXT KEYS
SWIPE (Drag Gesture)
EVENT: DRAG VECTOR [X1,Y1->X2,Y2]
FRAME
MAPPED
TAP INJECTION
KEY INJECTION
SWIPE GESTURE