Hoan/GenericAgent
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,411 Commits 2 Branches 8 Tags
eaba500314c2baed6f64ca39fdb68f50d19a0b74
Commit Graph
5 Commits
Author SHA1 Message Date
ljq 2bacbf6a33 Fix macOS key modifiers and clarify computer-use SOP 2026-10-27 15:22:26 +08:00
ljq 0763061a48 Use in-process Quartz for macOS screenshots 2026-10-27 14:51:37 +08:00
weijia b006a84b7c fix(macljqCtrl): add CropToScreen helper + crop-origin coord hints (#614) 
On macOS the screenshot path lacked a counterpart to win32's
ClientToScreen. Detecting a target inside a cropped GrabScreen(bbox)
image and feeding the in-image (px,py) straight to Click silently
mis-clicks because the crop-origin offset is dropped.

- add CropToScreen(bbox, x, y): in-crop coords -> absolute physical
  coords (pure crop-origin add, no scaling)
- GrabScreen docstring: warn about the crop-origin trap and not to
  hand-roll screencapture -R (it takes logical points)
- Click 0%-pixel-change warning now names the common causes
- ljqCtrl_sop.md: add macOS subsection mirroring the win32 trap note
 2026-06-17 20:15:16 +08:00
weijia 05d9dba08a feat(memory): enhance macOS AX control (resolve_pid fix, enabled field, AXClick)Feat/macos ax enhancements (#611) 
* feat(memory): enhance macOS AX control (resolve_pid fix, enabled field, AXClick)

- _resolve_pid: fix bundle_id branch (used un-imported AppKit), 3-tier match (bundle id > app name exact > substring)
- AXElements: collect 'enabled' field (SOP: check disabled before click)
- AXClick: AXPress-first then fallback to physical-coord Click, honest success判定 via pixel diff
- AXFind: add enabled_only filter, refactor if-forest into _hit helper

* docs(ljqCtrl): tighten macOS AX guidance, drop boilerplate & app-specific detail

- collapse 5-line cross-platform import boilerplate to one line
- generalize control-identifier tip (remove app-specific identifiers)
 2026-06-15 09:00:45 +08:00
weijia dab1b1a242 feat(memory): add macOS port of ljqCtrl with AX accessibility support (#606) 
- macljqCtrl.py: macOS implementation of mouse/keyboard/screenshot/window
  enumeration mirroring ljqCtrl API, plus AX accessibility control tree
  (AXElements/AXFind/AXPress) as the macOS equivalent of UIA
- computer_use.md: add section 3 documenting the macOS platform branch
- .gitignore: whitelist memory/macljqCtrl.py
 2026-06-14 09:14:06 +08:00