fix: test fix to change clicks to box drawing

This commit is contained in:
Zoe
2026-09-21 00:04:35 -05:00
parent d4b5ea0254
commit 4b08ce05a4
5 changed files with 37 additions and 8 deletions
+2 -2
View File
@@ -77,14 +77,14 @@ Other action examples:
{
"expectedSize": [1280, 800],
"actions": [
{ "type": "click", "x": 300, "y": 200, "button": "left" },
{ "type": "click", "ymin": 190, "xmin": 280, "ymax": 210, "xmax": 320, "button": "left" },
{ "type": "keys", "keys": ["ctrl", "a"] },
{ "type": "scroll", "direction": "down", "steps": 2 }
]
}
```
Use coordinates from your own screenshot, not these example coordinates. `expectedSize` is optional and rejects input if the screen size changed. Supported actions are click, click_target, scroll, keys, text, and wait. Drag is deferred. Actions are serialized by a VM-side lock; avoid manual interaction while a request runs. The full request is validated before any actions execute, but runtime failures can still leave partial effects.
Use coordinates from your own screenshot, not these example coordinates. Coordinate clicks draw a bounding box with `ymin`, `xmin`, `ymax`, and `xmax`; the click is delivered to the center of the box. `expectedSize` is optional and rejects input if the screen size changed. Supported actions are click, click_target, scroll, keys, text, and wait. Drag is deferred. Actions are serialized by a VM-side lock; avoid manual interaction while a request runs. The full request is validated before any actions execute, but runtime failures can still leave partial effects.
After a non-empty action batch, the helper waits **500 ms** before taking the resulting screenshot and scanning accessibility targets. Capture-only requests have no added delay. This allows ordinary UI updates to paint; slow loads still need an explicit wait or another observation.