While it runs
Three things update live.- The browser panel shows screenshots of the real page, roughly twice a second.
- The execution bar lists the steps, each turning from pending to running to passed, failed or skipped.
- The chat receives the report when the run ends.
The report
The report opens with a header line:- the state read back off the element after an assertion:
enabled, the text it actually held, the value in the input, ornot present - the address the page was on when the step acted, when the app moved it mid-step
- the network call a step’s API assertion matched, with its status
Why a step failed
Each failed step carries a cause, and the report describes it accordingly.
Debugging a failed run walks through each of
these.
The run page
Every run has a permanent page at/runs/<run-id> holding more than the chat
report shows:
- The final screenshot, and a screenshot at the moment of each failed step
- Per-step before/after snapshots: URL, page title and visible text
- Console messages and network requests captured during each step’s window
- Accessibility findings from the scan of the finished page
- Performance metrics for each page that loaded, and any budget breach
- Visual diffs (baseline, actual and difference side by side) for steps with a baseline
- Video and trace artifacts

