Setting it up
1
Install the GitHub App
Project settings → GitHub → Connect GitHub. You are taken to
GitHub to install the Testorim app on the repository you want, then
brought back to the same section. Install it through this button: an
installation made directly on GitHub is not picked up.
2
Pick the installation and repository
Choose the GitHub installation and the Repository this project
tests.
3
Choose which procedures run
Tick them under Procedures to run on each pull request. Keep it to the
ones that matter on every PR. A slow suite makes people ignore the
comment.
4
Tell it where previews live (optional)
Preview address pattern is where each pull request’s preview deploy
lives, with
{{branch}} or {{prNumber}} in it, for example
https://preview-{{prNumber}}.your-app.com. Leave it blank to test the
project’s own address.5
Subscribe to check runs (optional)
To mirror your own CI, the app’s webhook subscription must include the
check_run event. In GitHub: the app’s settings → Permissions &
events → Subscribe to events.
What happens on a pull request
- When a pull request is opened or reopened (and on every push, if you chose that), Testorim builds the preview address from your pattern and uses it as the base address for the run.
- The selected procedures are dispatched in chunks sized to your plan’s concurrent run limit, each chunk finishing before the next starts.
- One comment is posted and edited in place as results arrive, not a new comment per run. While work is queued, the comment says how many are done and how many are waiting. A run that needs review is marked, and so is the headline when nothing failed.
PR activity
Withcheck_run subscribed, Testorim keeps a read-only mirror of your
repository’s check runs: lint, test, build, deploy, whatever you have.
- The project overview shows Recent PR activity: the last pull requests
with an aggregated status of
in progress,success,failureormixed. /project/<project-id>/pr/<number>shows one pull request’s unified timeline: your check runs and Testorim’s QA runs together, each with its verdict, auto-refreshing while anything is in progress.
Security
Webhook deliveries are verified by HMAC with a constant-time comparison, and each delivery is processed exactly once. A redelivery is acknowledged and does nothing.The GitHub integration needs a subscription (a trial counts).

