Start and follow a run
Start a run on code or a change, approve its price, and follow it to the findings.
A run reviews code in your repositories, or one change, and its findings go to the inbox. Every member of an organization can start and cancel runs, and each run is paid for with credit: see What a run costs.
Start a run
Open the run sheet from any of these places:
- New run on Runs.
- Run… on a repository workspace. The sheet starts on that repository.
- Run now on a focus. The sheet starts with that focus attached; see Run a focus.
V12 runs only repositories it can reach on GitHub. An archived repository cannot be run.
Review code or a change
The sheet asks one question at a time and lists your answers as it goes. Click an answer to change it.
Which repository? Pick one from the list, or type in Search your repositories.
What should it review? Choose The code to review a branch or a commit, or A change to review a pull request or a branch's new commits.
For The code, answer Which branch?. Open a branch to pick one of its commits instead (Which commit?). Then answer What should the run read?: tick up to 200 folders and files, or tick nothing to read the whole repository.
For A change, answer Which change? with an open pull request or a branch. Pick a branch to review its commits since it left the default branch, or open it to choose the first commit yourself (Since which commit?). The diff then shows what the run will review.
What should it look for? is optional. Describe what matters to you, type @ to reference a finding, document, file, commit or repository, or attach documents. The sheet waits until an uploaded document is readable.
Above the text, Add focus attaches a saved focus, up to 5; New focus… at the end of its list writes one. Save as focus turns what you wrote into a focus and attaches it in place of your words. A focus steers the run beside your words; it does not change the repositories or scope the run reads.
A code review can read more than one repository. Add a repository adds another one, with its own branch and scope, up to 9 in all.
Approve the price
The last question, Ready, shows four figures for the whole run:
- Files and Lines it will read (Changed lines for a change);
- Estimate, the price of the run;
- Left, the credit your workspace holds now.
Click Run to start the run, and its page opens. Save draft keeps the plan instead; see Drafts.
Run and Save draft become available once the price is in. They stay unavailable while a document is uploading, while nothing in scope can be reviewed, or while a repository in the run is not accessible.
If V12 refuses the start for lack of credit, the message links to Settings → Billing:
- "Insufficient credit balance." comes with Add credit; see Add credit.
- "Monthly spending limit reached." comes with Raise the limit; see Monthly limit.
Drafts
A draft is a run that is not started and not charged. Only you see your drafts in Runs, marked Draft.
- Resume reopens the sheet on the saved answers, so you can check them against the latest code and start the run.
- Discard removes the draft.
Only whoever saved a draft, or an Admin, can resume or discard it.
Follow a run
The run page and Runs show where each run is: Queued, then the stage it is working on, then Complete, Failed or Cancelled.
While any run is queued or working, Runs in the sidebar shows how many. In a repository workspace it counts the runs that read that repository.
The progress rail on the run page shows each stage:
- a code review: Queue, Compile, Scan, Triage, Prove and fix, Report and Inbox;
- a change: Queue, Compile, Review changes, Triage and Inbox.
The run page's header links every focus the run carried. Below it, the page shows each focus's document as the run read it, then the run's own words under Steering.
Cancel stops a run that is queued or working. A change review that is already working stops at its next checkpoint and shows Cancelling until then.
Refunds:
- a run that fails is refunded in full;
- a run cancelled before it started is refunded in full.
On a failed run, Retry starts the same run again as a new run. Only whoever started the run, or an Admin, sees it.
After the run
When a run completes, V12 imports its findings into the inbox, and the run page lists them under Findings.
- If the page shows Import findings, click it to add the run's findings to the inbox. If the import fails, Retry appears.
- Findings that did not reach the inbox can be downloaded; see Export run findings.
- Share publishes a public report of the run; see Share a run report.