Admin Dashboard & Metrics
The RegressionBot Dashboard provides org-level visibility into test durations, execution trends, API key usage patterns, and historical job results.
Operational Metrics
The top of the dashboard displays aggregate metrics summarizing all visual regression activity within your organization:
The cumulative number of jobs executed by the organization across all projects and ad-hoc runs.
The average execution time (in seconds) of completed checks, tracking visual regression engine efficiency.
The average number of page/device combinations tested per execution.
Execution Trends
The Execution Trends chart displays duration trends for the 10 most recent jobs. Spikes in duration usually correlate with adding more pages or viewports to a project configuration.
Job History & Diff Downloads
The dashboard displays the execution history of your 10 most recent jobs. Each entry lists the project name, unique Job ID, scanned count, execution time, creation date, and status.
Job Status Lifecycle
Jobs transition through the following states, visible in the history badges:
- INITIALIZING: Preparing the environment and parsing target URLs.
- PROCESSING: Headless workers capturing and comparing screenshots in parallel.
- SUMMARIZING: Post-map AI summary is running, generating regressionbot summaries of visual changes using AWS Bedrock.
- COMPLETED: Execution finished. Diff metrics, images, and regressionbot summaries are ready.
- APPROVED: Visual changes were reviewed and promoted to the baseline.
- FAILED: Execution aborted due to system or network issues.
Diff Links
If a past job contains visual regressions, clicking the Diff Links button expands the job row to display each failed URL.
You can click Download Diff to view a side-by-side comparison image directly in your browser. The diff image highlights exact pixel-level differences in red inside a yellow bounding box.
Visual Triage Workspace
The Visual Triage Workspace allows you to review visual differences side-by-side. Click on any URL flagged with regressions to open the interactive modal.
Triage Interface
Inside the triage view, you can compare the baseline and current screenshots using:
- Interactive Comparison Slider: Click and drag the vertical slider left and right to inspect precise pixel changes.
- Side-by-Side View: Compare the baseline and current screenshots side-by-side (especially useful for layout reflows or structural redesigns).
- AI-Powered Summaries: Read plain-English descriptions of detected regressions in the side panel (collapsible to prevent blocking screenshot details).
- Element Mask Overlay: View selectors configured to be hidden from comparison, showing how they were masked to prevent noise.
Keyboard Shortcuts
Use keyboard shortcuts to quickly navigate and triage multiple changes without taking your hands off the keyboard:
| Key Binding | Action |
|---|---|
| Enter or O or I | Inspect / Toggle open or close the visual comparison modal. |
| B (Hold) | Blink baseline vs. current screenshots rapidly to pinpoint changes. |
| H | Toggle element mask overlay visibility. |
| A or ArrowRight | Approve the visual change and promote current to baseline. |
| R or ArrowLeft | Reject the visual change and keep the current baseline. |
| J or ArrowDown | Navigate to the next regression result. |
| K or ArrowUp | Navigate to the previous regression result. |
| + or = | Zoom in on the screenshot comparison (up to 300%). |
| - | Zoom out on the screenshot comparison. |
| 0 | Reset zoom level to 100%. |
| Esc | Close the comparison triage modal and return to dashboard. |
API Keys & Usage Analytics
Manage your credentials and monitor scan volumes in the lower dashboard section.
Manage API Keys
Generate multiple API keys (e.g. sk_live_...) for separate CI pipelines, staging systems, or development environments. Keys can be toggled visible, copied, or deleted at any time.
Plan Limits & Comparison Usage
The progress bar displays your current comparison and summary usage against your pricing plan tier. Pricing tiers enforce the following limits:
- Early Adopter (free): 500 screenshot comparisons and 50 regressionbot summaries (bot summary limit) (expires after 7 days).
- Hobby: 2,000 screenshot comparisons and 100 regressionbot summaries (bot summary limit) ($9/mo).
- Starter: 5,000 screenshot comparisons and 1,000 regressionbot summaries (bot summary limit) ($29/mo).
- Pro: 15,000 screenshot comparisons and 2,500 regressionbot summaries (bot summary limit) ($79/mo).
Hard vs. Soft Capping:
- Screenshot Comparisons Limit: This is a hard limit. Once your monthly comparisons are exhausted, subsequent visual regression jobs will be blocked and return a usage limit error.
- Bot Summary Limit: This is a soft limit. Once your monthly regressionbot summaries allocation is exhausted, your visual regression jobs will still run and complete successfully, but generating regressionbot summaries will be bypassed (the
regressionbotSummaryfield will be omitted).
Usage Analytics
The stacked bar chart tracks daily scan volumes for the last 30 days, segmented by the API key labels you created. This helps isolate which pipeline or team is consuming your monthly allocation.