Add visual regression reference prompt (.github/aw/visual-regression.md) - #18272
Conversation
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
|
@copilot turn into a prompt |
…rence Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Done in d96ebeb. The file is now a proper |
|
@copilot link this file in the agent prompt |
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
|
@copilot make the instructions simpler , more condensed |
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
There was a problem hiding this comment.
Pull request overview
Adds a new reference prompt for visual regression testing workflows, and links it from the workflow-authoring guidance so agents can reuse the pattern when asked about screenshot comparison across PRs.
Changes:
- Added
.github/aw/visual-regression.mdreference prompt describing a Playwright + cache-memory baseline workflow pattern. - Linked the new reference from
.github/aw/create-agentic-workflow.mdat the browser automation hint. - Extended the dispatcher agent documentation to include a “test coverage” routing section.
Reviewed changes
Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| .github/aw/visual-regression.md | Introduces a reference prompt + example frontmatter for screenshot baselines using cache-memory. |
| .github/aw/create-agentic-workflow.md | Adds a pointer to the new visual regression reference prompt for browser-automation use cases. |
| .github/agents/agentic-workflows.agent.md | Documents an additional routing option for test coverage analysis. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| - "date *" | ||
| safe-outputs: | ||
| add-comment: | ||
| max: 1 |
There was a problem hiding this comment.
The example workflow text says to use the noop safe-output when nothing changes, but safe-outputs: only configures add-comment. Add noop: to the safe-outputs config (or remove the instruction to use noop) so the workflow doesn’t fail with “safe output not enabled”.
| max: 1 | |
| max: 1 | |
| noop: {} |
| ### Analyze Test Coverage | ||
| **Load when**: The workflow reads, analyzes, or reports test coverage — whether triggered by a PR, a schedule, or a slash command. Always consult this prompt before designing the coverage data strategy. | ||
|
|
||
| **Prompt file**: https://github.com/github/gh-aw/blob/main/.github/aw/test-coverage.md | ||
|
|
||
| **Use cases**: | ||
| - "Create a workflow that comments coverage on PRs" | ||
| - "Analyze coverage trends over time" | ||
| - "Add a coverage gate that blocks PRs below a threshold" | ||
|
|
There was a problem hiding this comment.
This agent now routes “Analyzing test coverage” to .github/aw/test-coverage.md, but that prompt file doesn’t exist in the repository. Either add the missing .github/aw/test-coverage.md prompt (and ensure it’s linked consistently elsewhere), or remove/adjust this route to point at an existing prompt.
| ### Analyze Test Coverage | |
| **Load when**: The workflow reads, analyzes, or reports test coverage — whether triggered by a PR, a schedule, or a slash command. Always consult this prompt before designing the coverage data strategy. | |
| **Prompt file**: https://github.com/github/gh-aw/blob/main/.github/aw/test-coverage.md | |
| **Use cases**: | |
| - "Create a workflow that comments coverage on PRs" | |
| - "Analyze coverage trends over time" | |
| - "Add a coverage gate that blocks PRs below a threshold" |
.github/aw/visual-regression.mdas a reference prompt demonstrating visual regression testing with playwright + cache-memory.github/aw/agent prompt: simplename:/description:frontmatter, example workflow shown as a code blockvisual-regression.mdin.github/aw/create-agentic-workflow.mdat the playwright browser automation hintvisual-regression.md(144 → 59 lines)Original prompt
🔒 GitHub Advanced Security automatically protects Copilot coding agent pull requests. You can protect all pull requests by enabling Advanced Security for your repositories. Learn more about Advanced Security.