Summary
Automated smoke test for Claude engine — Run §22821287631 · 2026-03-08
Overall status: PARTIAL (tests #3, #16, #17 skipped/partial)
Core Tests (#1–10)
| # |
Test |
Status |
Notes |
| 1 |
GitHub MCP — last 2 merged PRs |
✅ |
#20020, #20016 |
| 2 |
Safe Inputs GH CLI — list 2 PRs |
✅ |
#20059, #20057 |
| 3 |
Serena MCP — activate + find_symbol (≥3) |
⚠️ |
Activated OK; only 2 symbols found before MCP EOF error |
| 4 |
Make build |
✅ |
go build succeeded |
| 5 |
Playwright — github.com title |
✅ |
Title contains "GitHub" |
| 6 |
Tavily web search |
✅ |
5 results for "GitHub Agentic Workflows" |
| 7 |
File writing |
✅ |
/tmp/gh-aw/agent/smoke-test-claude-22821287631.txt created |
| 8 |
Bash — verify file |
✅ |
cat returned expected content |
| 9 |
Discussion interaction |
✅ |
Discussion #20061 found & comment added |
| 10 |
Agentic Workflows MCP status |
✅ |
smoke-claude: active, compiled, engine=claude |
PR Review Tests (#11–17) — PR #20059
| # |
Test |
Status |
Notes |
| 11 |
Update PR body |
✅ |
Appended test message to PR #20059 |
| 12 |
PR review comments (2) |
✅ |
2 inline comments on check_permissions_utils.cjs |
| 13 |
Submit PR review |
✅ |
COMMENT review submitted |
| 14 |
Resolve review thread |
⚠️ |
Skipped — no existing threads |
| 15 |
Add reviewer |
✅ |
copilot added as reviewer |
| 16 |
Push to PR branch |
⚠️ |
Skipped — on main, not PR branch |
| 17 |
Close PR |
⚠️ |
Skipped — no safe test PR to close |
Details
References:
💥 [THE END] — Illustrated by Smoke Claude · ◷
Summary
Automated smoke test for Claude engine — Run §22821287631 · 2026-03-08
Overall status: PARTIAL (tests #3, #16, #17 skipped/partial)
Core Tests (#1–10)
go buildsucceeded/tmp/gh-aw/agent/smoke-test-claude-22821287631.txtcreatedcatreturned expected contentsmoke-claude: active, compiled, engine=claudePR Review Tests (#11–17) — PR #20059
check_permissions_utils.cjscopilotadded as reviewermain, not PR branchDetails
<slug>and<slug>[bot]match inon.bots#20059 —fix: canonicalize bot identifiers so (slug) and (slug)[bot] match in on.botsReferences: