fix(smoke): target ADO agent-definitions repo for PR/git-write smokes#1045
Conversation
The pipeline YAML for the daily safe-output smoke suite lives in
GitHub (githubnext/ado-aw), so repository: "self" in the
PR-targeting smoke prompts resolves to the GitHub source repo at
runtime. Stage 3 safe-output executors then call the ADO Git REST
APIs against a name that doesn't exist on the ADO side, 404-ing
every PR / git-write smoke before any prereq can help.
Fix the 7 affected fixtures:
add-pr-comment, reply-to-pr-comment, resolve-pr-thread,
submit-pr-review, update-pr, create-branch, create-git-tag
For each:
- declare ADO repo resource via repos: [agent-definitions=agent-definitions]
- whitelist the alias in the per-tool allowed-repositories: list
- change prompt parameter from repository: "self"
to repository: "agent-definitions"
Recompile lock files. Document the limitation + the new ADO-repo
targeting convention in tests/safe-outputs/REGISTERED.md.
create-pull-request remains untouched (needs a separate redesign
that synthesises a working-tree commit inside the ADO repo); the
README flag and table note explain the limitation.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
31064e7 to
08dd58c
Compare
🔍 Rust PR ReviewSummary: Fix is correct and consistently applied — this approach is sound. Findings✅ What Looks Good
|
Problem
The daily safe-output smoke suite is registered as Azure DevOps pipelines in
msazuresphere/AgentPlayground, but the pipeline YAML lives in GitHub (githubnext/ado-aw). For PR / git-write smokes,repository: "self"in the agent prompt resolves to$(Build.Repository.Name)at runtime, which is the GitHub repo. Stage 3 then calls the ADO Git REST APIs against a name that does not exist on the ADO side, so every PR-targeting smoke 404s before any variable-group / perma-PR prereq can help.Fix
Update the 7 affected smoke fixtures so they explicitly target the AgentPlayground ADO repo
agent-definitions:add-pr-comment,reply-to-pr-comment,resolve-pr-thread,submit-pr-review,update-prcreate-branch,create-git-tagFor each fixture:
repos: [agent-definitions=agent-definitions]allowed-repositories:listrepository: "self"torepository: "agent-definitions"Lock files are regenerated to include the
agent-definitionsrepo resource and a matching- checkout: agent-definitionsstep.Documentation
tests/safe-outputs/REGISTERED.mdnow has an ADO repo targeting section explaining the convention, plus per-row notes calling out which fixtures targetagent-definitions.Follow-up
create-pull-request.mdis not included here. It needs a separate redesign that synthesises a working-tree commit inside the ADO repo (the current prompt assumesself's working tree contains an editable file). The README and table flag it as not yet exercised against AgentPlayground.Why this is unblocking
The variable group
ado-aw-daily-smokeand the perma-PR / perma-thread inagent-definitionsare now meaningful: they target a repo that Stage 3 can actually reach. Without this PR, those prereqs would be wired against a repo Stage 3 cannot see.Compiled with
ado-aw v0.36.0 --force(inside the ado-aw source checkout).