Skip to content

Comments

chore(triage-issue): Improve triage prompt for accuracy#19454

Merged
s1gr1d merged 5 commits intodevelopfrom
sig/update-skill
Feb 20, 2026
Merged

chore(triage-issue): Improve triage prompt for accuracy#19454
s1gr1d merged 5 commits intodevelopfrom
sig/update-skill

Conversation

@s1gr1d
Copy link
Member

@s1gr1d s1gr1d commented Feb 20, 2026

Improve the prompt to challenge the framing of the issue reporter and consider misconfiguration etc.

Also fix some issues where the agent was trying to write where it was not allowed in CI (e.g. writing to tmp). I added some general prompts directly to the system prompt in the GitHub action (as it's only relevant for CI).

Also allows Bash(npm info *),Bash(npm ls *) to get some general package info.

Closes #19455 (added automatically)

title = _sanitize_title(data.get("title", ""))
state = data.get("state", "")
print(f"#{num} {state} {title}")
print(f"#{num} {title} {state}")
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is just to match the print output of the other function.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026

size-limit report 📦

Path Size % Change Change
@sentry/browser 25.61 kB - -
@sentry/browser - with treeshaking flags 24.12 kB - -
@sentry/browser (incl. Tracing) 42.42 kB - -
@sentry/browser (incl. Tracing, Profiling) 47.08 kB - -
@sentry/browser (incl. Tracing, Replay) 81.24 kB - -
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags 70.86 kB - -
@sentry/browser (incl. Tracing, Replay with Canvas) 85.93 kB - -
@sentry/browser (incl. Tracing, Replay, Feedback) 98.09 kB - -
@sentry/browser (incl. Feedback) 42.33 kB - -
@sentry/browser (incl. sendFeedback) 30.28 kB - -
@sentry/browser (incl. FeedbackAsync) 35.28 kB - -
@sentry/browser (incl. Metrics) 26.78 kB - -
@sentry/browser (incl. Logs) 26.92 kB - -
@sentry/browser (incl. Metrics & Logs) 27.6 kB - -
@sentry/react 27.37 kB - -
@sentry/react (incl. Tracing) 44.76 kB - -
@sentry/vue 30.06 kB - -
@sentry/vue (incl. Tracing) 44.26 kB - -
@sentry/svelte 25.64 kB - -
CDN Bundle 28.16 kB - -
CDN Bundle (incl. Tracing) 43.25 kB - -
CDN Bundle (incl. Logs, Metrics) 29 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) 44.09 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) 68.08 kB - -
CDN Bundle (incl. Tracing, Replay) 80.12 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) 80.99 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) 85.56 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) 86.46 kB - -
CDN Bundle - uncompressed 82.33 kB - -
CDN Bundle (incl. Tracing) - uncompressed 128.05 kB - -
CDN Bundle (incl. Logs, Metrics) - uncompressed 85.17 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) - uncompressed 130.88 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) - uncompressed 208.83 kB - -
CDN Bundle (incl. Tracing, Replay) - uncompressed 244.93 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) - uncompressed 247.75 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed 257.73 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) - uncompressed 260.54 kB - -
@sentry/nextjs (client) 47.17 kB - -
@sentry/sveltekit (client) 42.88 kB - -
@sentry/node-core 52.18 kB +0.02% +8 B 🔺
@sentry/node 166.54 kB +0.01% +6 B 🔺
@sentry/node - without tracing 93.97 kB +0.02% +10 B 🔺
@sentry/aws-serverless 109.47 kB +0.01% +8 B 🔺

View base workflow run

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026

node-overhead report 🧳

Note: This is a synthetic benchmark with a minimal express app and does not necessarily reflect the real-world performance impact in an application.

Scenario Requests/s % of Baseline Prev. Requests/s Change %
GET Baseline 9,080 - 11,689 -22%
GET With Sentry 1,614 18% 1,949 -17%
GET With Sentry (error only) 5,999 66% 7,606 -21%
POST Baseline 1,157 - 1,295 -11%
POST With Sentry 557 48% 617 -10%
POST With Sentry (error only) 1,024 89% 1,098 -7%
MYSQL Baseline 3,288 - 3,497 -6%
MYSQL With Sentry 419 13% 450 -7%
MYSQL With Sentry (error only) 2,645 80% 2,970 -11%

View base workflow run

Comment on lines +69 to +72
Do NOT write to `/tmp/` or any other directory. Only write files (e.g. triage_report.md) inside the workspace (repo root).
Do NOT use Bash redirection (> file)—it is blocked.
Do NOT use `python3 -c` or other inline Python in Bash, only the provided scripts are allowed.
Do NOT attempt to delete (`rm`) temporary files you create.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need this in the action? This should be specified in the skill already no?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I put it here because it's specific to the CI run. Locally, the agent can at least try to do this stuff (as someone can still approve it). But some of it is also mentioned in the skill as well.

@s1gr1d s1gr1d enabled auto-merge (squash) February 20, 2026 12:32
# Conflicts:
#	.claude/skills/triage-issue/SKILL.md
#	.github/workflows/triage-issue.yml
Copy link

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.

```
4. If no Linear linkback found or the script fails, fall back to printing to terminal.
3. Post it to Linear: `python3 .claude/skills/triage-issue/scripts/post_linear_comment.py "JS-XXXX" "triage_report.md"`
4. If no Linear linkback found or the script fails, fall back to adding a GitHub Action Job Summary.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CI fallback to Job Summary is unreachable

Low Severity

The Step 8 fallback was changed from "printing to terminal" to "adding a GitHub Action Job Summary." However, the new CI constraints in triage-issue.yml block both writing outside the workspace ($GITHUB_STEP_SUMMARY lives in a runner temp directory) and bash redirection (>> $GITHUB_STEP_SUMMARY). This makes the Job Summary fallback unreachable in CI, potentially wasting agent turns against the --max-turns 20 limit. The previous fallback of "printing to terminal" always worked.

Additional Locations (1)

Fix in Cursor Fix in Web

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The action has the permission to do that and it was already posting a Job Summary

@s1gr1d s1gr1d merged commit d251b11 into develop Feb 20, 2026
131 of 133 checks passed
@s1gr1d s1gr1d deleted the sig/update-skill branch February 20, 2026 13:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

chore(triage-issue): Improve triage prompt for accuracy

2 participants