Skip to content

Document AI agent skill-usage telemetry#1229

Merged
IEvangelist merged 3 commits into
release/13.5from
dapine/agent-telemetry-docs
Jul 6, 2026
Merged

Document AI agent skill-usage telemetry#1229
IEvangelist merged 3 commits into
release/13.5from
dapine/agent-telemetry-docs

Conversation

@IEvangelist

@IEvangelist IEvangelist commented Jun 8, 2026

Copy link
Copy Markdown
Member

Summary

Extends the Microsoft-collected CLI telemetry reference page to document the AI agent skill-usage telemetry installed by aspire agent init:

  • A new AI agent skill usage section under Scope explaining the PostToolUse hook.
  • The three event types (skill_invocation, tool_invocation, reference_file_read) and the exact low-cardinality fields recorded.
  • The privacy guarantees: only Aspire-owned skill/tool names and skill-relative reference paths are recorded; never absolute paths, repo/user names, file contents, or tool arguments.
  • The opt-out: the single ASPIRE_CLI_TELEMETRY_OPTOUT switch disables all CLI telemetry, including AI agent skill usage.

English source only; translations are handled by the localization workflow.

The implementation shipped in microsoft/aspire#18009 (merged to main, Aspire 13.5); the canonical hook scripts live in microsoft/aspire-skills#30. This doc has been verified against the merged behavior — the documented event types and recorded fields match the tags the shipped aspire agent telemetry command emits.

Part of microsoft/aspire#18008

@aspire-repo-bot

Copy link
Copy Markdown
Contributor

Frontend HTML artifact ready

The latest frontend build uploaded the frontend-dist artifact for PR #1229. Use the VS Code button below to open this PR with GitHub Artifacts Explorer and browse the built HTML locally.

VS Code: Open PR #1229 artifacts

This comment updates automatically when a new frontend build artifact is uploaded.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the Aspire CLI telemetry reference documentation to include the new AI agent skill-usage telemetry that’s emitted via the aspire agent init-installed PostToolUse hook and recorded through the existing CLI telemetry pipeline.

Changes:

  • Adds an “AI agent skill usage” subsection under Scope describing how the PostToolUse hook forwards usage events to aspire agent telemetry.
  • Adds a new Data points entry (v13.5) and a dedicated section documenting the three event types and the low-cardinality fields recorded.
  • Documents privacy guarantees and clarifies that ASPIRE_CLI_TELEMETRY_OPTOUT disables this telemetry as well.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread src/frontend/src/content/docs/reference/cli/microsoft-collected-cli-telemetry.mdx Outdated
Comment thread src/frontend/src/content/docs/reference/cli/microsoft-collected-cli-telemetry.mdx Outdated

@alistairmatthews alistairmatthews left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please apply my suggestion. Otherwise, good to go.

Comment thread src/frontend/src/content/docs/reference/cli/microsoft-collected-cli-telemetry.mdx Outdated
@IEvangelist
IEvangelist changed the base branch from main to release/13.5 July 6, 2026 11:37
IEvangelist and others added 3 commits July 6, 2026 06:41
Extend the Microsoft-collected CLI telemetry page to cover the agent telemetry
hooks installed by 'aspire agent init': the three event types
(skill_invocation, tool_invocation, reference_file_read), the exact
low-cardinality fields recorded, the privacy guarantees (only Aspire-owned
skill/tool names and skill-relative reference paths; never absolute paths, repo
or user names, file contents, or tool arguments), and the
ASPIRE_CLI_AGENT_TELEMETRY_OPTOUT / --no-telemetry-hooks opt-out paths.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Remove the AI-only opt-out section (ASPIRE_CLI_AGENT_TELEMETRY_OPTOUT) and the
'aspire agent init --no-telemetry-hooks' note. The single
ASPIRE_CLI_TELEMETRY_OPTOUT switch disables all CLI telemetry including AI
agent skill usage. Soften the over-claimed opt-out re-check wording.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Alistair Matthews <alistairwebdojo@live.com>
@IEvangelist
IEvangelist force-pushed the dapine/agent-telemetry-docs branch from a761286 to bbc5fc8 Compare July 6, 2026 11:41
@IEvangelist
IEvangelist merged commit 55c420e into release/13.5 Jul 6, 2026
10 checks passed
@IEvangelist
IEvangelist deleted the dapine/agent-telemetry-docs branch July 6, 2026 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants