feat(desktop): add Pocket voice settings by johnmatthewtennant · Pull Request #3208 · block/buzz

johnmatthewtennant · 2026-07-27T20:52:57Z

Context

Pocket TTS can read live agent replies during a huddle, but Buzz does not provide an installation-wide way to turn that behavior off or choose among the bundled voices. The setting also needs a stable voice identity boundary that future backends and per-agent preferences can reuse without treating a display label as identity.

Summary

This adds a compact Pocket TTS voice settings surface with an Agent text to speech toggle, preview playback, and 12 bundled voices. Text to speech remains enabled by default with Mary selected. Disabling it immediately cancels queued and in-flight agent speech.

Changes

Adds a versioned, device-local TTS settings schema and backend-qualified voice keys.
Bundles Anna, Azelma, Charles, Eponine, Eve, Fantine, George, Jane, Mary, Michael, Paul, and Vera with provenance and deterministic Mary fallback behavior.
Adds voice selection and preview controls while preserving the saved voice when text to speech is disabled.
Labels the visible and accessible selector as Pocket TTS voice.
Speaks only new live agent-authored text in active huddles, including kind 40002 agent replies, while excluding history, people, reactions, edits, system or tool rows, and attachment-only content.
Keeps agent speech strictly live-only across reconnects. The limit: 0 subscription cannot page missed history or reorder replay against new live events.
Removes the unused speakableAgentText wrapper and replaces stale replay-override coverage with a live-only no-paging assertion.
Cancels stale, queued, and in-flight speech on barge-in, shutdown, or voice changes without appending stale audio.
Adds content-free route diagnostics, focused Rust and frontend coverage, and a Playwright screenshot flow.
Groups huddle audio settings into a cohesive state boundary and extracts relay timing constants so both existing files remain below their strict file-size ratchets.

Related issue

None found.

Testing

Manual validation in the combined daily-driver build confirmed all 12 bundled voice previews, one-time playback of a new live agent response through the selected output, and cancellation of stale audio after a voice change.

Screenshots

The global toggle, Pocket voice selector, and Preview action share one compact Voice settings surface.

A focused screenshot was captured at desktop/test-results/voice-settings/pocket-voices.png (SHA-256 a430ce71e7093612a0e9d27ebd3c6e43b2fa02b081c28376d8292e50f45d0a8b). It is intentionally not posted.

Reviewer-reproducible examples

Exercise the bundled selector and live-only subscription contract from a fresh checkout:

. ./bin/activate-hermit
cd desktop
pnpm build:e2e
pnpm exec playwright test tests/e2e/voice-settings.spec.ts --project=smoke
node --import ./test-loader.mjs --experimental-strip-types --test \
  src/features/huddle/lib/ttsLiveMessages.test.mjs \
  src/shared/api/relayReconnectReplay.test.mjs \
  src/shared/api/relayChannelFilters.test.mjs \
  src/features/settings/ui/voiceSettingsLogic.test.mjs

The selector renders 12 bundled voices under the accessible Pocket TTS voice label. The agent-speech subscription remains limit: 0 and never requests missed-history paging.

Signed-off-by: John Tennant <johnmatthewtennant@gmail.com> Signed-off-by: John Tennant <jtennant@block.xyz> Signed-off-by: John Tennant <jtennant@squareup.com>

Signed-off-by: John Tennant <jtennant@squareup.com>

johnmatthewtennant · 2026-07-30T00:59:15Z

🤖 ### Pocket TTS voice settings

The global text-to-speech toggle, bundled Pocket voice selector, and Preview action share one compact Voice settings surface.

Resolve the huddle pipeline by preserving the Pocket voice startup reconciliation and the base STT egress guard. Resolve the relay session by retaining the PR timing-module imports while taking the base reconnect waiter behavior, without restoring the superseded inline timing constants. Co-authored-by: npub1mprnacetjua2xx3p5eddmhxyk6wv929ymm5py8kd2xfxurxahspqqlgyta <d8473ee32b973aa31a21a65adddcc4b69cc2a8a4dee8121ecd51926e0cddbc02@buzz.block.builderlab.xyz> Signed-off-by: npub1mprnacetjua2xx3p5eddmhxyk6wv929ymm5py8kd2xfxurxahspqqlgyta <d8473ee32b973aa31a21a65adddcc4b69cc2a8a4dee8121ecd51926e0cddbc02@buzz.block.builderlab.xyz>

Co-authored-by: npub1t2tgm7d8f995uqvmnm8h88sg3wnpp9a5xysjf6dg3tjmgt3ltulqdp8ehr <5a968df9a7494b4e019b9ecf739e088ba61097b4312124e9a88ae5b42e3f5f3e@buzz.block.builderlab.xyz> Signed-off-by: npub1t2tgm7d8f995uqvmnm8h88sg3wnpp9a5xysjf6dg3tjmgt3ltulqdp8ehr <5a968df9a7494b4e019b9ecf739e088ba61097b4312124e9a88ae5b42e3f5f3e@buzz.block.builderlab.xyz>

…ttings (relands #2467 + #3208) (#3910) Relands **#2467** (extract `buzz-voice` crate) and **#3208** (Pocket voice settings) onto main, after #3266 and #3180 merged. ## Why a fresh PR The repo is squash-only with delete-branch-on-merge. Squashing #3266 deleted `jtennant/pocket-tts-2026-04`, which was #2467's base — GitHub auto-closed #2467 and it cannot be reopened. Squash merges also sever ancestry, so GitHub's natural merge-base reports phantom conflicts for the whole remaining stack. ## Content provenance - Byte-identical to the blessed `jt/buzz-voice-refactor` branch (`93029c577`, tree `6729e0eff` — reviewed by Dawn (#2467) and Max (#3208) at exact heads) **except** the three files where #3180 and #3208 genuinely interact. - Three-file resolution (union of both sides): - `huddle/mod.rs` — #3180's pipeline re-exports + #3208's `agent_tts_routing` imports. - `huddle/state.rs` — `reset_preserving_generation` preserves both `huddle_generation` (#3180) and `tts_enabled` (#3208); test sets merged into one `tests` module. - `desktop/src/testing/e2eBridge.ts` — both switch arms kept; no duplicate case labels. ## Verification at cf32dac - `cargo test` (desktop/src-tauri, pinned 1.95.0): **2047 + 3 pass / 0 fail** (14 ignored: 8 keychain, 4 real_relay, 2 flag-gated) - `cargo clippy --all-targets -- -D warnings`: clean; `cargo fmt --check`: clean - `cargo check --workspace` (root, includes new `buzz-voice` member): clean; `cargo test -p buzz-voice`: 5/0 - `pnpm test`: **3885 / 0**; `tsc --noEmit`: clean; lint: clean The 3180×3208 interaction resolution is getting an independent team re-review before merge. Buzz channel: buzz-desktop-voice `fd5fb402-b651-4238-89b1-bb3e2fa4dc96`, thread `b4798ecc`. Signed-off-by: npub1qyvc0c5kl4gqv2fd97fsk46tu378sqgy35vc83rvgfwne90sel7s0ed67d <011987e296fd5006292d2f930b574be47c7801048d1983c46c425d3c95f0cffd@buzz.block.builderlab.xyz> Co-authored-by: npub1qyvc0c5kl4gqv2fd97fsk46tu378sqgy35vc83rvgfwne90sel7s0ed67d <011987e296fd5006292d2f930b574be47c7801048d1983c46c425d3c95f0cffd@buzz.block.builderlab.xyz>

Restack after #3910 relanded #2467+#3208 onto main. Logical-base merge (base 6186fc2, rerere disabled); tree matches the pre-verified merge-tree prediction 799cc15. Co-authored-by: npub1qyvc0c5kl4gqv2fd97fsk46tu378sqgy35vc83rvgfwne90sel7s0ed67d <011987e296fd5006292d2f930b574be47c7801048d1983c46c425d3c95f0cffd@buzz.block.builderlab.xyz> Signed-off-by: npub1qyvc0c5kl4gqv2fd97fsk46tu378sqgy35vc83rvgfwne90sel7s0ed67d <011987e296fd5006292d2f930b574be47c7801048d1983c46c425d3c95f0cffd@buzz.block.builderlab.xyz>

…evert-fix * origin/main: fix(desktop): open profiles from avatars (#3751) refactor(voice): extract reusable Pocket primitives + Pocket voice settings (relands #2467 + #3208) (#3910) docs: add VISION_REMOTE_AGENTS.md (#3924) feat(desktop): auto-enable huddle transcription for agents (#3180) feat(agent): optional reply guard reminds a silent turn to publish (#3763) feat(desktop): upgrade Pocket TTS model (#3266) feat(desktop): delete a message by clearing its edit to empty (#3813) feat(relay): raise hosted community limit to five (#3829) feat(desktop): locally stored NIP-49 encrypted key backup (#2937) fix(catalog): update Amp tagline (#3806) fix(desktop): channel topic and membership metadata cleanup (#3642) fix(desktop): align data deletion labels (#2230) fix(relay): align NIP-11 max_limit with REQ ceiling (#3635) Signed-off-by: npub1mn7jgtj4w2pd0g0zeuhxsa6jy6p0rewxz4kujt98my82ahfmp72sxjexk7 <dcfd242e557282d7a1e2cf2e6877522682f1e5c6156dc92ca7d90eaedd3b0f95@buzz.block.builderlab.xyz>

…chive * origin/main: (25 commits) feat(desktop): import local Pocket voices (#3259) fix(desktop): open profiles from avatars (#3751) refactor(voice): extract reusable Pocket primitives + Pocket voice settings (relands #2467 + #3208) (#3910) docs: add VISION_REMOTE_AGENTS.md (#3924) feat(desktop): auto-enable huddle transcription for agents (#3180) feat(agent): optional reply guard reminds a silent turn to publish (#3763) feat(desktop): upgrade Pocket TTS model (#3266) feat(desktop): delete a message by clearing its edit to empty (#3813) feat(relay): raise hosted community limit to five (#3829) feat(desktop): locally stored NIP-49 encrypted key backup (#2937) fix(catalog): update Amp tagline (#3806) fix(desktop): channel topic and membership metadata cleanup (#3642) fix(desktop): align data deletion labels (#2230) fix(relay): align NIP-11 max_limit with REQ ceiling (#3635) fix(desktop): allow linux-only media items as dead code off-linux (#3811) fix(desktop): report authenticated relay recovery (#3812) fix(desktop): don't gate hover affordances on the hover media query (#3657) feat(relay): gate kind 30178 team-catalog reads behind the shared tag (#3358) test(desktop): click visible thread collapse guide (#3800) feat(desktop): raise the install ceiling and make installs observable (#3368) ... Co-authored-by: Will Pfleger <pfleger.will@gmail.com> Signed-off-by: Will Pfleger <pfleger.will@gmail.com> # Conflicts: # desktop/src/testing/e2eBridge.ts # desktop/tests/helpers/bridge.ts

…-style * origin/main: (22 commits) feat(desktop): import local Pocket voices (block#3259) fix(desktop): open profiles from avatars (block#3751) refactor(voice): extract reusable Pocket primitives + Pocket voice settings (relands block#2467 + block#3208) (block#3910) docs: add VISION_REMOTE_AGENTS.md (block#3924) feat(desktop): auto-enable huddle transcription for agents (block#3180) feat(agent): optional reply guard reminds a silent turn to publish (block#3763) feat(desktop): upgrade Pocket TTS model (block#3266) feat(desktop): delete a message by clearing its edit to empty (block#3813) feat(relay): raise hosted community limit to five (block#3829) feat(desktop): locally stored NIP-49 encrypted key backup (block#2937) fix(catalog): update Amp tagline (block#3806) fix(desktop): channel topic and membership metadata cleanup (block#3642) fix(desktop): align data deletion labels (block#2230) fix(relay): align NIP-11 max_limit with REQ ceiling (block#3635) fix(desktop): allow linux-only media items as dead code off-linux (block#3811) fix(desktop): report authenticated relay recovery (block#3812) fix(desktop): don't gate hover affordances on the hover media query (block#3657) feat(relay): gate kind 30178 team-catalog reads behind the shared tag (block#3358) test(desktop): click visible thread collapse guide (block#3800) feat(desktop): raise the install ceiling and make installs observable (block#3368) ... Amp-Thread-ID: https://ampcode.com/threads/T-019fb8e1-6ece-72a7-8808-9b12e0f7e833 Co-authored-by: Amp <amp@ampcode.com> Signed-off-by: Joah Gerstenberg <joah@squareup.com> # Conflicts: # desktop/src-tauri/src/linux_media.rs # desktop/src/app/AppShell.tsx

…-setting * origin/main: feat(desktop): import local Pocket voices (#3259) fix(desktop): open profiles from avatars (#3751) refactor(voice): extract reusable Pocket primitives + Pocket voice settings (relands #2467 + #3208) (#3910) docs: add VISION_REMOTE_AGENTS.md (#3924) feat(desktop): auto-enable huddle transcription for agents (#3180) feat(agent): optional reply guard reminds a silent turn to publish (#3763) feat(desktop): upgrade Pocket TTS model (#3266) Signed-off-by: npub1223z34hd7vtwc6qj4s7flsxkj644nlre2nthu7lrrmkumhu3xddsrx9r6w <52a228d6edf316ec6812ac3c9fc0d696ab59fc7954d77e7be31eedcddf91335b@buzz.block.builderlab.xyz> Co-authored-by: Taylor Ho <taylorkmho@gmail.com> Signed-off-by: Taylor Ho <taylorkmho@gmail.com>

…-phase2-integration * origin/main: (38 commits) fix(release): preserve main in desktop PR body (#3979) chore(release): release Buzz Desktop version 0.5.3 (#3972) fix(release): require exact-head approval for desktop tags (#3973) fix(release): make desktop tagging squash-safe (#3965) Revert "chore(release): release Buzz Desktop version 0.5.3" (#3960) docs(nips): add single-coordinate manual-unread override layer and verification model to NIP-RS (#2864) chore(release): release Buzz Desktop version 0.5.3 fix(release): make immutable desktop release operable (#3943) feat(desktop): import local Pocket voices (#3259) fix(desktop): open profiles from avatars (#3751) refactor(voice): extract reusable Pocket primitives + Pocket voice settings (relands #2467 + #3208) (#3910) docs: add VISION_REMOTE_AGENTS.md (#3924) feat(desktop): auto-enable huddle transcription for agents (#3180) feat(agent): optional reply guard reminds a silent turn to publish (#3763) feat(desktop): upgrade Pocket TTS model (#3266) feat(desktop): delete a message by clearing its edit to empty (#3813) feat(relay): raise hosted community limit to five (#3829) feat(desktop): locally stored NIP-49 encrypted key backup (#2937) fix(catalog): update Amp tagline (#3806) fix(desktop): channel topic and membership metadata cleanup (#3642) ... Signed-off-by: npub1g8493u0xfsjrvflg4n08ezd7vec99mnwzlv0qgwpr9d7gvjwhuzqx59rhw <41ea58f1e64c243627e8acde7c89be667052ee6e17d8f021c1195be4324ebf04@buzz.block.builderlab.xyz>

…el-label-registry-sync * origin/main: (39 commits) feat(relay): accept kind:30621 multi-repo projects at ingest (#3171) fix(release): preserve main in desktop PR body (#3979) chore(release): release Buzz Desktop version 0.5.3 (#3972) fix(release): require exact-head approval for desktop tags (#3973) fix(release): make desktop tagging squash-safe (#3965) Revert "chore(release): release Buzz Desktop version 0.5.3" (#3960) docs(nips): add single-coordinate manual-unread override layer and verification model to NIP-RS (#2864) chore(release): release Buzz Desktop version 0.5.3 fix(release): make immutable desktop release operable (#3943) feat(desktop): import local Pocket voices (#3259) fix(desktop): open profiles from avatars (#3751) refactor(voice): extract reusable Pocket primitives + Pocket voice settings (relands #2467 + #3208) (#3910) docs: add VISION_REMOTE_AGENTS.md (#3924) feat(desktop): auto-enable huddle transcription for agents (#3180) feat(agent): optional reply guard reminds a silent turn to publish (#3763) feat(desktop): upgrade Pocket TTS model (#3266) feat(desktop): delete a message by clearing its edit to empty (#3813) feat(relay): raise hosted community limit to five (#3829) feat(desktop): locally stored NIP-49 encrypted key backup (#2937) fix(catalog): update Amp tagline (#3806) ... Signed-off-by: npub1mn7jgtj4w2pd0g0zeuhxsa6jy6p0rewxz4kujt98my82ahfmp72sxjexk7 <dcfd242e557282d7a1e2cf2e6877522682f1e5c6156dc92ca7d90eaedd3b0f95@buzz.block.builderlab.xyz>

* origin/main: fix(release): make immutable desktop release operable (#3943) feat(desktop): import local Pocket voices (#3259) fix(desktop): open profiles from avatars (#3751) refactor(voice): extract reusable Pocket primitives + Pocket voice settings (relands #2467 + #3208) (#3910) docs: add VISION_REMOTE_AGENTS.md (#3924) feat(desktop): auto-enable huddle transcription for agents (#3180) feat(agent): optional reply guard reminds a silent turn to publish (#3763) feat(desktop): upgrade Pocket TTS model (#3266) feat(desktop): delete a message by clearing its edit to empty (#3813) feat(relay): raise hosted community limit to five (#3829) feat(desktop): locally stored NIP-49 encrypted key backup (#2937) Signed-off-by: npub12wpjffj7q5qjsky5jvk4ldwlxmse5xll3d8gytk4wqd0c5y7jvwspg37n6 <538324a65e0501285894932d5fb5df36e19a1bff8b4e822ed5701afc509e931d@buzz.block.builderlab.xyz> Co-authored-by: Tom Brow <tomb@block.xyz> Signed-off-by: Tom Brow <tomb@block.xyz>

johnmatthewtennant force-pushed the jtennant/pocket-tts-settings-v1 branch from df8cad5 to a741f1a Compare July 27, 2026 23:41

johnmatthewtennant changed the base branch from main to jt/buzz-voice-refactor July 27, 2026 23:41

johnmatthewtennant force-pushed the jt/buzz-voice-refactor branch from 8ac609c to c9dfe50 Compare July 28, 2026 00:29

johnmatthewtennant force-pushed the jtennant/pocket-tts-settings-v1 branch 2 times, most recently from 4891a92 to c118f5a Compare July 28, 2026 04:48

johnmatthewtennant force-pushed the jt/buzz-voice-refactor branch 5 times, most recently from be4adc9 to 617e0d2 Compare July 28, 2026 21:40

johnmatthewtennant force-pushed the jtennant/pocket-tts-settings-v1 branch from 7e5cc4b to 7cc0804 Compare July 28, 2026 21:48

johnmatthewtennant force-pushed the jt/buzz-voice-refactor branch from 617e0d2 to 388cf0c Compare July 29, 2026 00:13

johnmatthewtennant force-pushed the jtennant/pocket-tts-settings-v1 branch from 7cc0804 to acb302e Compare July 29, 2026 00:24

johnmatthewtennant force-pushed the jt/buzz-voice-refactor branch from 388cf0c to ace19c6 Compare July 29, 2026 16:15

johnmatthewtennant and others added 13 commits July 29, 2026 12:20

feat(desktop): add Pocket voice settings

fc61d30

Signed-off-by: John Tennant <johnmatthewtennant@gmail.com> Signed-off-by: John Tennant <jtennant@block.xyz> Signed-off-by: John Tennant <jtennant@squareup.com>

fix(desktop): persist mocked voice settings

5e70797

Signed-off-by: John Tennant <jtennant@squareup.com>

fix(desktop): serialize Pocket voice transitions

68d9c37

Signed-off-by: John Tennant <jtennant@squareup.com>

refactor(desktop): split Pocket voice transitions

648b135

Signed-off-by: John Tennant <jtennant@squareup.com>

Cancel in-flight Pocket synthesis

c3e03bb

Signed-off-by: John Tennant <jtennant@squareup.com>

Preserve ordered huddle TTS reconnect replay

ed87750

Signed-off-by: John Tennant <jtennant@squareup.com>

Fix first-event reconnect replay baseline

145e051

Signed-off-by: John Tennant <jtennant@squareup.com>

Test agent TTS routing in settings layer

c08885c

Signed-off-by: John Tennant <jtennant@squareup.com>

feat(desktop): complete Pocket voice settings

a20a671

Signed-off-by: John Tennant <jtennant@squareup.com>

fix(desktop): preserve TTS route outcomes

18fec8c

Signed-off-by: John Tennant <jtennant@squareup.com>

fix(desktop): group TTS worker controls

8d31bf7

Signed-off-by: John Tennant <jtennant@squareup.com>

refactor(desktop): satisfy file size ratchets

8a25584

Signed-off-by: John Tennant <jtennant@squareup.com>

fix(desktop): keep agent speech live-only

6186fc2

Signed-off-by: John Tennant <jtennant@squareup.com>

johnmatthewtennant force-pushed the jtennant/pocket-tts-settings-v1 branch from ea833b1 to 6186fc2 Compare July 29, 2026 16:37

johnmatthewtennant marked this pull request as ready for review July 29, 2026 19:21

johnmatthewtennant requested a review from a team as a code owner July 29, 2026 19:21

johnmatthewtennant added triage-ready Appropriate for agentic review and removed triage-ready Appropriate for agentic review labels Jul 29, 2026

johnmatthewtennant added a commit that referenced this pull request Jul 30, 2026

screenshots: PR #3208

95b5c75

tlongwell-block merged commit 93029c5 into jt/buzz-voice-refactor Jul 31, 2026
25 checks passed

tlongwell-block deleted the jtennant/pocket-tts-settings-v1 branch July 31, 2026 11:07

tlongwell-block mentioned this pull request Jul 31, 2026

refactor(voice): extract reusable Pocket primitives + Pocket voice settings (relands #2467 + #3208) #3910

Merged

adrienlacombe mentioned this pull request Jul 31, 2026

[upstream-sync] Sync upstream block/buzz → 2026-07-31 (23 commits) adrienlacombe/buzz#9

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat(desktop): add Pocket voice settings - #3208

feat(desktop): add Pocket voice settings#3208
tlongwell-block merged 14 commits into
jt/buzz-voice-refactorfrom
jtennant/pocket-tts-settings-v1

johnmatthewtennant commented Jul 27, 2026 •

edited

Loading

Uh oh!

johnmatthewtennant commented Jul 30, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

johnmatthewtennant commented Jul 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Context

Summary

Changes

Related issue

Testing

Screenshots

Reviewer-reproducible examples

Uh oh!

johnmatthewtennant commented Jul 30, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

johnmatthewtennant commented Jul 27, 2026 •

edited

Loading