Skip to content

batched-bench : fix unified KV cache handling + pp timing#15562

Merged
ggerganov merged 2 commits into
masterfrom
gg/batched-bench-pps
Aug 25, 2025
Merged

batched-bench : fix unified KV cache handling + pp timing#15562
ggerganov merged 2 commits into
masterfrom
gg/batched-bench-pps

cont : run dummy token only with split KV cache

c9c72d5
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.