perf(gemma4): GPU-side PLE pre-pass dequant for batched prefill (#247 item 1)#256

Merged

pekkah merged 3 commits into

claude/gemma4-prefill-optimization-h7syay

Jun 15, 2026

Commits on Jun 15, 2026

perf(gemma4): GPU-side PLE pre-pass dequant for batched prefill (#247 item 1)

pekkah
and
claude
committed
test(gemma4): cover int8 -128 in dequant-rows test; note int-safe gather bound

pekkah
and
claude
committed
review(gemma4): guard UploadRawInto empty span; alloc-free Half bits in test

pekkah
and
claude
committed