Gemma 4 E2B text model support#326

Open

Adi2K wants to merge 8 commits intotrymirai:mainfrom

Adi2K:gemma4-clean

Commits on Apr 7, 2026

feat(config): add Gemma 4 decoder and layer config fields
Adi2K
committed
feat(forward-pass): add Gemma 4 buffer sizing, KV sharing, and PLE state
Adi2K
committed
feat(kernels): add head_dim=512 attention variants and PLE element-wise mul
Adi2K
committed
feat(encoder): implement PLE, per-layer scalar, V-norm, and Gemma 4 decoder
Adi2K
committed
feat(traces): add Gemma 4 trace generation script
Adi2K
committed
feat(config): support lalamo PR #197 nested config format
Adi2K
committed
fix(uzu): explicit residual add for PLE/scalar layers, remove excess comments
Adi2K
committed
refactor(uzu): address PR review — restructure PLE, code style, add tests
Adi2K
committed