Skip to content

Add QK layernorm support for dot-product attention in MambaModel#4067

Merged
Phlip79 merged 21 commits intoNVIDIA:mainfrom
Phlip79:philip/add-qk-norm
Apr 17, 2026
Merged

Add QK layernorm support for dot-product attention in MambaModel#4067
Phlip79 merged 21 commits intoNVIDIA:mainfrom
Phlip79:philip/add-qk-norm

Commits

Commits on Mar 31, 2026

Commits on Apr 3, 2026

Commits on Apr 7, 2026

Commits on Apr 10, 2026

Commits on Apr 16, 2026

Commits on Apr 17, 2026