Support batch_size>1 in native MHA decoder, incl. true sub-64 (head_dim>mlen)#55

Merged

booth-algo merged 2 commits into

mainfrom

feat/multibatch-decoder

Jun 2, 2026

Commits on Jun 1, 2026

Support batch_size>1 in non-packed MHA decoder (delegate to kernel)
booth-algo
committed
Support head_dim > mlen in batched MHA kernel (true sub-64 multi-batch)
booth-algo
committed