Fix meta-init bf16 cast corrupting rotary `inv_freq` under sequence parallelism#1725

Merged

SumanthRH merged 3 commits into

NovaSky-AI:mainfrom

EdisonScientific:fix/meta-init-inv-freq-bf16-cast

May 30, 2026

Commits on May 29, 2026

[fsdp] Keep meta-init from casting rotary inv_freq to bf16 (fixes #1709)

jamesbraza
and
claude
committed
[test] Make the meta-init regression test actually exercise meta-init

jamesbraza
and
claude
committed

Commits on May 30, 2026

[test] Reproduce the actual NaN-under-SP failure, not just the dtype divergence

jamesbraza
and
claude
committed