Multi stage pipeline parallelism support#418

Merged

BlueCrescent merged 27 commits intomainfrom

Jan 23, 2026

Commits on Nov 7, 2025

fix(config): Component factory assert accepts BaseModel field aliases.
BlueCrescent
committed
feat(parallelism): Added first version of multi stage pipeline parallelism support. (WIP)
BlueCrescent
committed

Commits on Nov 19, 2025

chore: Merge remote-tracking branch 'origin/main' into pp_multi_stage
BlueCrescent
committed

Commits on Nov 21, 2025

feat(parallelism): Switched various pp configs to interleaved 1F1B.
BlueCrescent
committed
fix(parallelism): Handling for None block types when fsdp2 wrapping model.
BlueCrescent
committed
fix(parallelism): Deactivated eval before training again due to bug with interleaved 1F1B.
BlueCrescent
committed
refactor: Better name for maybe_list_parameter_wrapper (relevant in stack traces/views).
BlueCrescent
committed
feat: Better error reporting in cuda env tear down.
BlueCrescent
committed
test(parallelism): Multiple updates to warmstart tests.
BlueCrescent
committed
refactor(typing): Removed unused PydanticPytorchModuleNotListType.
BlueCrescent
committed

Commits on Nov 28, 2025

Commits on Dec 2, 2025

Commits on Dec 13, 2025

feat: added foreach and fused options to Adam*OptimizerConfig
le1nux
committed