Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
337 Open 2,181 Closed
337 Open 2,181 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix typo docs-only documentation only (docs or docstrings)
#4090 opened Apr 1, 2026 by janEbert Loading… Core 0.16
2
add permute fusion into hybrid ep complexity: low
#4089 opened Apr 1, 2026 by Autumn1998 Loading…
5 tasks
2
Refactor BackendSpecProvider to use Protocols to define the types it returns community-request
#4087 opened Apr 1, 2026 by nschank Loading…
2 of 5 tasks
1
Support CP (no sequence packing) community-request
#4086 opened Mar 31, 2026 by ankisinha-nvidia • Draft
5 tasks
2
Add unit test for Mamba EP inference (eager fallback with mixed CUDA graphs)
#4085 opened Mar 31, 2026 by santhnm2 • Draft
5 tasks
Core 0.16
2
Set tensor-parallel attributes irrespective of perform_initialization complexity: low Final Review PR is in the "final review" stage
#4084 opened Mar 31, 2026 by ilml Loading…
5 tasks
Core 0.16
3
Part 1 Run functional tests
#4083 opened Mar 31, 2026 by asolergi-nv • Draft
5 tasks
Core 0.16
4
[DEV] Minor update optimizer
#4082 opened Mar 31, 2026 by skyw Loading…
5 tasks
Core 0.16
2
Add tools/prepare_cache.py for offline GPT dataset cache preparation complexity: medium
#4080 opened Mar 31, 2026 by asolergi-nv Loading…
4 of 5 tasks
Core 0.16
5
Ko3n1g/chore/update nightlies
#4076 opened Mar 31, 2026 by ko3n1g • Draft
5 tasks
Core 0.16
2
Fix THD RoPE offsets for local packed shards community-request Final Review PR is in the "final review" stage
#4075 opened Mar 31, 2026 by kaimo455 Loading…
3 of 5 tasks
Core 0.16
6
Add permute/unpermute fusion with dispatch/combine in Hybrid-EP
#4073 opened Mar 31, 2026 by Autumn1998 Loading…
5 tasks
4
[Dev] Skip routed expert padding for graph-safe MoE complexity: low
#4071 opened Mar 31, 2026 by zhongbozhu Loading…
5 tasks
Core 0.16
4
Fix DSA indexer loss not averaged across micro-batches community-request
#4070 opened Mar 31, 2026 by kaimo455 Loading…
1 of 5 tasks
Core 0.16
4
Add QK layernorm support for dot-product attention in MambaModel complexity: medium
#4067 opened Mar 31, 2026 by Phlip79 Loading…
5 tasks
Core 0.16
17
Enable FP8 DPA for MXFP8 recipe
#4066 opened Mar 30, 2026 by vasunvidia • Draft
5 tasks
2
Align chat completions endpoint with vLLM complexity: medium
#4063 opened Mar 30, 2026 by santhnm2 Loading…
5 tasks
Core 0.16
13
Preserve type of decorated methods/classes community-request Final Review PR is in the "final review" stage
#4062 opened Mar 30, 2026 by nschank Loading…
2 of 5 tasks
13
Enable NullTokenizer for pretraining to reduce I/O access complexity: low Final Review PR is in the "final review" stage Run functional tests
#4057 opened Mar 30, 2026 by asolergi-nv Loading…
5 tasks
Core 0.16
7
Fix forced lag initial conditions
#4056 opened Mar 30, 2026 by tdene • Draft
5 tasks
1
Megatron-FSDP: Fix insufficient double buffers during gradient reduce complexity: low Final Review PR is in the "final review" stage module: megatron-fsdp
#4054 opened Mar 30, 2026 by shjwudp Loading…
5 tasks
@shjwudp
4
Add Dual Chunk Attention (DCA) for long-context training community-request
#4048 opened Mar 29, 2026 by Ternura143 • Draft
5 of 10 tasks
1
3
fix: wait for async P2P send before deallocating output tensor
#4047 opened Mar 28, 2026 by ZhiyuLi-Nvidia • Draft
5 tasks
2
Fix HybridDeviceOptimizer KeyError after mixed-precision param replacement community-request Final Review PR is in the "final review" stage
#4046 opened Mar 28, 2026 by ma-ben Loading…
1
4
Docs: improve docstrings and comments in example training loop community-request
#4041 opened Mar 27, 2026 by DhineshPonnarasan • Draft
1
1
ProTip! Updated in the last three days: updated:>2026-03-29.