Skip to content

From NVIDIA Megatron-LM for visibility#18

Open
RaymondLi0 wants to merge 6315 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 6315 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0
Copy link
Collaborator

@RaymondLi0 RaymondLi0 commented Jan 24, 2023

No description provided.

@RaymondLi0 RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0 RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
nschank and others added 28 commits January 23, 2026 02:08
@nschank @yashaswikarnati
Support custom Router implementations in MoELayer (#2891)
7857383 
Co-authored-by: Yashaswi Karnati <144376261+yashaswikarnati@users.noreply.github.com>
@shanmugamr1992
Supporting inference when called within an asyncio loop (#2816)
0136876
@JavaZeroo @yaox12 @Skylion007
Update type hints and doc strings for moe_utils.py (#2821)
03e0915 
Co-authored-by: Xin Yao <yaox12@outlook.com>
Co-authored-by: Aaron Gokaslan <aaronGokaslan@gmail.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
@HaochenYuan @Phlip79
Remove calculation of padding token in moe routing loss (#2142)
10c6f01 
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@jon-barker
Bug fix with --no-use-tokenizer-from-checkpoint-args (#3049)
029f48f 
Co-authored-by: Jon Barker <jbarker@oci-hsg-cs-001-vscode-01.cm.cluster>
@thomasdhc
Revert "Bug fix with --no-use-tokenizer-from-checkpoint-args (#3049)" (…
0683679 
…#3057)

Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
@santhnm2
Add health endpoint to dynamic text gen server (#3009)
93567e8 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
3593301
@thomasdhc
ci: Skip test_precision_aware_optimizer (#3062)
30dea5d 
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
@yaoyu-33 @shifangx
Support multimodule communication (#2031)
485ed18 
Co-authored-by: shifangx <shifangx@nvidia.com>
Co-authored-by: Mcore Bot <mcore-bot@nvidia.com>
@ko3n1g
Revert "Support multimodule communication (#2031)" (#3068)
0972f02
@ko3n1g
Revert "Remove calculation of padding token in moe routing loss (#2142)…
4cfaa7d 
…" (#3069)
@deepakn94
Add ability to save wgrads and dgrads (#3032)
dbde759 
Signed-off-by: Deepak Narayanan <dnarayanan@nvidia.com>
@chtruong814
ci: Mark test_mode_partial_cudagraph unit tests as flaky (#3064)
55fe705 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@deepakn94
Keep FSDP's and DDP's finish_grad_sync API identical (#3070)
3a7d74d 
Signed-off-by: Deepak Narayanan <dnarayanan@nvidia.com>
@jon-barker @chtruong814
(REPLAY) Bug fix with --no-use-tokenizer-from-checkpoint-args (#3059)
389436b 
Co-authored-by: Jon Barker <jbarker@oci-hsg-cs-001-vscode-01.cm.cluster>
Co-authored-by: Charlie Truong <chtruong@nvidia.com>
@sidsingh-nvidia
Optimizing post-processing of requests (#2920)
53a2b19
@sidsingh-nvidia
Fix broken functional tests in #2920 (#3071)
369e0eb
@FDecaYed
fix ep weight gradnorm/num_zero calculation error for muon (#3024)
b2e9390
@maanug-nv
[training migration] Add LoggerConfig dataclass (#2414)
497d42d 
Signed-off-by: Maanu Grover <maanug@nvidia.com>
@hexinw-nvidia
Added --ft-num-warmup-iters option. (#3052)
06d0f46
@jiemingz
Reapply "Various CUDA graph improvements on capture time, replay time…
642fdd9 
…, memory footprint (#2572)" (#3056)

Signed-off-by: Jimmy Zhang <jiemingz@nvidia.com>
@liuyun7345 @shjwudp
fix(fsdp): add CLI argument for outer_dp_sharding_strategy (#3053)
bb42a00 
Co-authored-by: Jianbin Chang <shjwudp@gmail.com>
@ko3n1g
ci: Log node name (#3081)
94d8186 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@jeffnvidia
add all_gather process-group for overlapping in fsdp disributed train…
528cb2e 
…ing (#2663)
@ko3n1g
docs: Release docs (#3055)
23a76d1 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ChenhanYu @jenchen13 @AAnoosheh
Support NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 FP8/NVFP4 PTQ in example (#…
b47c376 
…3079)

Signed-off-by: jenchen13 <jennifchen@nvidia.com>
Signed-off-by: Jennifer Chen <jennifchen@nvidia.com>
Co-authored-by: jenchen13 <jennifchen@nvidia.com>
Co-authored-by: Jenny Chen <jc4686@columbia.edu>
Co-authored-by: Asha Anoosheh <ashaanoosheh1@gmail.com>
@ko3n1g
Reapply "Support multimodule communication (#2031)" (#3068)
35e85a6 
This reverts commit 0972f02.
shanmugamr1992 and others added 20 commits February 13, 2026 21:32
@shanmugamr1992
Fix for rl (#3390)
2611830
@vasunvidia
Add check for full_iteration scope before instantiating CudaGraphMana…
4578ed8 
…ger (#3362)
@megnvidia @Phlip79
Fix broken links throughout (#3230)
698feec 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
Co-authored-by: Philip Petrakian <pgpetrak@gmail.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@sajadn
Extract intermediate embeddings of transformer block (#3060)
d401490 
Signed-off-by: sajadn <snorouzi@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
545bff9
@kunlunl @laixinn
Decouple topk and loss from DSA Indexer (#3248)
b890099 
Co-authored-by: xielaixin <xielx@shanghaitech.edu.cn>
@tdene @ISEEKYAN
@sidsingh-nvidia @ArEsKay3 @ko3n1g
Move to using the Inference OpenAI API server (bis) (#3395)
7a8f305 
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Yan Bai <baiyan1996@icloud.com>
Co-authored-by: Siddharth Singh <sidsingh@nvidia.com>
Co-authored-by: Robert Kirby <rkirby@cw-dfw-cs-001-vscode-01.cm.cluster>
Co-authored-by: Robert Kirby <rkirby@nvidia.com>
Co-authored-by: Robert Kirby <ArEsKay3@users.noreply.github.com>
Co-authored-by: Siddharth Singh <136645615+sidsingh-nvidia@users.noreply.github.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
@santhnm2
Make Mamba inference state memory ratio configurable (#3322)
4beb8ca 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@tdene
Fix configs for RL model environments (#3441)
cbb47c8
@tdene @yobibyte
Replace pickle with json in rl_utils (#3351)
8f1c2f8 
Co-authored-by: yobi byte <yobibyte@users.noreply.github.com>
@dndnda
fix: correct typo in demo training example (#3428)
057c804 
Co-authored-by: liming127 <liming127@meituan.com>
@tdene
Clean up logging inside inference flask server (#3437)
b218e64
@chtruong814
ci: Update release-docs workflow to use FW-CI-templates v0.72.0 (#3438)
3c69780 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@jon-barker @tdene
Fix --tokenizer-hf-include-special-tokens (#3422)
74ef64e 
Co-authored-by: Jon Barker <jbarker@oci-hsg-cs-001-vscode-01.cm.cluster>
Co-authored-by: Teodor-Dumitru Ene <34819528+tdene@users.noreply.github.com>
@tdene
Update num_tokens_to_generate default for Gym (#3453)
267cf1f
@tdene
Fix slowdown in inference flask server (#3445)
0627623
@BestJuly
Add a normalized scale for MTP per token loss (#3159)
a22c40e 
Signed-off-by: lit <lit@nvidia.com>
@BestJuly
[Bugfix] Fix nan loss caused by zero token in MTP (#3396)
d7500d4 
Signed-off-by: lit <lit@nvidia.com>
@ko3n1g
ci: Add testing branches
ad5a627 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@github-actions
chore: rotate oncall schedule
cd71d4c
yobibyte and others added 9 commits February 18, 2026 14:40
@yobibyte
Log RL metrics per environment (#3446)
f1908bc
@tdene @mathemakitten
Move tensor offload/onload out of RL code (#3029)
1106df4 
Co-authored-by: helen ngo <helen.ngo14@gmail.com>
@ArEsKay3
Add Engine event to the follow up requests after checkpointing (#3473)
0672477
@tdene @ArEsKay3
Fix another inference flask / Gym interaction (#3467)
7b016be 
Co-authored-by: Robert Kirby <rkirby@nvidia.com>
@megnvidia
adding in copyright blurb at the top of md file (#3394)
acb7273 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
@shjwudp
[Megatron-FSDP] Add fsdp_all_gather_in_start_param_sync option in DDP…
fdde15e 
… Config (#3095)
@chtruong814
ci: Update release workflow to include changelog and publish docs (#3472
77f22f2 
)

Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@ko3n1g
ci(fix): Weekly GPT tests (#3443)
1666b45 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci: Remove environments (#3462)
0d0943c 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Comments