Skip to content

[Perf] Use direct FLCE weight-gradient accumulation for FP16, BF16, and FP32 - #1324

Open
Anubhav-2003 wants to merge 1 commit into
linkedin:mainfrom
Anubhav-2003:Anubhav-2003/fix-flce-bf16-grad-weight-oom
Open

[Perf] Use direct FLCE weight-gradient accumulation for FP16, BF16, and FP32#1324
Anubhav-2003 wants to merge 1 commit into
linkedin:mainfrom
Anubhav-2003:Anubhav-2003/fix-flce-bf16-grad-weight-oom

perf: directly accumulate FLCE grad_weight across dtypes

9fe6f57
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs