Skip to content

Fix NaN in scale_by_adam on float16 zero-gradient steps - #1755

Open
kartik1pandey wants to merge 2 commits into
google-deepmind:mainfrom
kartik1pandey:fix-adam-float16-zero-grad-nan
Open

Fix NaN in scale_by_adam on float16 zero-gradient steps#1755
kartik1pandey wants to merge 2 commits into
google-deepmind:mainfrom
kartik1pandey:fix-adam-float16-zero-grad-nan

Extend float16 zero-grad NaN fix to sibling optimizers

619e74c
Select commit
Loading
Failed to load commit list.