Skip to content

Support the maximize parameter for adam when dtype is torch.half#35

Merged
a710128 merged 4 commits into
OpenBMB:mainfrom
alphaGem:param-maximize-for-adam
Jul 8, 2022
Merged

Support the maximize parameter for adam when dtype is torch.half#35
a710128 merged 4 commits into
OpenBMB:mainfrom
alphaGem:param-maximize-for-adam

fix grad no view(-1) at float16 in adam_offload

2509746
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs