1 Repositories
Python adamw_bfloat16 Libraries
AdamW optimizer for bfloat16 models in pytorch.
Image source AdamW optimizer for bfloat16 models in pytorch. Bfloat16 is currently an optimal tradeoff between range and relative error for deep netwo
8 Nov 20, 2022