DeepSpeed/csrc/adagrad
Liran Bachar 69af361167
CPUAdam fp16 and bf16 support (#5409)
Hi.
Please review the following changes
I added support for BF16 to cpu adam. BF16, FP16 and float are supported
at compilation time. the correct template is called at runtime according
to input params dtype.

---------

Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
2024-05-20 12:50:20 +00:00
..
cpu_adagrad.cpp CPUAdam fp16 and bf16 support (#5409) 2024-05-20 12:50:20 +00:00