DeepSpeed/csrc/lion
Liran Bachar 69af361167
CPUAdam fp16 and bf16 support (#5409)
Hi.
Please review the following changes
I added support for BF16 to cpu adam. BF16, FP16 and float are supported
at compilation time. the correct template is called at runtime according
to input params dtype.

---------

Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
2024-05-20 12:50:20 +00:00
..
cpu_lion.cpp CPUAdam fp16 and bf16 support (#5409) 2024-05-20 12:50:20 +00:00
cpu_lion_impl.cpp CPUAdam fp16 and bf16 support (#5409) 2024-05-20 12:50:20 +00:00
fused_lion_frontend.cpp feat: add Lion optimizer (#4331) 2023-10-05 22:32:14 +00:00
multi_tensor_apply.cuh feat: add Lion optimizer (#4331) 2023-10-05 22:32:14 +00:00
multi_tensor_lion.cu feat: add Lion optimizer (#4331) 2023-10-05 22:32:14 +00:00