DeepSpeed/tests
Reza Yazdani 8e891aa568
Transformer kernel/fix layer norm (#1587)
* fixing the softmax masking when using triangular masking

* fix a bug in the the layernorm backward kernels

* revert back some changes & remove debug code

* change the constants to a macro

Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
2021-12-01 20:17:22 +00:00
..
benchmarks Fix many typos (#1423) 2021-10-01 19:56:32 -07:00
model Improve pre-commit hooks (#1602) 2021-12-01 03:12:29 +00:00
onebit
perf force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598) 2021-11-29 15:41:18 -08:00
small_model_debugging
unit Transformer kernel/fix layer norm (#1587) 2021-12-01 20:17:22 +00:00
conftest.py