Ammar Ahmad Awan
|
01726ce2b8
|
Add 1-bit Adam support to DeepSpeed (#380)
* 1-bit adam (#353)
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: tanghl1994 <htang14@ur.rochester.edu>
Co-authored-by: Hank <tanghl1994@gmail.com>
Co-authored-by: root <root@node2x12b.cs.rochester.edu>
Co-authored-by: Ammar Ahmad Awan <awan.ammar@microsoft.com>
|
2020-09-09 14:37:37 -07:00 |
Jeff Rasley
|
e5bbc2e559
|
Sparse attn + ops/runtime refactor + v0.3.0 (#343)
* Sparse attn + ops/runtime refactor + v0.3.0
Co-authored-by: Arash Ashari <arashari@microsoft.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>
|
2020-09-01 18:06:15 -07:00 |
Jeff Rasley
|
871f7e6305
|
Update setup.py (#298)
|
2020-07-22 08:33:05 -07:00 |
Jeff Rasley
|
734d8991c8
|
Transformer kernel release (#242)
* Transformer kernels release
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
|
2020-05-29 13:15:36 -07:00 |
Jeff Rasley
|
3d3f8d36a4
|
PyTorch 1.3+ build support (#135)
* add support for torch 1.3+ builds inside a docker build environment
* remove apex imports
|
2020-03-12 13:08:58 -07:00 |
Shaden Smith
|
50ae149f82
|
Moving to major/minor/patch versioning. (#51)
|
2020-02-09 20:03:35 -08:00 |
Jeff Rasley
|
20ff66a0c1
|
Azure tutorial updates and cleanup (#43)
|
2020-02-08 22:00:24 -08:00 |
Jeff Rasley
|
a5acb5b22d
|
updating formatting to pass yapf
|
2020-02-03 11:12:45 -08:00 |
Jeff Rasley
|
26e5ecab9b
|
Initial commit of setup
|
2020-01-31 15:57:11 -08:00 |