Граф коммитов

9 Коммитов

Автор SHA1 Сообщение Дата
Ammar Ahmad Awan 01726ce2b8
Add 1-bit Adam support to DeepSpeed (#380)
* 1-bit adam (#353)

Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: tanghl1994 <htang14@ur.rochester.edu>
Co-authored-by: Hank <tanghl1994@gmail.com>
Co-authored-by: root <root@node2x12b.cs.rochester.edu>
Co-authored-by: Ammar Ahmad Awan <awan.ammar@microsoft.com>
2020-09-09 14:37:37 -07:00
Jeff Rasley e5bbc2e559
Sparse attn + ops/runtime refactor + v0.3.0 (#343)
* Sparse attn + ops/runtime refactor + v0.3.0

Co-authored-by: Arash Ashari <arashari@microsoft.com>

Co-authored-by: Arash Ashari <arashari@microsoft.com>
2020-09-01 18:06:15 -07:00
Jeff Rasley 871f7e6305
Update setup.py (#298) 2020-07-22 08:33:05 -07:00
Jeff Rasley 734d8991c8
Transformer kernel release (#242)
* Transformer kernels release

Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
2020-05-29 13:15:36 -07:00
Jeff Rasley 3d3f8d36a4
PyTorch 1.3+ build support (#135)
* add support for torch 1.3+ builds inside a docker build environment
* remove apex imports
2020-03-12 13:08:58 -07:00
Shaden Smith 50ae149f82 Moving to major/minor/patch versioning. (#51) 2020-02-09 20:03:35 -08:00
Jeff Rasley 20ff66a0c1 Azure tutorial updates and cleanup (#43) 2020-02-08 22:00:24 -08:00
Jeff Rasley a5acb5b22d updating formatting to pass yapf 2020-02-03 11:12:45 -08:00
Jeff Rasley 26e5ecab9b
Initial commit of setup 2020-01-31 15:57:11 -08:00