Jeff Rasley
|
7ddfda8526
|
Add support for p100 in transformer kernels (#470)
add compute cap of 6.0, support p100
|
2020-10-14 10:44:16 -07:00 |
|
Jeff Rasley
|
1afca8f722
|
revert previous (accidental) change
|
2020-10-12 16:11:55 -07:00 |
|
Jeff Rasley
|
b8eb40eb67
|
add compute cap of 6.0 to transformer kernels
add compute cap of 6.0 to transformer kernels
|
2020-10-12 16:10:18 -07:00 |
Olatunji Ruwase
|
7b8be2a7d9
|
Disable default installation of CPU Adam (#450)
* Disable default installation of CPU Adam
* Handle cpufeature import/use errors separately
|
2020-09-29 14:43:34 -07:00 |
Shaden Smith
|
5812e84544
|
readthedocs yaml configuration (#410)
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
|
2020-09-16 18:57:43 -07:00 |
|
Jeff Rasley
|
240ea97b33
|
only add 1bit adam reqs if mpi is installed, update cond build for cpu-adam (#400)
|
2020-09-10 10:52:45 -07:00 |
|
Jeff Rasley
|
41db1c2f03
|
ZeRO-Offload release (#391)
* ZeRO-Offload (squash) (#381)
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Jie <37380896+jren73@users.noreply.github.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: arashashari <arashashari@ArashMSLaptop.redmond.corp.microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
|
2020-09-09 17:14:12 -07:00 |
Ammar Ahmad Awan
|
01726ce2b8
|
Add 1-bit Adam support to DeepSpeed (#380)
* 1-bit adam (#353)
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: tanghl1994 <htang14@ur.rochester.edu>
Co-authored-by: Hank <tanghl1994@gmail.com>
Co-authored-by: root <root@node2x12b.cs.rochester.edu>
Co-authored-by: Ammar Ahmad Awan <awan.ammar@microsoft.com>
|
2020-09-09 14:37:37 -07:00 |
|
Jeff Rasley
|
e5bbc2e559
|
Sparse attn + ops/runtime refactor + v0.3.0 (#343)
* Sparse attn + ops/runtime refactor + v0.3.0
Co-authored-by: Arash Ashari <arashari@microsoft.com>
Co-authored-by: Arash Ashari <arashari@microsoft.com>
|
2020-09-01 18:06:15 -07:00 |
|
Jeff Rasley
|
871f7e6305
|
Update setup.py (#298)
|
2020-07-22 08:33:05 -07:00 |
|
Jeff Rasley
|
734d8991c8
|
Transformer kernel release (#242)
* Transformer kernels release
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <ShadenTSmith@gmail.com>
Co-authored-by: Elton Zheng <eltonz@microsoft.com>
Co-authored-by: Reza Yazdani <reyazda@microsoft.com>
Co-authored-by: RezaYazdaniAminabadi <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
Co-authored-by: Tunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
|
2020-05-29 13:15:36 -07:00 |
|
Jeff Rasley
|
3d3f8d36a4
|
PyTorch 1.3+ build support (#135)
* add support for torch 1.3+ builds inside a docker build environment
* remove apex imports
|
2020-03-12 13:08:58 -07:00 |
|
Shaden Smith
|
50ae149f82
|
Moving to major/minor/patch versioning. (#51)
|
2020-02-09 20:03:35 -08:00 |
|
Jeff Rasley
|
20ff66a0c1
|
Azure tutorial updates and cleanup (#43)
|
2020-02-08 22:00:24 -08:00 |
|
Jeff Rasley
|
a5acb5b22d
|
updating formatting to pass yapf
|
2020-02-03 11:12:45 -08:00 |
|
Jeff Rasley
|
26e5ecab9b
|
Initial commit of setup
|
2020-01-31 15:57:11 -08:00 |