0ad4fd880b
* Update zero.md Update to ZeRO tutorial to specify the use of activation checkpointing * Update zero-offload.md Use activation checkpointing with ZeRO-Offload Co-authored-by: Jeff Rasley <jerasley@microsoft.com> |
||
|---|---|---|
| .. | ||
| _data | ||
| _layouts | ||
| _pages | ||
| _posts | ||
| _tutorials | ||
| assets | ||
| code-docs | ||
| news | ||
| 404.html | ||
| CNAME | ||
| Gemfile | ||
| Gemfile.lock | ||
| README.md | ||
| _config.yml | ||
| contributing.md | ||
| index.md | ||
README.md
DeepSpeed Documentation
This directory includes the source code for the website and documentation of DeepSpeed. The code-docs/ directory is used to build deepspeed.readthedocs.io.
deepspeed.ai is the recommended way to read all DeepSpeed documentation. Directly viewing the Markdown files in this directory will not include images and other features.
Building the documentation locally
You can serve the DeepSpeed website locally. This is especially useful for development.
Prerequisites
The DeepSpeed website relies on Jekyll. There are several guides for installation. The instructions below assume you are in an Ubuntu environment and have been tested on WSL.
First ensure that you have the necessary packages (e.g., make and zlib).
sudo apt-get install build-essential zlib1g-dev ruby-full
Add these lines to your .bashrc or equivalent to ensure you have permissions to install Ruby packages without sudo.
export GEM_HOME="$HOME/gems"
export PATH="$HOME/gems/bin:$PATH"
Don't forget to source ~/.bashrc afterwards 😊.
Now we can install Jekyll and Bundler:
gem install jekyll bundler
Start a local webserver
We now need to install the required Ruby packages for the website.
NOTE: you should change to this folder (i.e., docs) before running the installation command to avoid this error:
Could not locate Gemfile
NOTE: this step frequently hangs when connected to a VPN (including MSVPN). Simply disconnect for the package installation.
bundle install
You can now start a local webserver via:
bundle exec jekyll serve
The website should now be accessible at http://localhost:4000