DeepSpeed/docs
Gavin Goodship 75c7720214
doc corrections (#4861)
2023-12-21 19:13:24 +00:00
..
_data DeepSpeed4Science (#4357) 2023-09-18 22:16:08 +00:00
_includes Website posts and tutorial improvements (#1799) 2022-03-11 15:00:32 -08:00
_layouts Website posts and tutorial improvements (#1799) 2022-03-11 15:00:32 -08:00
_pages Guanhua/partial offload rebase v2 (#590) (#4636) 2023-11-06 14:15:16 -08:00
_posts Add Japanese blog for DeepSpeed-FastGen (#4651) 2023-11-07 10:10:45 -08:00
_sass Tune webpage width (#1829) 2022-03-11 15:19:54 -08:00
_tutorials doc corrections (#4861) 2023-12-21 19:13:24 +00:00
assets [docs] paper updates (#4584) 2023-10-30 14:17:18 -07:00
code-docs Add get and set APIs for the ZeRO-3 partitioned parameters (#4681) 2023-11-17 21:58:47 +00:00
404.html drafting Jekyll webpage (#143) 2020-03-17 13:49:48 -07:00
CNAME Restoring CNAME (#145) 2020-03-17 14:27:07 -07:00
Gemfile drafting Jekyll webpage (#143) 2020-03-17 13:49:48 -07:00
README.md Update README.md (#4284) 2023-09-07 08:26:28 -07:00
_config.yml DeepSpeed4Science (#4357) 2023-09-18 22:16:08 +00:00
contributing.md Improving deepspeed.ai website (#269) 2020-06-23 17:13:01 -07:00
index.md [docs] Intel inference blog (#4734) 2023-11-28 08:27:54 -08:00

README.md

DeepSpeed Documentation

This directory includes the source code for the website and documentation of DeepSpeed. The code-docs/ directory is used to build deepspeed.readthedocs.io.

deepspeed.ai is the recommended way to read all DeepSpeed documentation. Directly viewing the Markdown files in this directory will not include images and other features.

Building the documentation locally

You can serve the DeepSpeed website locally. This is especially useful for development.

Prerequisites

The DeepSpeed website relies on Jekyll. There are several guides for installation. The instructions below assume you are in an Ubuntu environment and have been tested on WSL.

First ensure that you have the necessary packages (e.g., make and zlib).

sudo apt-get install build-essential zlib1g-dev ruby-full

Add these lines to your .bashrc or equivalent to ensure you have permissions to install Ruby packages without sudo.

export GEM_HOME="$HOME/gems"
export PATH="$HOME/gems/bin:$PATH"

Don't forget to source ~/.bashrc afterward 😊.

Now we can install Jekyll and Bundler:

gem install jekyll bundler

Start a local webserver

We now need to install the required Ruby packages for the website.

NOTE: you should change to this folder (i.e., docs) before running the installation command to avoid this error:

Could not locate Gemfile

NOTE: This step frequently hangs when connected to a VPN (including MSVPN). Simply disconnect for the package installation.

bundle install

You can now start a local webserver via:

bundle exec jekyll serve

The website should now be accessible at http://localhost:4000

Update the Readthedocs.io API documentation

Use the following steps to update the public API documentation.

  1. Make your documentation changes and push them to the rtd-staging branch. This will rebuild the docs in the staging branch. NOTE: It is acceptable to force push to this branch to overwrite previous changes.
  2. View the result of the result of the build here
  3. Once the build is complete view the newly modified API documentation here
  4. Once you are satisfied with the changes create a new branch off of rtd-staging to push into master.