Align bfloat16 docs (#1715)

docs/_data/navigation.yml

@@ -39,6 +39,8 @@ lnav:
         url: /docs/config-json/#communication-options
       - title: "FP16"
         url: /docs/config-json/#fp16-training-options
+      - title: "BFOAT16"
+        url: /docs/config-json/#bfloat16-training-options
       - title: "Gradient Clipping"
         url: /docs/config-json/#gradient-clipping
       - title: "ZeRO optimizations"

docs/_pages/config-json.md

@@ -233,7 +233,7 @@ Example of <i>**scheduler**</i>
 | ----------------------------------------------------------------------------------------------------- | ------- |
 | <i>**min_loss_scale**</i> is  a **fp16** parameter representing the minimum dynamic loss scale value. | `1000`  |
 
-### BFLOAT16 options
+### BFLOAT16 training options
 
 **Note:** this mode cannot be combined with the `amp` mode described below.
 {: .notice--warning}
@@ -241,10 +241,7 @@ Example of <i>**scheduler**</i>
 **Note:** this mode cannot be combined with the `fp16` mode described above.
 {: .notice--warning}
 
-**Note:** this mode is only compatible with ZeRO stages 1 and 2.
-{: .notice--warning}
-
-<i>**bfloat16**</i>: [dictionary]
+<i>**bf16**</i>: [dictionary]
 
 | Description                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                | Default |
 | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------- |
@@ -256,11 +253,11 @@ Example of <i>**scheduler**</i>
  }
 ```
 
-<i>**bfloat16:enabled**</i>: [boolean]
+<i>**bf16:enabled**</i>: [boolean]
 
-| Description                                                                                 | Default |
-| ------------------------------------------------------------------------------------------- | ------- |
-| <i>**enabled**</i> is a **bfloat16** parameter indicating whether or not BFLOAT16 training enabled. | `false` |
+| Description                                                        | Default |
+|--------------------------------------------------------------------| ------- |
+| <i>**enabled**</i> indicates whether BFLOAT16 training is enabled. | `false` |
 
 
 ### Automatic mixed precision (AMP) training options