зеркало из https://github.com/Azure/nlp-samples.git
add comment
This commit is contained in:
Родитель
99b0c3b441
Коммит
460e49ce2e
|
@ -10,12 +10,19 @@ login to Azure
|
||||||
az login
|
az login
|
||||||
```
|
```
|
||||||
|
|
||||||
|
check Azure subscription
|
||||||
|
```bash
|
||||||
|
az account show -o table # check if you are logged in to a right Azure subscription
|
||||||
|
az account set --subscription <subscription_id> # change Azure subscription if needed
|
||||||
|
```
|
||||||
|
|
||||||
## Installation Azure ML CLI 2.0 (Preview)
|
## Installation Azure ML CLI 2.0 (Preview)
|
||||||
|
|
||||||
Install Azure ML CLI 2.0 (Preview)
|
Install Azure ML CLI 2.0 (Preview)
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
./setup.sh
|
./setup.sh
|
||||||
|
# Inside the shell, run the following command:
|
||||||
# az extension add -n ml -y <-- If you use devcontainer, it already installed. Seee Dockerfile under .devcontiner folder.
|
# az extension add -n ml -y <-- If you use devcontainer, it already installed. Seee Dockerfile under .devcontiner folder.
|
||||||
# az configure --defaults group="azureml-mlops" workspace="azureml-mlops" <-- change resource group name and workspace name to your environment.
|
# az configure --defaults group="azureml-mlops" workspace="azureml-mlops" <-- change resource group name and workspace name to your environment.
|
||||||
```
|
```
|
||||||
|
@ -34,6 +41,11 @@ Create Azure ML Environments based on [Dockerfile](./Dockerfile)
|
||||||
Fine Tune GPT-2 Model
|
Fine Tune GPT-2 Model
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
./train.sh # Fine Tune using HaggingFace Transformers Trainer API
|
# single node (use transformers Trainer API directly)
|
||||||
|
./train.sh # Fine Tune rinna GPT-2 Model
|
||||||
```
|
```
|
||||||
|
or
|
||||||
|
```bash
|
||||||
|
# distributed training (use modified run_clm.py)
|
||||||
|
./train_distributed.sh # Fine Tune rinna GPT-2 Model
|
||||||
|
```
|
|
@ -0,0 +1,2 @@
|
||||||
|
#!/bin/sh
|
||||||
|
az ml job create --file rinna_trainer_distributed_job.yml
|
Загрузка…
Ссылка в новой задаче