doAzureParallel/docs
Pablo Selem 45fe532d50
Update documentation on using private docker registries (#201)
* update documentation for private docker registry

* update docs to be less confusing
2018-01-22 08:54:30 -08:00
..
00-azure-introduction.md updated docs (#172) 2017-11-20 15:30:19 -08:00
10-vm-sizes.md README update 2017-03-13 21:54:41 +00:00
11-autoscale.md v0.3.0 Release (#20) 2017-05-22 17:22:40 -07:00
12-quota-limitations.md README / Documentation Updates for v0.2.0 (#7) 2017-03-15 13:34:15 -07:00
20-package-management.md Feature/container (#153) 2017-11-03 10:06:40 -07:00
21-distributing-data.md Feature/container (#153) 2017-11-03 10:06:40 -07:00
22-parallelizing-cores.md README update 2017-03-13 21:54:41 +00:00
23-persistent-storage.md Feature/longrunjob, long running job improvement, add deleteJob and terminateJob (#174) 2017-12-06 16:51:50 -08:00
30-customize-cluster.md Feature/docker registry auth (#182) 2017-12-06 17:57:57 -08:00
31-long-running-job.md Feature/longrunjob, long running job improvement, add deleteJob and terminateJob (#174) 2017-12-06 16:51:50 -08:00
32-building-containers.md Update documentation on using private docker registries (#201) 2018-01-22 08:54:30 -08:00
33-programmatically-generate-config.md Update documentation on using private docker registries (#201) 2018-01-22 08:54:30 -08:00
40-troubleshooting.md Feature/longrunjob, long running job improvement, add deleteJob and terminateJob (#174) 2017-12-06 16:51:50 -08:00
41-managing-storage-via-R.md Merge master to stable for version 0.4.3 (#132) 2017-09-29 13:23:21 -07:00
42-faq.md Feature/longrunjob, long running job improvement, add deleteJob and terminateJob (#174) 2017-12-06 16:51:50 -08:00
README.md Feature/configfromobj support programmatically created credentials and cluster configs (#168) 2017-11-16 23:18:09 -08:00

README.md

doAzureParallel Guide

This section will provide information about how Azure works, how best to take advantage of Azure, and best practices when using the doAzureParallel package.

  1. Azure Introduction (link)

    Using the Data Science Virtual Machine (DSVM) & Azure Batch

  2. Virtual Machine Sizes (link)

    How do you choose the best VM type/size for your workload?

  3. Autoscale (link)

    Automatically scale up/down your cluster to save time and/or money.

  4. Azure Limitations (link)

    Learn about the limitations around the size of your cluster and the number of foreach jobs you can run in Azure.

  5. Package Management (link)

    Best practices for managing your R packages in code. This includes installation at the cluster or job level as well as how to use different package providers.

  6. Distributing your Data (link)

    Best practices and limitations for working with distributed data.

  7. Parallelizing on each VM Core (link)

    Best practices and limitations for parallelizing your R code to each core in each VM in your pool

  8. Persistent Storage (link)

    Taking advantage of persistent storage for long-running jobs

  9. Customize Cluster (link)

    Setting up your cluster to user's specific needs

  10. Long Running Job (link)

    Best practices for managing long running jobs

  11. Programmatically generated config (linik)

Generate credentials and cluster config at runtime programmatically

Additional Documentation

Take a look at our Troubleshooting Guide for information on how to diagnose common issues.

Read our FAQ for known issues and common questions.