AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure
Перейти к файлу
jiata 73b2b6d531 created spark-app-ssh 2017-04-13 07:34:19 +00:00
bin created spark-app-ssh 2017-04-13 07:34:19 +00:00
example-jobs configured bin dir for scripts + setup.py 2017-04-12 08:14:31 +00:00
redbull created spark-app-ssh 2017-04-13 07:34:19 +00:00
.gitignore configured bin dir for scripts + setup.py 2017-04-12 08:14:31 +00:00
README.md readme.md 2017-04-13 01:47:44 +00:00
requirements.txt az_spark_start + az_spark_submit 2017-04-07 20:55:05 +00:00
setup.py created spark-app-ssh 2017-04-13 07:34:19 +00:00

README.md

redbull

Run Spark on Azure Batch

Develop

  1. Create a virtual environment (either virtualenv or with conda)
  2. Use setuptools:
    python3 setup.py develop