AWS bootstrap scripts for Mozilla's flavoured Presto setup.

Перейти к файлу

Blake Imsland 293582086b Change dev env vars to reflect reality		2017-03-20 14:37:29 -07:00
envs	Change dev env vars to reflect reality	2017-03-20 14:37:29 -07:00
files/bootstrap	Update parquet2hive datasets	2017-01-27 07:25:17 -08:00
playbooks	Allow runtime configuration of emr release	2016-11-01 16:40:03 -07:00
templates	Enable "hive.parquet.use-column-names"	2017-01-27 07:26:10 -08:00
.gitignore	Clean up provisioning logic	2016-03-11 15:39:28 -08:00
README.md	refactor + use centralized metastore	2016-11-01 15:25:19 -07:00
ansible.cfg	refactor + use centralized metastore	2016-11-01 15:25:19 -07:00
hosts	refactor + use centralized metastore	2016-11-01 15:25:19 -07:00

README.md

emr-bootstrap-presto

This repo contains the CloudFormation templates and bootstrap scripts for setting up Mozilla's Presto cluster.

Prerequisites

ansible >= 2.2.0.0
boto
boto3

Creating Stacks

Metastore

ansible-playbook \
  playbooks/metastore.yml \
  -e @envs/dev.yml \
  -e owner=<yourname>@mozilla.com

Presto

ansible-playbook \
  playbooks/presto.yml \
  -e @envs/dev.yml \
  -e owner=<yourname>@mozilla.com

Deploying Bootstrap Scripts

ansible-playbook \
  playbooks/bootstrap.yml \
  -e @envs/dev.yml

Modifying Variables

Besides the owner variable specified when creating the stack, everything lives in vars/default.yml and envs/<env>.yml. Any of these can be overridden at runtime by using the -e flag just as you did with owner.