INACTIVE - http://mzl.la/ghe-archive - Dashboard to Create AWS Clusters for the Mertrics Team

Перейти к файлу

Saptarshi Guha ceff78479b SSH is public-key based		2015-04-27 15:45:29 -07:00
bootscriptsAndR	SSH is public-key based	2015-04-27 15:45:29 -07:00
static	more niceties!	2015-04-27 12:45:46 -07:00
templates	more niceties!	2015-04-27 12:45:46 -07:00
.gitignore	Initial Commit	2015-04-22 08:56:21 -07:00
README.md	Create README.md	2015-04-22 09:07:12 -07:00
config.py	Spot History is now last 6 hrs!	2015-04-27 13:37:53 -07:00
misc.py	Initial Commit	2015-04-22 08:56:21 -07:00
server.py	Spot History is now last 6 hrs!	2015-04-27 13:37:53 -07:00
user.py	Initial Commit	2015-04-22 08:56:21 -07:00

README.md

metrics-aws-clusters

Dashboard to Create AWS Clusters for the Mertrics Team

This application uses Flask. You need a file called scr.dat (see config.py) the first line of which is your Amazon AWS_SECRET_ACCESS_KEY and the second line is the AWS_ACCESS_ID.

You'll also need to edit the line of valid email ids in the file user.py so that you'll be allowed to login.

But the cluster wont start because some files are on my private S3 folder. The files are

s3://mozillametricsemrscripts/kickstartrhipe.sh
s3://mozillametricsemrscripts/final.step.sh

Both of these files are in this github repo. But they depend on files created by https://github.com/mozilla/metrics-aws-clusters/blob/master/bootscriptsAndR/sequence.of.commands.to.create.mozilla.metrics.emr.kickstart.files.sh the output of which is stored in S3. I will update this README with a link to the files in the S3 bucket.

The cluster will start with some R packages and RHIPE 0.75. See https://github.com/mozilla/metrics-aws-clusters/blob/master/bootscriptsAndR/sequence.of.commands.to.create.mozilla.metrics.emr.kickstart.files.sh#L28 for what R packages are installed.