This is the initial commit of the topline dashboard that outlines the
general approach to moving the data around. The data will simply be a
union of historical data and the slightly reformatted topline data. This
uses moto for mocking boto3.
This adds comments for testing setup and renames a test. This also makes
function names more indicative of their function and changes the
partition column `report_start` to be read as a string.
Uses operator.itemgetter, iteritems, new style classes.
Moves some functions outside of their user functions to not have to create the inner function on every call.
These jobs are currently running on ATMO. We'd like to get these jobs
reviewed and running on Airflow.
basic_etl was previously in it's own repository
[here](https://github.com/harterrt/betl) but will now be maintained in
this repository.
This uses tox for setting up the environment and test-runner. The
dependencies for this are added to setup.py if you want to run pytest
manually with your own virtual environment, while tox is used for
automatically setting up the environment.
This will run tests with dependencies on spark on travis, and then send
the results to codecov.io.
Anthony Miyaguchi
Ryan Harter
Jannis Leidel