@acmiyaguchi reported that with the source mounted into the container,
cache files were written to the local file system that then
couldn't be removed without sudo on an Ubuntu host.
This change should make sure all cache files are written inside the
container so they don't hit the local filesystem.
* Remove Coveralls
Coveralls is currently making it impossible to merge PRs, since
they are not having the coveralls status reported. Admins also
cannot override this.
* Add cryptography dependencies
Previously, the job failed with:
"c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory"
* Remove coverage usage
* Add a utility function for reading main_summary.
This supports merging schemas for only a subset of partitions.
* Replace findspark with pyspark
* Remove pyspark from setup.py
The main idea here is to ADD/COPY content that changes often (like the
project source code) as late as possible. This also fixes the activation
of the conda environment, which was not happening.
The ADD directive let's you specify a remote src which is very handy,
but it means the src file is downloaded everytime. Using RUN means that
we are only downloading the file once, unless the filename changes.
Jeff Klukas
Daniel Thorn
Frank Bertsch
Rob Hudson
Mark Reid
Mauro Doglio
William Lachance
William Lachance