Spark bindings for Mozilla Telemetry
Перейти к файлу
Jeff Klukas d4c8319878 Explicitly mark spark_context fixture as session-scoped
We also alter some quotes solely for consistency.
2018-08-17 14:19:28 -04:00
bin Use parse_scalars.py instead of custom code (#194) 2018-02-09 14:16:13 +01:00
docs Update sphinx-rtd-theme from 0.2.4 to 0.4.0 2018-06-08 11:36:00 -04:00
moztelemetry Reorganize `Dataset.record` for clarity (#222) 2018-08-16 09:40:44 -07:00
tests Explicitly mark spark_context fixture as session-scoped 2018-08-17 14:19:28 -04:00
.gitignore Add support for python3 (#208) 2018-07-12 09:39:45 -07:00
.travis.yml Fix .travis.yml to only deploy from python 3.6 (#214) 2018-07-12 12:09:58 -07:00
Dockerfile Add support for python3 (#208) 2018-07-12 09:39:45 -07:00
LICENSE add license and how to install 2016-06-03 16:21:06 -07:00
README.md Add support for python3 (#208) 2018-07-12 09:39:45 -07:00
environment.yml Add support for python3 (#208) 2018-07-12 09:39:45 -07:00
pytest.ini Bug 1376905 - Run flake8 when testing locally 2018-02-12 11:24:34 -08:00
readthedocs.yml Bug 1294663 - add readthedocs config file 2016-08-16 13:33:15 +01:00
runtests.sh Add support for python3 (#208) 2018-07-12 09:39:45 -07:00
setup.cfg Bug 1419761 - Rename "histogram_tools.py" to "parse_histograms.py" (#188) 2017-11-24 14:41:08 -04:00
setup.py Add support for python3 (#208) 2018-07-12 09:39:45 -07:00

README.md

python_moztelemetry Build Status Documentation Status Updates codecov.io

Spark bindings for Mozilla Telemetry

Deploying a code change

After having your PR reviewed and merged create a new release on github. A new pypi release will be automatically triggered by Travis.

Installing from pypi

  • To install this package from pypi run:
pip install python_moztelemetry

Updating parse_histograms.py

moztelemetry/parse_histograms.py is a mirror of its counterpart from mozilla-central. To update it to the latest version you can run

bin/update_parser_scripts

Note that this file was formerly called histogram_tools.py and was renamed in Bug 1419761.

Testing locally

To test/debug this package locally, the recommended procedure is to build a docker image with the appropriate dependencies, then execute the unit tests inside it:

docker build -t moztelemetry_docker .
./runtests.sh # will run tests inside docker container

You can also run a subset of the tests by passing arguments to runtests.sh:

./runtests.sh -ktest_unpack # runs only tests with key "test_unpack"
./runtests.sh tests/heka # runs only tests in tests/heka