A system for managing CI data for Mozilla projects
Перейти к файлу
Ed Morley 0809a5bd57
Bug 1337717 - Update to newer Celery, Kombu, py-amqp and billiard (#4722)
Updating in one go, since the Celery 4 release only supports the newer
versions of its dependencies and vice versa.

Of note, this fixes the unhelpful connection error messages shown when
in fact there was an authentication problem, and brings Celery/Kombu
support for Python 3.7. It's also likely that this will fix the pulse
listener hang seen in bug 1529404.

The new Celery release has renamed a number of the settings.
Most changes were performed by running:

```
celery upgrade settings treeherder/config/settings.py --django
celery upgrade settings tests/settings.py --django
```

The Django integration in celery.py has been cleaned up by following:
https://celery.readthedocs.io/en/latest/django/first-steps-with-django.html

The bug being hit that caused this to be reverted back in #2119/bug 1333079
was due to Celery 4 no longer supporting calling `apply_async()`
with just the `routing_key` - it now has to be called with either just
the `queue`, or else both the `routing_key` and `queue`, otherwise the task
ends up in the `default` queue. Sadly this isn't mentioned in the Celery
breaking changes list - I'll file an upstream issue shortly.

Changes:

http://docs.celeryproject.org/en/master/history/whatsnew-4.0.html
http://docs.celeryproject.org/en/master/changelog.html#rc1
https://github.com/celery/celery/compare/v3.1.26...v4.3.0rc1

http://docs.celeryproject.org/projects/kombu/en/stable/changelog.html#version-4-3-0
https://github.com/celery/kombu/compare/v3.0.37...v4.3.0

https://amqp.readthedocs.io/en/stable/changelog.html
https://github.com/celery/py-amqp/compare/v1.4.9...v2.4.1

https://github.com/celery/billiard/blob/v3.6.0/CHANGES.txt
https://github.com/celery/billiard/compare/v3.3.0.23...v3.6.0
2019-02-28 19:52:22 +00:00
.dependabot Bug 1337717 - Update to newer Celery, Kombu, py-amqp and billiard (#4722) 2019-02-28 19:52:22 +00:00
bin Bug 1530206 - Remove the bin/run_* scripts 2019-02-27 07:12:33 +00:00
deployment/aws Bug 1308354 - Remove SCL3-specific code now we're on Heroku 2016-10-24 18:55:03 +01:00
docs Bug 1530206 - Rename read_pulse_* to pulse_listener_* 2019-02-27 07:12:33 +00:00
lints Bug 1337717 - Update to newer Celery, Kombu, py-amqp and billiard (#4722) 2019-02-28 19:52:22 +00:00
requirements Bug 1337717 - Update to newer Celery, Kombu, py-amqp and billiard (#4722) 2019-02-28 19:52:22 +00:00
schemas Bug 1522101 - Use Prettier to format JSON 2019-01-23 20:19:04 +00:00
tests Bug 1337717 - Update to newer Celery, Kombu, py-amqp and billiard (#4722) 2019-02-28 19:52:22 +00:00
treeherder Bug 1337717 - Update to newer Celery, Kombu, py-amqp and billiard (#4722) 2019-02-28 19:52:22 +00:00
ui Bug 1527824 - refactor and replace usage of PushModel.getList (#4713) 2019-02-27 10:26:50 -08:00
vagrant Bug 1527868 - Vagrant/Travis: Remove Elasticsearch server 2019-02-14 21:10:21 +00:00
.eslintrc.js Bug 1513581 - Fix ESLint react/no-access-state-in-setstate 2019-02-27 09:40:35 -08:00
.gitattributes Bug 1419168 - Add a .gitattributes file to force Linux line endings (#2997) 2017-11-28 21:51:59 +00:00
.gitignore Clean up the location of generated output directories (#4289) 2018-11-16 19:18:18 +00:00
.neutrinorc.js Increase maxEntrypointSize to avoid failures from duplicate deps (#4651) 2019-02-16 11:10:44 +00:00
.prettierignore Bug 1522101 - Use Prettier to format JSON 2019-01-23 20:19:04 +00:00
.prettierrc.js Bug 1507172 - Use Prettier for formatting JS/JSX (#4276) 2018-11-16 08:28:34 +00:00
.readthedocs.yml Bug 1466084 - Docs: Switch to MkDocs and Material theme (#4565) 2019-02-06 19:34:08 +00:00
.slugignore Bug 1318295 - Vagrant: Remove the puppet provisioner 2017-03-21 22:48:51 +00:00
.travis.yml Bug 1330474 - Travis: Stop testing against Python 2 (#4675) 2019-02-25 06:54:46 +00:00
.yarnrc Don't run preinstall/install/postinstall hooks during yarn install (#4432) 2019-01-08 18:15:01 +00:00
LICENSE.txt Bug 1192801 - List the full MPL v2 license in LICENSE.txt 2015-08-18 23:29:32 +01:00
Procfile Bug 1531271 - Remove unused Celery queues (#4719) 2019-02-28 17:22:40 +00:00
README.md Bug 1525923 - Switch from pyup to Dependabot for Python package updates (#4575) 2019-02-07 15:41:31 +00:00
Vagrantfile Bug 1527868 - Vagrant/Travis: Remove Elasticsearch server 2019-02-14 21:10:21 +00:00
jest.config.js Bug 1364045 - Don't load '@neutrinojs/jest' in production (#4381) 2018-12-17 12:23:53 +00:00
manage.py Bug 1330474 - Switch from Python 2.7 to Python 3.6 (#4668) 2019-02-21 07:38:24 +00:00
mkdocs.yml Bug 1466084 - Docs: Switch to MkDocs and Material theme (#4565) 2019-02-06 19:34:08 +00:00
newrelic.ini Bug 1508228 - Remove Intermittents Commenter celery task (#4300) 2018-11-27 14:14:38 -08:00
package.json Bug 1506805 - Convert job-view and userguide to react-fontawesome (#4710) 2019-02-27 17:58:55 +00:00
pylintrc Bug 1452420 - Update pylintrc to reduce noise 2018-04-10 19:22:28 +01:00
renovate.json Update Renovate config to set reviewer and labels 2019-02-07 17:49:21 -08:00
requirements.txt Bug 1291307 - Stop using django-heroku-memcacheify 2016-09-02 10:53:54 +01:00
runtests.sh Bug 1337717 - Update to newer Celery, Kombu, py-amqp and billiard (#4722) 2019-02-28 19:52:22 +00:00
runtime.txt Bug 1330474 - Switch from Python 2.7 to Python 3.6 (#4668) 2019-02-21 07:38:24 +00:00
setup.cfg Bump isort from 4.3.4 to 4.3.8 in /requirements (#4696) 2019-02-25 11:12:40 +00:00
webpack.config.js Bug 1364894 - Upgrade from Neutrino 4 to 9 (#4216) 2018-11-02 18:48:28 +00:00
yarn.lock Bug 1506805 - Convert job-view and userguide to react-fontawesome (#4710) 2019-02-27 17:58:55 +00:00

README.md

treeherder

What's Deployed Build Status Node dependencies Status Node devDependencies Status Documentation Status

Description

Treeherder is a reporting dashboard for Mozilla checkins. It allows users to see the results of automatic builds and their respective tests. The Treeherder service manages the etl layer for data ingestion, web services, and the data model behind Treeherder.

Instances

Treeherder exists on two instances, stage for pre-deployment validation, and production for actual use.

Installation

The steps to run Treeherder are provided here.

The steps to run only the UI are provided here.

Visit our project tracking Wiki at: https://wiki.mozilla.org/EngineeringProductivity/Projects/Treeherder

Visit our readthedocs page for other setup and configuration at: https://treeherder.readthedocs.io

File any bugs you may encounter here.