Граф коммитов

8 Коммитов

Автор SHA1 Сообщение Дата
Ed Morley 0809a5bd57
Bug 1337717 - Update to newer Celery, Kombu, py-amqp and billiard (#4722)
Updating in one go, since the Celery 4 release only supports the newer
versions of its dependencies and vice versa.

Of note, this fixes the unhelpful connection error messages shown when
in fact there was an authentication problem, and brings Celery/Kombu
support for Python 3.7. It's also likely that this will fix the pulse
listener hang seen in bug 1529404.

The new Celery release has renamed a number of the settings.
Most changes were performed by running:

```
celery upgrade settings treeherder/config/settings.py --django
celery upgrade settings tests/settings.py --django
```

The Django integration in celery.py has been cleaned up by following:
https://celery.readthedocs.io/en/latest/django/first-steps-with-django.html

The bug being hit that caused this to be reverted back in #2119/bug 1333079
was due to Celery 4 no longer supporting calling `apply_async()`
with just the `routing_key` - it now has to be called with either just
the `queue`, or else both the `routing_key` and `queue`, otherwise the task
ends up in the `default` queue. Sadly this isn't mentioned in the Celery
breaking changes list - I'll file an upstream issue shortly.

Changes:

http://docs.celeryproject.org/en/master/history/whatsnew-4.0.html
http://docs.celeryproject.org/en/master/changelog.html#rc1
https://github.com/celery/celery/compare/v3.1.26...v4.3.0rc1

http://docs.celeryproject.org/projects/kombu/en/stable/changelog.html#version-4-3-0
https://github.com/celery/kombu/compare/v3.0.37...v4.3.0

https://amqp.readthedocs.io/en/stable/changelog.html
https://github.com/celery/py-amqp/compare/v1.4.9...v2.4.1

https://github.com/celery/billiard/blob/v3.6.0/CHANGES.txt
https://github.com/celery/billiard/compare/v3.3.0.23...v3.6.0
2019-02-28 19:52:22 +00:00
Ed Morley d726fe7313 Bug 1530267 - Remove __future_ imports
Since they are a no-op on Python 3.
2019-02-25 20:39:03 +00:00
Ed Morley dfb91271f0 Bug 1452212 - Add missing raw string annotations
Fixes pylint `anomalous-backslash-in-string`.
2018-04-10 20:10:27 +01:00
George Hickman 37bd9fe649 Bug 1428045 - Add future imports to turn print statements into functions 2018-03-21 11:56:27 +00:00
George Hickman 9cdeb4665a Bug 1428045 - Convert print statments to print functions 2018-03-21 11:56:27 +00:00
Ed Morley 8fae27955a Revert "Bug 1333079 - Switch to new style Celery setting names"
This reverts commit 1db3e2baf4.
2017-02-01 16:28:55 +00:00
Ed Morley 1db3e2baf4 Bug 1333079 - Switch to new style Celery setting names
Converted using:

celery upgrade settings treeherder/config/settings.py --django
celery upgrade settings tests/settings.py --django

As suggested by:
http://celery.readthedocs.io/en/latest/whatsnew-4.0.html#lowercase-setting-names

(I manually reverted the env variable name back to simplify deployment,
we can always clean these up later.)

The Django integration in celery.py has been cleaned up by following:
https://celery.readthedocs.io/en/latest/django/first-steps-with-django.html
2017-02-01 14:11:45 +00:00
James Graham 5ff72285c4 Bug 1255087 - Create a lint for ensuring that the heroku Procfile contains the same queues as CELERY_QUEUES in the settings file 2016-03-16 17:46:16 +00:00