Граф коммитов

669 Коммитов

Автор SHA1 Сообщение Дата
Ed Morley 1dc1f7fee5 Bug 1182043 - Use pylibmc instead of python-memcached
We're already using pylibmc on Heroku, since we need its SASL
authentication support. However we were still using python-memcached on
Vagrant, Travis, stage & prod.

To reduce the number of simultaneous changes when we migrate to Heroku,
and to ensure at that point we're testing what we ship, this switches us
to pylibmc pre-emptively for all environments.

Django does have a native pylibmc backend [1], however it doesn't
support SASL authentication, so we have to use the custom django-pylibmc
backend instead [2], which we choose to use everywhere (even though only
Heroku's memcache instances require auth) for consistency.

Installing pylibmc requires libmemcached-dev, which is installed by
default on Travis, has just been installed on stage/prod (bug 1243767),
and as of this change, is now installed in the Vagrant environment too.

The comment mentioning that pylibmc must be present in the root
requirements.txt file no longer applies, since the Python buildpack now
uses pip-grep (rather than regex) to determine whether it is in the
requirements files [3], and so handles included requirements files too.
Example: https://emorley.pastebin.mozilla.org/8858007

I'll be checking for any changes in performance when this is deployed,
however if anything I expect it to be faster since it's not pure Python.

[1] https://github.com/django/django/blob/1.8.7/django/core/cache/backends/memcached.py#L171
[2] https://github.com/django-pylibmc/django-pylibmc/blob/master/django_pylibmc/memcached.py
[3] https://github.com/heroku/heroku-buildpack-python/blob/v75/bin/steps/pylibmc#L22
2016-02-05 17:35:57 +00:00
Ed Morley d81ce45ab1 Bug 1238274 - Update hawkrest from v0.0.8 to v0.0.9
https://hawkrest.readthedocs.org/en/latest/#changelog
https://github.com/kumar303/hawkrest/compare/0.0.8...0.0.9
2016-01-09 17:32:03 +00:00
Ed Morley af2e69a5d9 Bug 1238274 - Update mohawk from v0.3.0 to v0.3.1
https://mohawk.readthedocs.org/en/latest/#changelog
https://github.com/kumar303/mohawk/compare/0.3.0...0.3.1
2016-01-09 17:31:42 +00:00
Ed Morley d1e25ed9c7 Revert "Bug 1169696 - Use librabbitmq with Celery/Kombu for improved performance"
This reverts commit 375960c843.

Due to:
exceptions:NotImplementedError: ssl not supported by librabbitmq, please
use pyamqp:// or stunnel
2016-01-06 17:42:32 +00:00
Ed Morley 375960c843 Bug 1169696 - Use librabbitmq with Celery/Kombu for improved performance
For rabbitmq transports specified using `amqp://`, Celery/Kombu will use
librabbitmq automatically if it's available, otherwise will fall back to
the pure Python (and therefore slower) amqp:
http://celery.readthedocs.org/en/latest/userguide/optimizing.html#librabbitmq
2016-01-05 17:23:49 +00:00
Ed Morley a221cf1b45 Bug 1203597 - Heroku: Redirect HTTP to HTTPS and set an HSTS header
Since Heroku doesn't use nginx/Apache we must perform this via wsgi
middleware. We cannot use Django's HTTPS/HSTS features since they won't
help with requests that were served by WhiteNoise directly (eg the site
homepage).

Instead we use wsgi-sslify, as recommended by:
https://github.com/evansd/whitenoise/issues/53#issuecomment-166972824

We only enable it when IS_HEROKU is set, since stage/prod is handled by
Apache, and for local development we have to use HTTP.
2016-01-05 17:08:35 +00:00
Ed Morley 985cd86a6d Bug 1232654 - Update gunicorn from v19.4.1 to v19.4.3
http://docs.gunicorn.org/en/latest/news.html
https://github.com/benoitc/gunicorn/compare/19.4.1...19.4.3
2015-12-29 20:33:45 +00:00
Ed Morley 8f80564d9c Bug 1232654 - Update kombu from v3.0.30 to v3.0.32
https://github.com/celery/kombu/blob/master/Changelog
https://github.com/celery/kombu/compare/v3.0.30...v3.0.32
2015-12-21 15:41:21 +00:00
Ed Morley eac41a546c Bug 1232654 - Update gunicorn from v19.3.0 to v19.4.1
http://docs.gunicorn.org/en/latest/news.html
https://github.com/benoitc/gunicorn/compare/19.3...19.4.1
2015-12-21 15:38:40 +00:00
Ed Morley 631361b511 Bug 1232654 - Update djangorestframework from v3.3.1 to v3.3.2
http://www.django-rest-framework.org/topics/release-notes/
https://github.com/tomchristie/django-rest-framework/compare/3.3.1...3.3.2
2015-12-21 15:38:39 +00:00
Ed Morley f9ad9c288a Bug 1232654 - Update requests from v2.7.0 to v2.9.1
https://github.com/kennethreitz/requests/blob/master/HISTORY.rst
https://github.com/kennethreitz/requests/compare/v2.7.0...v2.9.1
2015-12-21 15:38:35 +00:00
Ed Morley 6916961c1d Bug 1232654 - Update mozlog from v3.0 to v3.1
https://github.com/mozilla/gecko-dev/commits/master/testing/mozbase/mozlog
2015-12-21 15:31:07 +00:00
Ed Morley cde42d044f Bug 1232654 - Update newrelic from v2.58.1.44 to v2.60.0.46
https://docs.newrelic.com/docs/release-notes/agent-release-notes/python-release-notes/python-agent-260046
https://github.com/edmorley/newrelic-python-agent/compare/v2.58.1.44...v2.60.0.46
2015-12-21 15:31:07 +00:00
Ed Morley 527a8f9947 Bug 1212937 - Remove Python client support for OAuth credentials
Since they are deprecated and no longer supported by the API.
The Python client version will be bumped in a later commit.
2015-12-16 18:12:42 +00:00
Ed Morley 32d4ce4888 Bug 1232654 - Update celery from v3.1.18 to v3.1.19
http://docs.celeryproject.org/en/latest/changelog.html
https://github.com/celery/celery/compare/v3.1.18...v3.1.19
2015-12-16 14:59:04 +00:00
Ed Morley 0b727a3562 Bug 1232654 - Update kombu from v3.0.26 to v3.0.30
https://github.com/celery/kombu/blob/3.0/Changelog
https://github.com/celery/kombu/compare/v3.0.26...v3.0.30
2015-12-16 14:59:03 +00:00
Ed Morley 308c1a3e03 Bug 1232654 - Update amqp from v1.4.6 to v1.4.8
https://github.com/celery/py-amqp/blob/master/Changelog
https://github.com/celery/py-amqp/compare/v1.4.6...v1.4.8
2015-12-16 14:59:03 +00:00
Ed Morley 754b4d0bb5 Bug 1232654 - Update billiard from v3.3.0.20 to v3.3.0.22
https://github.com/celery/billiard/blob/master/CHANGES.txt
https://github.com/celery/billiard/compare/v3.3.0.20...v3.3.0.22
2015-12-16 14:59:02 +00:00
Ed Morley ca53f80f81 Bug 1232654 - Update requests-hawk from v0.2.0 to v1.0.0
v1.0.0 has a simplified API for passing the id and key, see:
https://github.com/mozilla-services/requests-hawk#great-how-can-i-use-it

https://github.com/mozilla-services/requests-hawk/blob/master/CHANGES.txt
https://github.com/mozilla-services/requests-hawk/compare/0.2.0...1.0.0
2015-12-16 14:45:36 +00:00
Ed Morley e3c351bf40 Bug 1232654 - Update six from v1.9.0 to v1.10.0
https://bitbucket.org/gutworth/six/src/default/CHANGES
https://bitbucket.org/gutworth/six/branches/compare/1.10.0%0D1.9.0
2015-12-15 13:49:10 +00:00
Ed Morley 146d5a11ac Bug 1232654 - Update django-browserid from v1.0.0 to v1.0.2
https://github.com/mozilla/django-browserid/blob/master/CHANGELOG.rst
https://github.com/mozilla/django-browserid/compare/v1.0.0...v1.0.2
2015-12-15 13:49:09 +00:00
Ed Morley dc83c7d1c7 Bug 1232654 - Update simplejson from v3.7.3 to v3.8.1
https://github.com/simplejson/simplejson/blob/master/CHANGES.txt
https://github.com/simplejson/simplejson/compare/v3.7.3...v3.8.1
2015-12-15 13:49:09 +00:00
Ed Morley d5bb0b2cde Bug 1232654 - Update sqlparse from v0.1.16 to v0.1.18
https://github.com/andialbrecht/sqlparse/blob/master/CHANGES
https://github.com/andialbrecht/sqlparse/compare/0.1.16...0.1.18
2015-12-15 13:49:08 +00:00
Ed Morley 5ba2d0e017 Bug 1232654 - Update functools32 from v3.2.3-1 to v3.2.3-2
https://github.com/MiCHiLU/python-functools32/blob/master/ChangeLog
https://github.com/MiCHiLU/python-functools32/compare/3.2.3-1...3.2.3-2
2015-12-15 13:49:07 +00:00
Ed Morley 0d3bc53b75 Bug 1232654 - Update pytz from v2015.4 to v2015.7
https://launchpad.net/pytz/+announcements
2015-12-15 13:49:07 +00:00
Ed Morley 730a013e63 Bug 1232654 - Update whitenoise from v2.0.4 to v2.0.6
https://github.com/evansd/whitenoise/blob/master/CHANGELOG.rst
https://github.com/evansd/whitenoise/compare/v2.0.4...v2.0.6
2015-12-15 13:49:06 +00:00
Ed Morley e6a3e296e0 Bug 1232550 - Update pytest from v2.8.2 to v2.8.5
http://pytest.org/latest/changelog.html
https://github.com/pytest-dev/pytest/compare/2.8.2...2.8.5
2015-12-15 04:02:30 +00:00
Ed Morley c2f3bcc5bb Bug 1232550 - Update py from v1.4.30 to v1.4.31
http://pylib.readthedocs.org/en/latest/changelog.html
https://bitbucket.org/pytest-dev/py/branches/compare/1.4.31%0D1.4.30
2015-12-15 04:02:30 +00:00
Ed Morley b606ee5934 Bug 1232550 - Update datadiff from v1.1.6 to v2.0.0
http://sourceforge.net/p/datadiff/code/commit_browser
2015-12-15 04:02:29 +00:00
Ed Morley 16eee44d8e Bug 1232550 - Update flake8 from v2.5.0 to v2.5.1
http://flake8.readthedocs.org/en/latest/changes.html
https://gitlab.com/pycqa/flake8/compare/2.5.0...2.5.1
2015-12-15 04:02:29 +00:00
Ed Morley 4a94c4fe38 Bug 1232550 - Update django-extensions from v1.5.9 to v1.6.1
https://github.com/django-extensions/django-extensions/blob/master/CHANGELOG.md
https://github.com/django-extensions/django-extensions/compare/1.5.9...1.6.1
2015-12-15 04:02:28 +00:00
Ed Morley ed82dcc95a Bug 1231831 - Update djangorestframework from v3.2.4 to v3.3.1
http://www.django-rest-framework.org/topics/release-notes/
https://github.com/tomchristie/django-rest-framework/compare/3.2.4...3.3.1
2015-12-10 17:16:20 -05:00
Ed Morley d1b1cb534c Bug 1160561 - Replace dj-database-url with django-environ
We're already using django-environ for standard environment variables,
however it also supports DB URL parsing too, so we might as well use
it for everything, rather than using two packages.

In addition, django-environ already supports DB URI options (eg for
specifying the SSL cert), whereas the dj-database-url PR for that
feature has sat unmerged since May.

Compare:
https://github.com/kennethreitz/dj-database-url/blob/v0.3.0/dj_database_url.py
...with:
https://github.com/joke2k/django-environ/blob/v0.4/environ/environ.py#L323-L392
2015-11-25 21:48:15 +00:00
Ed Morley 63309178d9 Bug 1227733 - Update Django from v1.8.5 to v1.8.7
https://docs.djangoproject.com/en/1.8/releases/1.8.6/
https://docs.djangoproject.com/en/1.8/releases/1.8.7/
https://github.com/django/django/compare/1.8.5...1.8.7
2015-11-25 13:53:32 +00:00
William Lachance 651c5d90d0 Bug 1201154 - Add django-filter to list of required packages 2015-11-24 14:25:13 -05:00
Ed Morley 9cda039e8b Bug 1226565 - Update datasource to v0.10.0 (adds 'rowcount' return_type)
Adds support for a `return_type` of `rowcount`:
https://github.com/jeads/datasource/pull/39

https://github.com/jeads/datasource/compare/v0.9.1...v0.10.0
2015-11-20 18:35:30 +00:00
Ed Morley 5457781fe7 Bug 1223496 - Update newrelic from v2.56.0.42 to v2.58.1.44
https://docs.newrelic.com/docs/release-notes/agent-release-notes/python-release-notes/python-agent-258043
https://docs.newrelic.com/docs/release-notes/agent-release-notes/python-release-notes/python-agent-258144
https://github.com/edmorley/newrelic-python-agent/compare/v2.56.0.42...v2.58.1.44
2015-11-18 10:36:55 +00:00
Ed Morley 87c71dc037 Bug 1223824 - Update django-extensions from v1.5.7 to v1.5.9
https://github.com/django-extensions/django-extensions/blob/master/CHANGELOG.md
https://github.com/django-extensions/django-extensions/compare/1.5.7...1.5.9
2015-11-16 17:45:26 +00:00
Ed Morley 631f470e2b Bug 1223824 - Update beautifulsoup4 from v4.4.0 to v4.4.1
https://groups.google.com/forum/#!topic/beautifulsoup/buk4qPLJhMs
2015-11-16 17:45:25 +00:00
Ed Morley 30b157734a Bug 1223824 - Update waitress from v0.8.9 to v0.8.10
http://docs.pylonsproject.org/projects/waitress/en/latest/#change-history
https://github.com/Pylons/waitress/compare/0.8.9...0.8.10
2015-11-16 17:45:25 +00:00
Ed Morley 111ddbe180 Bug 1223824 - Update WebOb from v1.4.1 to v1.5.1
http://webob.readthedocs.org/en/latest/changes.html
https://github.com/Pylons/webob/compare/1.4.1...1.5.1
2015-11-16 17:45:24 +00:00
Ed Morley 24dc811884 Bug 1223824 - Update WebTest from v2.0.18 to v2.0.20
http://webtest.pythonpaste.org/en/latest/changelog.html
https://github.com/Pylons/webtest/compare/2.0.18...2.0.20
2015-11-16 17:45:23 +00:00
Ed Morley ffc5e723cd Bug 1223824 - Update pytest from v2.7.2 to v2.8.2
http://pytest.org/latest/changelog.html
https://github.com/pytest-dev/pytest/compare/2.7.2...2.8.2
2015-11-16 17:45:22 +00:00
Ed Morley bc273b5d34 Bug 1223824 - Update pyflakes from v0.9.2 to v1.0.0
https://github.com/pyflakes/pyflakes/releases/tag/1.0.0
https://github.com/pyflakes/pyflakes/compare/0.9.2...1.0.0
2015-11-16 17:45:22 +00:00
Ed Morley b7eda32d16 Bug 1223824 - Update flake8 from v2.4.1 to v2.5.0
http://flake8.readthedocs.org/en/latest/changes.html
https://gitlab.com/pycqa/flake8/compare/2.4.1...2.5.0
2015-11-16 17:45:21 +00:00
Ed Morley 01883737b2 Bug 1223824 - Update mock from v1.0.1 to v1.3.0
https://github.com/testing-cabal/mock/blob/master/NEWS
https://github.com/testing-cabal/mock/compare/1.0.1...1.3.0

mock now also requires the funcsigs and pbr packages.
2015-11-16 17:45:20 +00:00
Ed Morley be08ac3420 Bug 1223824 - Update responses from v0.4.0 to v0.5.0
https://github.com/getsentry/responses/blob/master/CHANGES
https://github.com/getsentry/responses/compare/0.4.0...0.5.0
2015-11-16 17:45:19 +00:00
Ed Morley 169a3d8b85 Bug 1182485 - Update datasource to v0.9.1 for the whitespace fix
Gives us the fix in:
https://github.com/jeads/datasource/pull/36

https://github.com/jeads/datasource/compare/v0.9...v0.9.1
2015-11-11 10:39:13 +00:00
Ed Morley 5f767d8e45 Bug 1223497 - Update the New Relic Python agent to v2.56.0.42
https://docs.newrelic.com/docs/release-notes/agent-release-notes/python-release-notes/python-agent-256042
2015-11-11 09:43:17 +00:00
Ed Morley 727658aef1 Bug 1221157 - Update hash for django-browserid now it has a wheel
The wheel archive is preferred over the standard one, so we need to
update the hash associated with django-browserid.
2015-11-03 16:05:06 +00:00
Ed Morley 9fd4f04d14 Bug 1220111 - Remove unused Python coverage packages
We don't currently have code coverage enabled, and whilst we want to do
so, it will likely be in a form different from here (eg coveralls.io).
The packages removed by this commit are also older releases - and the
latest versions have changed their dependencies (for example cov-core is
no longer a separate package). By removing them it will reduce the
number of packages we have to install locally & on Travis, as well as
mean fewer warnings for out of date packages from requires.io.
2015-10-30 14:33:00 +00:00
Ed Morley 2b40a0ada9 Bug 1220105 - Remove unused fancy-tag package dependency
As of django-browserid v1.0.0, it no longer uses fancy_tag:
https://github.com/mozilla/django-browserid/pull/281
2015-10-30 14:02:06 +00:00
Mauro Doglio 5930b4f4c1 Bug 1193836 - Use pytest-django to run tests
pytest-django doesn't setup a test database for every single test, but
only for those tests that actually require a db. Tests that require a db
need to either be marked with `@pytest.mark.django_db` or use a fixture
that has a dependency on `db` or `transactional_db`.
Using a non transactional db would make tests execution much faster, but
unfortunately it doesn't play well with the treeherder datasource
creation so I used a transactional_db.

pytest-django also allows you to specify a settings file to use for
tests in a pytest.ini file, which is nicer than monkeypatch the original
settings file in the pytest session start function 😃.
2015-10-27 11:19:13 +00:00
Ed Morley 654db14fc3 Remove leading whitespace in requirements/common.txt 2015-10-24 14:22:50 +01:00
Mauro Doglio a6b9d736ca Bug 1209555 - add requests-hawk to requirements 2015-10-08 13:11:54 +01:00
Ed Morley 0164b8f72f Bug 1211866 - Update django-extensions to v1.5.7
https://github.com/django-extensions/django-extensions/blob/master/CHANGELOG.md#157
https://github.com/django-extensions/django-extensions/compare/1.5.5...1.5.7
2015-10-06 16:01:36 +01:00
Ed Morley 745df95505 Bug 1211866 - Update django-environ to v0.4.0
https://github.com/joke2k/django-environ#040---23-september-2015
https://github.com/joke2k/django-environ/compare/v0.3...v0.4
2015-10-06 16:01:35 +01:00
Ed Morley 3e47f58a0d Bug 1211866 - Update django-rest-swagger to v0.3.4
https://github.com/marcgibbons/django-rest-swagger/blob/master/CHANGELOG.md#v034-august-19-2015
https://github.com/marcgibbons/django-rest-swagger/compare/0.3.2...0.3.4
2015-10-06 16:01:34 +01:00
Ed Morley ad4df5a2ff Bug 1211866 - Update drf-extensions to v0.2.8
http://chibisov.github.io/drf-extensions/docs/#0-2-8
https://github.com/chibisov/drf-extensions/compare/0.2.7...0.2.8
2015-10-06 16:01:34 +01:00
Ed Morley f9ee70006d Bug 1211866 - Update djangorestframework to v3.2.4
http://www.django-rest-framework.org/topics/3.2-announcement/
http://www.django-rest-framework.org/topics/release-notes/#32x-series
https://github.com/tomchristie/django-rest-framework/compare/3.1.3...3.2.4
2015-10-06 16:01:33 +01:00
Ed Morley 55c86687db Bug 1211866 - Update Django to v1.8.5
https://docs.djangoproject.com/en/1.8/releases/1.8.5/
https://github.com/django/django/compare/1.8.4...1.8.5
2015-10-06 16:01:31 +01:00
Ed Morley a79854f6b7 Bug 1211893 - Update httplib2 to v0.9.2
https://github.com/jcgregorio/httplib2/blob/master/CHANGELOG
https://github.com/jcgregorio/httplib2/compare/0.9.1...0.9.2
2015-10-06 15:50:24 +01:00
Ed Morley fe6e51d457 Bug 1211893 - Update oauth2 to v1.9.0.post1
Includes the fix for CVE-2013-4347.

https://github.com/joestump/python-oauth2/compare/hudson-python-oauth2-211...v1.9
2015-10-06 15:50:24 +01:00
Ed Morley 60a8d4015b Bug 1211900 - Update whitenoise to v2.0.4
https://github.com/evansd/whitenoise/blob/master/CHANGELOG.rst#v204
https://github.com/evansd/whitenoise/compare/v2.0.2...v2.0.4
2015-10-06 15:30:19 +01:00
Ed Morley cfe5ffca3a Bug 1210748 - Update to hawkrest v0.0.8 since v0.0.6 removed from PyPI
https://github.com/kumar303/hawkrest/compare/0.0.6...0.0.8
2015-10-05 16:40:03 +01:00
Ed Morley 8be78f1f57 Bug 1192957 - Add isort v4.2.2 to dev.txt
https://github.com/timothycrosley/isort
2015-10-02 17:54:47 +01:00
Cameron Dawson d23435f8ed Bug 1169320, 1199506 - Adds requirements, settings and JSON schema for Pulse Ingestion 2015-10-01 15:50:12 -07:00
Mauro Doglio 38a2e3a1b5 Bug 1160111 - Add requirements for hawkrest 2015-09-29 21:22:22 +02:00
Cameron Dawson 546f1bec98 Bug 1205888 - Adds base settings for pulse exchange ingestion
These are the settings (which can be overridden by environment variables)
that will be used to specify which Pulse exchanges we ingest data from

This also introduces the ``django-environ`` package which will be used
elsewhere as we move away from ``local.py`` files on the stage/prod
servers.
2015-09-22 15:06:53 -07:00
Mauro Doglio aa91f022ab Bug 1201140 - Add sqlparse to the requirements file
This is required to execute migrations using migrations.RunSQL.
See https://docs.djangoproject.com/en/1.8/ref/migration-operations/#runsql for more info
2015-09-15 10:19:31 +01:00
Mauro Doglio c38d21813e Bug 1182464 - update mozlog version 2015-09-03 10:50:12 +02:00
Ed Morley 5db78a106f Bug 1199378 - Update New Relic Python agent to v2.54.0.41
https://docs.newrelic.com/docs/release-notes/agent-release-notes/python-release-notes/python-agent-254041
2015-08-27 19:29:29 +01:00
Mauro Doglio caebeeb794 Bug 1159167 - Update to latest django-browserid
The latest version of django-browserid removes a view that we used to fetch to retrieve
basig config params for the browserid client initialization. We now have loginUrl and logoutUrl
hardcoded in the client and we fetch the user login status from a dedicated endpoint.
2015-08-20 13:48:58 +01:00
Mauro Doglio 1ab14030ce Bug 1181879 - upgrade django to 1.8.4 2015-08-19 19:53:55 +01:00
Ed Morley 90ba77e596 Bug 1192801 - Remove per-file MPL boilerplate since it's unnecessary
The MPL 2.0 terms state that as long as a LICENSE file is present, the
per-file header text is not required. See "Exhibit A" at the end of:
https://www.mozilla.org/MPL/2.0/
2015-08-18 23:32:11 +01:00
Ed Morley 392af575dc Bug 1169944 - Remove requirements/prod.txt since it contains no packages
We had to do at least one deploy after the initial landing of
bug 1169944, before removing prod.txt, to avoid errors during update.py.
That has now occurred, so we can remove the file.
2015-08-18 23:04:08 +01:00
Ed Morley f9ee81d999 Bug 1169944 - Always install the New Relic package, not just on prod
For bug 1124278, we're going to want to sprinkle new relic annotations
around the codebase, so by always installing it, we save having to stub
these out in development/on Travis. It also seems wise to have prod
running as close to the same packages as in development.

Since NEW_RELIC_LICENSE_KEY isn't set locally, plus
NEW_RELIC_DEVELOPER_MODE is set to true, the New Relic agent doesn't
submit anything. See:
https://docs.newrelic.com/docs/agents/python-agent/installation-configuration/python-agent-configuration#developer_mode
2015-08-11 23:23:26 +01:00
Ed Morley f9d2efddb8 Revert "Bug 1189499 - Use link to .tar.gz when downloading python-memcached"
This reverts commit 39ecfd1716, since
the mis-versioned package has now been removed, so the workaround is no
longer needed:
https://github.com/linsomniac/python-memcached/issues/72#issuecomment-126793510
2015-08-03 10:33:50 +01:00
William Lachance 39ecfd1716 Bug 1189499 - Use link to .tar.gz when downloading python-memcached
The wheel package which is the default to be installed accidentally got
swapped with 1.55: https://github.com/linsomniac/python-memcached/issues/72
2015-07-30 16:46:30 -04:00
Ed Morley 1af312e0cc Bug 1175432 - Use dj-database-url to simplify DB environment variables
dj-database-url extracts DB host, port, username, password and database
name from the env variable 'DATABASE_URL' (unless another env variable
name is specified). If the env variable is not defined, it falls back to
the default passed to dj_database_url.config().

This means for Heroku and similar we can replace the multiple DB env
variables with just one URL for default & one for read_only.

This also effectively makes the setting of the read only DB variable
mandatory for stage/production/heroku, since DEFAULT_DATABASE_URL won't
be valid for them - so prevents us inadvertently not using the read only
DB.

The deployment script also had to be updated, so that we set the
prod/stage-specific environment variables before using manage.py, since
dj-database-url cannot rely on what's in the stage/prod local.py config
(which isn't a bad thing, since we're deprecating that file).
2015-07-15 14:58:46 +01:00
Mauro Doglio 3f34e5da13 Bug 1145712 - upgrade django-rest-framework from 2.4.5 to 3.1.3
This patch upgrades the version stored in the requirements file and fixes some issues introduced by breaking changes in the new version of the library:
 - Writable nested fields are not available anymore, you need an explicit create method on the serializer to write a nested field.
 - ModelViewSet now requires serializer_class and queryset attributes.
 - @action and @link decorators are now replaced by either @detail_route or @list_route.
 - any attempt to create a ModelSerializer instance with an attribute which type is either dict or list will raise an exception.
2015-07-15 10:34:46 +01:00
Ed Morley 044adae263 Bug 1182994 - Update to datasource v0.9
* Fixes the `offset` parameter, since it previously used the value for
  `limit` instead.
* The `limit` and `offset` parameters are now cast to int, to prevent
  SQL injection if those parameters were not sanitised in the app.
  Note: This intentionally removes the ability to pass a comma delimited
  `limit` string of say "100,200" - since the now-working `offset`
  parameter makes this redundant.

https://github.com/jeads/datasource/compare/v0.8...v0.9
2015-07-13 13:38:55 +01:00
Ed Morley 50ca297bdd Bug 1182485 - Update to datasource v0.8
To pick up the whitespace-stripping change, amongst others:
https://github.com/jeads/datasource/compare/v0.7...v0.8
2015-07-10 21:45:04 +01:00
Ed Morley cc4d813844 Bug 1181836 - Update Django to v1.7.9
https://docs.djangoproject.com/en/1.7/releases/1.7.8/
https://docs.djangoproject.com/en/1.7/releases/1.7.9/

https://github.com/django/django/compare/1.7.7...1.7.9
2015-07-10 14:25:45 +01:00
Ed Morley d84aa3a166 Bug 1181819 - Update django-cors-headers to v1.1.0
https://github.com/ottoyiu/django-cors-headers/releases
and older: https://github.com/ottoyiu/django-cors-headers#changelog

https://github.com/ottoyiu/django-cors-headers/compare/v0.11...1.1.0
2015-07-10 14:23:37 +01:00
Ed Morley 9371347bc2 Revert "Bug 1175432 - Use dj-database-url to simplify DB environment variables"
This reverts commit 3330b3c567.
2015-07-09 23:05:49 +01:00
Ed Morley 3330b3c567 Bug 1175432 - Use dj-database-url to simplify DB environment variables
dj-database-url extracts DB host, port, username, password and database
name from the env variable 'DATABASE_URL' (unless another env variable
name is specified). If the env variable is not defined, it falls back to
the default passed to dj_database_url.config().

This means for Heroku and similar we can replace the multiple DB env
variables with just one URL for default & one for read_only.

This also effectively makes the setting of the read only DB variable
mandatory for stage/production/heroku, since DEFAULT_DATABASE_URL won't
be valid for them - so prevents us inadvertently not using the read only
DB.

Before this is deployed, we'll need to update the stage/prod puppet
configs & Heroku settings to add the new environment variable.
2015-07-09 17:54:29 +01:00
Ed Morley 0c53e1f68a Bug 1181587 - Update python-memcached to v1.53
https://github.com/linsomniac/python-memcached/blob/master/ChangeLog
https://github.com/linsomniac/python-memcached/compare/8078ecfe...release-1.53

python-memcached v1.54 has a performance regression, so only update to
v1.53 for now. See:
https://github.com/linsomniac/python-memcached/issues/71
2015-07-09 12:38:30 +01:00
Ed Morley 27fed6557f Revert ea0fbedf17 ("Bug 1181587 - Update python-memcached to v1.54")
To confirm whether this caused a response time regression for memcached
gets and sets.
2015-07-09 10:13:00 +01:00
Ed Morley 8cf618c2d7 Bug 1181816 - Update requests to v2.7.0
https://github.com/kennethreitz/requests/blob/master/HISTORY.rst
https://github.com/kennethreitz/requests/compare/v2.6.2...v2.7.0
2015-07-09 00:52:38 +01:00
Ed Morley ae13ff1289 Bug 1181813 - Update Unipath to v1.1
https://github.com/mikeorr/Unipath/blob/master/CHANGES
https://github.com/mikeorr/Unipath/compare/v1.0...v1.1
2015-07-09 00:50:26 +01:00
Ed Morley 0fdb8c04a3 Bug 1181778 - Update httplib2 to v0.9.1
https://github.com/jcgregorio/httplib2/blob/master/CHANGELOG
https://github.com/jcgregorio/httplib2/compare/8e63343d...v0.9.1
2015-07-09 00:45:38 +01:00
Ed Morley f47f376312 Bug 1181776 - Update jsonschema to v2.5.1
https://github.com/Julian/jsonschema/blob/master/CHANGELOG.rst
https://github.com/Julian/jsonschema/compare/v2.4.0...v2.5.1

jsonschema now also requires functools32.
2015-07-09 00:43:50 +01:00
Ed Morley 6e22199bb9 Bug 1181700 - Update simplejson to v3.7.3
https://github.com/simplejson/simplejson/blob/master/CHANGES.txt
https://github.com/simplejson/simplejson/compare/v3.6.5...v3.7.3
2015-07-09 00:42:39 +01:00
Ed Morley 3233e7ab01 Bug 1181696 - Update jsonfield to v1.0.3
https://github.com/bradjasper/django-jsonfield#changes
https://github.com/bradjasper/django-jsonfield/compare/68ee4349...1.0.3
2015-07-08 19:49:41 +01:00
Ed Morley a3d19b230c Bug 1181693 - Update futures to v3.0.3
Only one change:
* Fixed AttributeErrors on exit on Python 2.x

https://github.com/agronholm/pythonfutures/blob/master/CHANGES
https://github.com/agronholm/pythonfutures/compare/3.0.2...3.0.3
2015-07-08 19:33:52 +01:00
Ed Morley 0287ea1cc1 Bug 1181600 - Update pytz to v2015.4 2015-07-08 16:08:53 +01:00
Ed Morley ea0fbedf17 Bug 1181587 - Update python-memcached to v1.54
https://github.com/linsomniac/python-memcached/blob/master/ChangeLog
https://github.com/linsomniac/python-memcached/compare/8078ecfe...release-1.54

python-memcached now requires the package 'six', so that has to be
listed in common.txt and not just dev.txt.
2015-07-08 15:40:08 +01:00
Ed Morley bb9a81d75a Bug 1181531 - Update py to v1.4.30 and pytest to v2.7.2
http://pytest.org/latest/changelog.html
https://github.com/pytest-dev/pytest/compare/2.6.4...2.7.2

aea9674297/CHANGELOG
https://bitbucket.org/pytest-dev/py/branches/compare/1.4.30%0D1.4.26
2015-07-08 12:58:01 +01:00
Ed Morley e2e4226dea Bug 1181525 - Update beautifulsoup4 to v4.4.0
http://bazaar.launchpad.net/~leonardr/beautifulsoup/bs4/view/head:/NEWS.txt
2015-07-08 12:17:37 +01:00
Ed Morley 1bd721f7bc Bug 1176482 - WhiteNoise: Update to v2.0.2
https://github.com/evansd/whitenoise/blob/master/CHANGELOG.rst
https://github.com/evansd/whitenoise/compare/v1.0.6...v2.0.2
2015-07-08 11:06:46 +01:00
Ed Morley 58813b0c51 Bug 1169916 - Stop using Cython to build the log parser
Since it only speeds up parsing by a few percent of total runtime, and
is therefore not worth the added complexity for deployment and local
hack-test-debug cycles when working on the log parser.

The .gitignore and update.py entries will be removed in a later commit,
once the stage/prod src directories have been cleaned up.
2015-06-30 14:51:57 +01:00
Ed Morley c929f1d0b2 Bug 1176413 - Update to New Relic Python agent v2.52.0.40 2015-06-25 17:41:49 -07:00
Ed Morley bf4c7c05ff Bug 1151803 - Serve the UI using gunicorn/WhiteNoise instead of Apache
In order that we can serve the UI on Heroku, we wrap the Django wsgi app
with WhiteNoise, so both the UI and API requests are served by gunicorn.

In the Vagrant environment, Apache has been removed and Varnish instead
now proxies all requests to gunicorn/Django runserver directly, without
Apache as a go-between.

The UI on production will not be affected by this commit, since the
Apache config there will still intercept requests for the UI assets
rather than proxying them to gunicorn.

It's worth noting too, that we're not able to make use of WhiteNoise's
automatic Django GZip/caching support since that assumes we are using
Django templates and referring to resources using {% static "foo.css" %}

However, we can sub-class WhiteNoise (or more specifically the
DjangoWhiteNoise class) and override the is_immutable_file() method to
add caching support at a later date:
http://whitenoise.evans.io/en/latest/base.html#caching-headers

Documentation for WhiteNoise can be found at:
http://whitenoise.evans.io/
2015-06-19 15:56:23 +01:00
Ed Morley 83d5e32aa1 Bug 1175842 - Update mozlog to v2.11
https://github.com/mozilla/gecko-dev/commits/master/testing/mozbase/mozlog
2015-06-18 18:20:18 +01:00
Ed Morley 66d686e87e Bug 1167212 - Update to Celery v3.1.18, Kombu v3.0.26, billiard v3.3.0.20
Celery 3.1.18 now requires at least Kombu 3.0.25 and billiard 3.3.0.20,
so we have to update them at the same time.

http://docs.celeryproject.org/en/latest/changelog.html
https://github.com/celery/celery/compare/v3.1.16...v3.1.18

http://kombu.readthedocs.org/en/latest/changelog.html
https://github.com/celery/kombu/compare/v3.0.23...v3.0.26

https://github.com/celery/billiard/blob/v3.3.0.20/CHANGES.txt
https://github.com/celery/billiard/compare/v3.3.0.19...v3.3.0.20
2015-06-18 16:22:00 +01:00
Ed Morley 8c051b4920 Bug 1175478 - Update gunicorn to v19.3.0
http://docs.gunicorn.org/en/latest/2013-news.html
http://docs.gunicorn.org/en/latest/2014-news.html
http://docs.gunicorn.org/en/latest/news.html

https://github.com/benoitc/gunicorn/compare/17.5...19.3
2015-06-18 14:35:45 +01:00
Ed Morley bd8836e7e4 Bug 1175854 - Update responses to v0.4.0
https://github.com/getsentry/responses/blob/master/CHANGES
https://github.com/getsentry/responses/compare/0.3.0...0.4.0

Responses now also requires the cookies package.
2015-06-18 12:28:28 +01:00
Ed Morley 13a708a1a5 Bug 1175851 - Update django-extensions to v1.5.5
https://github.com/django-extensions/django-extensions/blob/master/CHANGELOG.md
https://github.com/django-extensions/django-extensions/compare/1.5.2...1.5.5
2015-06-18 12:25:56 +01:00
Ed Morley 0a2163ee4d Bug 1175848 - Update pyinotify to v0.9.6
https://github.com/seb-m/pyinotify/wiki/Recent-Developments
https://github.com/seb-m/pyinotify/compare/0.9.5...0.9.6
2015-06-18 11:19:43 +01:00
Ed Morley 80d8d49132 Bug 1175750 - Update to flake8 v2.4.1, Pyflakes v0.9.2 and McCabe v0.3.1
https://gitlab.com/pycqa/flake8/blob/master/CHANGES.rst
https://gitlab.com/pycqa/flake8/compare/2.4.0...2.4.1

https://github.com/pyflakes/pyflakes/blob/master/NEWS.txt
https://github.com/pyflakes/pyflakes/compare/0.8.1...0.9.2

https://github.com/flintwork/mccabe#changes
https://github.com/flintwork/mccabe/compare/0.3...0.3.1
2015-06-18 01:31:48 +01:00
William Lachance 5fea0d4b13 Bug 1167349 - Turn swagger back on in production and update to latest 2015-06-17 14:13:14 -04:00
William Lachance fac87ff899 Bug 1163138 - Add a management command to allow importing perf data
This also extends treeherder client to handle performance data.
2015-05-27 11:54:57 -04:00
Ed Morley 76c5b0de69 Bug 1085579 - Docs: Use the Read the Docs theme for local builds too
Using the instructions from:
https://docs.readthedocs.org/en/latest/theme.html#how-do-i-use-this-locally-and-on-read-the-docs
2015-05-26 13:56:18 +01:00
Ed Morley cc367574b7 Bug 1167560 - Don't pin the packages in doc.txt to specific versions
Since otherwise we play tug of war with Read the Docs build process.
Instead let's allow them to update us as they see fit, but at the same
time retain a docs.txt that will work locally.
2015-05-22 13:23:34 +01:00
Mauro Doglio b04d930c72 Bug 1167548 - update rest_framework to 2.4.5 and drf-extensions to 1.5.2 2015-05-22 11:51:00 +01:00
Jonathan French 19b71bc4b4 Bug 1164881 - Add MPL2.0 headers to recent treeherder repo files 2015-05-14 11:45:26 -04:00
Mauro Doglio 597282fe58 Bug 1145606 - Setup treeherder to deploy on heroku
I added a Procfile listing all the different python services treeherder needs.
Heroku provides deployment-specific settings via environment variables, so I had to modify the settings file to listen to them where that wasn't the case. I created an enviroment variable IS_HEROKU which allows to have a heroku-only configuration where needed.
The db service is provided by Amazon RDS, which requires a ssl connection. To enable ssl in the MySQLdb python client I had to modify Datasource (and bump up the version used).
The cache service is provided by the memcachier heroku addon. Heroku recommends to use pylibmc, so I set it up according to the docs here https://devcenter.heroku.com/articles/memcachier#python.
The amqp service is provided by the CloudAMQP addon.
I added a post_compile script that runs every time we deploy. We should run every build step we require in there, like static asset minification, collection, etc.
To share the oauth credentials among the various services I used an environment variable. I also added an option to export_project_credentials so that the credentials can be printed to stdout. This should come handy when we will need to update the environment-stored credentials with the ones in the db.
2015-05-14 13:54:41 +01:00
William Lachance 0e6e61fbbe Bug 1159831 - Make treeherder use in-tree copy of treeherder-client 2015-05-01 13:34:29 -04:00
Cameron Dawson b0a0ea7a8c Bug 1144417 - use treeherder-client 1.2 with requests 2015-04-30 11:28:53 -07:00
Ed Morley ec90285cfa Bug 1159250 - Update django-extensions to 1.5.2
https://github.com/django-extensions/django-extensions/blob/master/CHANGELOG.md#152
https://github.com/django-extensions/django-extensions/compare/1.5.1...1.5.2
2015-04-28 23:46:06 +01:00
Ed Morley 1a0386000a Bug 1159250 - Update WebOb to v1.4.1
http://docs.webob.org/en/latest/news.html
https://github.com/Pylons/webob/compare/1.4...1.4.1
2015-04-28 23:46:06 +01:00
Ed Morley d66e30f220 Bug 1118023 - Update to django-browserid v0.10
Changes:
e8d1d57145...v0.10

Using a specific version release of django-browserid (vs the Git zip
archive for a specific revision) means peep doesn't have to re-download
the package each time.
2015-04-28 19:12:09 +01:00
Ed Morley c71366aa8b Bug 1158380 - Update requests to v2.6.2
Fixes security bugs, includes perf improvements & also means we can use
the 'json' param for uploads instead of having to json.dumps() them.

https://github.com/kennethreitz/requests/blob/master/HISTORY.rst
https://github.com/kennethreitz/requests/compare/v2.4.1...v2.6.2
2015-04-27 19:15:04 +01:00
Ed Morley 1146796120 Bug 1158371 - Update simplejson to v3.6.5
Changes:
https://github.com/simplejson/simplejson/compare/v3.3.0...v3.6.5
2015-04-27 19:14:10 +01:00
Ed Morley 3b0469dbc5 Revert update to django-browserid v0.11.1 (bug 1118023)
This reverts commit 702259c181
and 42f54236b3.
2015-04-27 16:58:36 +01:00
Ed Morley 702259c181 Bug 1118023 - Update to django-browserid v0.11.1
Changes:
e8d1d57145...v0.11.1

This will fix the spurious "Setting BROWSERID_VERIFY_CLASS not found"
errors in logs, as well as possibly help with people getting logged out
intermittently. It also brings us up to the latest django-browserid
release, which means updating later to a (yet to be released) Django 1.8
compatible version of django-browserid should be much easier.

Using a specific version release of django-browserid (vs the Git zip
archive for a specific revision) also means peep doesn't have to
re-download the package each time.
2015-04-27 14:30:22 +01:00
Ed Morley bf2566386c Bug 1158395 - Update Cython to v0.22
Changes:
https://github.com/cython/cython/blob/master/CHANGES.rst
https://github.com/cython/cython/compare/0.19.2...0.22
2015-04-27 14:23:59 +01:00
Ed Morley 915d7dc775 Bug 1158212 - Update New Relic Python agent to v2.50.0.39
v2.44.0.36 (11th Feb) -> v2.50.0.39 (6th April)

Brings improvements to SQL reporting, Django 1.8 support, improved
perf/resource usage in some cases.

For more info see:
https://docs.newrelic.com/docs/release-notes/agent-release-notes/python-release-notes
2015-04-27 14:17:46 +01:00
Ed Morley 45ba990542 Bug 1158766 - Pin datasource dependency using a tagged version not SHA
This is a no-op, the v0.6 release tag corresponds to the same revision,
it just avoids peeps SHA special-casing which causes continual
re-installation of the package & subsequent Travis cache invalidation.

https://github.com/jeads/datasource/releases/tag/v0.6
2015-04-27 12:46:25 +01:00
Ed Morley 5e10c031de Bug 1158202 - Update to treeherder-client v1.1
Changes:
f236a3487e...1.1

Using a specific version release of treeherder-client (vs the Git zip
archive for a specific revision) also means peep doesn't have to
re-download the package each time.
2015-04-24 16:39:33 +01:00
Ed Morley eaf0c2a792 Bug 1155160 - Remove script for generating the vendor directory
We're no longer using the vendor directory & this script wasn't entirely
reliable anyway, so let's remove it. The virtualenv package can be
removed from dev.txt, since virtualenv is installed globally, and
nothing inside our virtualenv (which is where the packages in dev.txt
end up) needs a local installation of it.
2015-04-22 11:23:32 +01:00
Ed Morley 0e188d4d9b Bug 1155160 - Stop referring to compiled vs pure packages
This differentiation was only useful when explaining which packages
could be listed in which requirements file (since compiled packages
could not be added to checked-in.txt). Now that all packages are peep
installed, common.txt contains both pure and compiled packages.
2015-04-22 11:23:06 +01:00
Ed Morley 8cdc06ec26 Bug 1155160 - Remove duplicate entry for the 'requests' package
Previously, the requests package had to be listed in dev.txt even
though it was in the vendor directory, since it was used by conftest.py
before the vendor directory was added to the Python path. Now that the
packages in checked-in.txt have been moved to common.txt, 'requests' is
listed in two requirements files that are peep installed, so we can
remove the dupe.
2015-04-22 11:23:00 +01:00
Ed Morley a5295870a8 Bug 1155160 - Move packages in checked-in.txt to common.txt
Now that we're using virtualenvs and peep to manage packages in
production, there's no need to use an in-repo vendor directory. As
such, all packages that were in checked-in.txt have been moved to
common.txt, so they will now be peep installed during deployment/testing
and also during the provision of the Vagrant environment.
2015-04-22 11:22:37 +01:00
Ed Morley 738de334c6 Bug 1070470 - Correct "Required by" comment for fancy-tag
fancy-tag is only required by 'django-browserid', not also 'responses'.
2015-04-16 14:04:37 +01:00
Ed Morley 9a68acd173 Bug 1154471 - Remove newrelic-plugin-agent from requirements/prod.txt
Since it has to be installed globally & run as a daemon, and so we have
no use for it in the virtualenv.

Reverts 37ae564296 from bug 1070470.
2015-04-15 16:24:59 +01:00
Ed Morley 52d5c4fb89 Bug 1153966 - Remove unused MozillaPulse, carrot & amqplib requirements 2015-04-14 00:22:33 +01:00
Ed Morley 0c9203555f Bug 1140882 - Remove gevent & greenlet from requirements
Since they are now unused.
2015-04-13 17:14:13 +01:00
Mauro Doglio 25b2cd935b Bug 1141551 - upgrade django version 1.7.7 2015-04-10 13:31:42 +01:00
Ed Morley f1aec89409 Bug 1143350 - Add peep hashes to the requirements files
The whole point of peep is that it errors out if (a) hashes aren't
specified for a package, or (b) the provided hash is incorrect. As
such before we can start using peep, we must add the hashes. The
requirements files are still compatible with pip, since it just
treats them like any other comment.
2015-03-19 12:12:05 +00:00
William Lachance bb2e7c4356 Bug 1144138 - Set a timeout for treeherder client requests
Before we would wait forever. Let's start with 120 seconds, we can always
modify in the future.
2015-03-17 16:01:02 -04:00
Ed Morley ac58bb3aa2 Bug 1143033 - Update packages in dev.txt 2015-03-14 22:14:41 +00:00
Ed Morley e1631abac8 Bug 1076710 - Remove socketio remnants
We're not currently using socketio - and if we start doing so in the
future we'll likely want to update to a newer version/adjust the
implementation anyway. Removing the dependencies from common.txt speeds
up the pip install on Travis. The old files will still be in version
control should we wish to refer to them :-)
2015-03-13 14:28:08 +00:00
Ed Morley 311e82aeb9 Bug 1070470 - Remove django-webtest from dev packages since it's unused
We use WebTest but not django-webtest.
2015-03-12 19:04:13 +00:00
Ed Morley eb6494f6b1 Bug 1070470 - Move six to dev.txt since it's not used in production 2015-03-12 19:04:13 +00:00
Ed Morley 2e0bf448eb Bug 1070470 - Explicitly list all packages and versions in docs.txt
Pins Sphinx to an exact version & explicitly lists all required
packages. Also updates sphinxcontrib-httpdomain from 1.1.7 to 1.3.0.
2015-03-12 19:04:13 +00:00
Ed Morley 37ae564296 Bug 1070470 - Add newrelic-plugin-agent to prod.txt
It is already installed in production; prod.txt now reflects reality.
2015-03-12 19:04:12 +00:00
Ed Morley 62ffc602a6 Bug 1070470 - Update newrelic version to that used in production 2015-03-12 19:04:12 +00:00
Ed Morley 71ed4c3ce0 Bug 1070470 - Rename compiled.txt to common.txt
The packages in this file are already a mixture of pure and compiled
packages. It's not worth moving the pure packages to checked-in.txt,
since we'll eventually be removing checked-in.txt and the associated
vendor/ and moving everything in there to this file. As such, common.txt
more accurately reflects the purpose of this file.
2015-03-12 19:04:11 +00:00
Ed Morley f4e1361ffa Bug 1070470 - Add inferred dependencies to requirements files
There were many packages that end up being installed via dependency
chains, that were not themselves listed in the requirements files. To
ensure determinism with pip (and to prevent errors with peep, since it
uses --no-deps by default), all packages must be listed explicitly.

I've avoided adding any more packages to checked-in.txt since we will
soon be deleting the vendor directory, so it seems silly to pollute it
further. compiled.txt is now rather unfortunately named, since it lists
packages that are pure and could have been in vendor/.

Versions have been set to match those currently used in production, or
in the case of blessings (which is not installed in production, we're
just lucky our use of mozlog does not hit the import & so haven't seen
the error), I've just set it to the latest available version.
2015-03-12 19:04:11 +00:00
Ed Morley a4248c53cb Bug 1070470 - Specify #egg= for dependencies from zip archives
Since peep doesn't like it if it's not set, plus it apparently helps pip
figure out sooner in the process whether a dependency is covered.
2015-03-12 19:04:10 +00:00
Ed Morley cd0214af49 Bug 1070470 - Use source archives rather than git for faster pip install
Using git+git means cloning the repo, trying to determine if the ref
specified is a tag or revision or branch etc. Instead Github provides
direct archive zips that are much faster when using pip install.
2015-03-12 19:04:10 +00:00
Ed Morley 77eb712b0b Bug 1070470 - Fix capitalisation of MozillaPulse to match PyPI 2015-03-12 19:04:09 +00:00
Ed Morley 76e2a56d95 Bug 1070470 - Remove duplicate jsonschema requirement
|jsonschema==2.4.0| is already listed higher up in the file.
2015-03-12 19:04:09 +00:00
Ed Morley ee58de7de5 Bug 1070470 - Remove argparse package since it's built into Python 2.7
See:
https://code.google.com/p/argparse/
2015-03-12 19:04:08 +00:00
Ed Morley 453b0f0c08 Bug 1070470 - Set explicit versions for all packages in requirements
For changes in compiled.txt, the version matches that installed globally
in production. For those in checked-in.txt I've used the version in
vendor/ which is actually different from that in production's global
site-packages, but is what we're actually using, since vendor/ is
earlier in the Python path.
2015-03-12 19:04:08 +00:00
Ed Morley 99c6a1a9d6 Bug 1070470 - Rename pure.txt to checked-in.txt
The packages in this file are those that have been checked in to
vendor/, and the new name makes this more obvious.
2015-03-12 19:04:07 +00:00
Cameron Dawson dd612f0005 Bug 1113873 - Add ``mozlog`` to requirements
This library is used to handle structured logs
2015-03-11 08:49:10 -07:00
Ed Morley 6273d32f7e Bug 1107523 - Run flake8 as part of the Travis build
flake8 is pyflakes+pep8. In a later PR I'll add a mention of it to the
docs - particularly how to set it up as a local git commit hook, but for
now I'm just keen to not regress the passing flake8 run. We may also
need to further tweak the ignore settings in setup.cfg if we find
certain warning types to be too annoying.
2015-03-05 13:51:49 +00:00
Ed Morley 694dc0dd10 Bug 1125585 - Update datasource to 2f09c9cc87
To pick up the version number bump. This doesn't change the contents of
vendor/datasource/ so in theory shouldn't be necessary. However prod
pip installs the requirements in pure.txt when it shouldn't, and the
vendor directory is later in python.path than site-packages, so we end
up using the version installed globally. Unfortunately some of the nodes
have an older version of datasource installed, but without the version
bump it's hard to tell which.
2015-02-18 15:46:41 +00:00
Cameron Dawson 0c45e01bf9 Bug 1119479 - Remove South 2015-02-10 11:34:07 -08:00
Cameron Dawson 698fd05519 Bug 1119479 - Upgrade to Django 1.7 2015-02-10 11:34:07 -08:00
Ed Morley a9188108ec Bug 1125585 - Update datasource to fab643e0d5
To pick up the new require_host_type config option:
https://github.com/jeads/datasource/pull/22

Also includes:
https://github.com/jeads/datasource/pull/17
2015-01-29 18:23:29 +00:00
mdoglio 6dc451372b Bug 1016117 - update celery and kombu version in requirements 2014-10-10 18:09:45 +01:00
Jonathan Eads 94bbbfb183 Bug 1016117 - Added/updated vendor libs to support publishing to pulse 2014-10-10 18:08:45 +01:00
mdoglio cb3d46df36 Bug 1072291 - handle 404 responses from json-pushes 2014-09-26 17:08:28 +01:00
Ed Morley 6ea4d2862b Bug 1032907 - Relax Sphinx version requirements 2014-08-26 17:10:02 +01:00
mdoglio e1d1a62f37 separate docs requirements from dev requirements 2014-08-26 16:28:55 +01:00
Cameron Dawson 3432fc2644 Add caching to endpoints that don't change much 2014-08-11 11:58:21 -07:00
mdoglio 8e0c47068c add log parsing status handling 2014-07-03 15:58:04 +02:00
Jonathan Eads 5676ff2ee8 new vendor lib 2014-05-30 14:49:41 -07:00
Mauro Doglio 6e1259ae8c Downgrade gunicorn version
18.0 isn't working on treeherder-dev
2014-05-20 11:57:41 +01:00
mdoglio c26f7f510d enable newrelic in wsgi when available 2014-05-16 18:31:28 +02:00
Jonathan Eads a97f1b6a2a updated sha for treeherder-client to include author property changes 2014-04-21 17:00:50 -07:00
Cameron Dawson d9527f7da5 updates per mdoglio's feedback 2014-04-17 13:28:54 -07:00
Cameron Dawson 611ee5b7c0 fix socket.io fetchJobs method to use GUID 2014-04-15 10:43:51 -07:00
mdoglio c7ddeed0f7 support exclusion profiles on the ui 2014-04-09 15:35:51 +01:00
mdoglio f2a11cfcb8 update thclient version 2014-03-10 19:38:03 +01:00
mdoglio 08105369ce update django-browserid version 2014-02-14 17:11:01 +00:00
Jonathan Eads 599b7ac06a changed argparse version requirement to preven python 2.6 related failure 2014-02-10 15:38:24 -08:00
Jonathan Eads d6bb075d72 removed unnecessary requirements 2014-02-04 10:02:30 -08:00
Jonathan Eads 27de2e2a4c new django_browserid requirements 2014-02-03 17:57:09 -08:00
Jonathan Eads 80e2c4d111 merged 2014-01-31 12:44:05 -08:00
vagrant 35be73269c made changes 2014-01-31 19:35:46 +00:00
mdoglio 7d75781531 update django-rest-framework and add swagger docs 2014-01-29 15:57:54 +00:00
Jonathan Eads 8fa7524d0c fixed oauth_required decorator 2014-01-28 14:33:05 -08:00
Jonathan Eads d0c8dbaac9 added stuff 2014-01-18 19:00:43 -08:00
Jonathan Eads 15ea648d53 updated vendor libs to include recent version of treeherder-client 2014-01-10 10:37:11 -08:00
Jonathan Eads 0fc9c386a2 added treeherder-client 2014-01-08 17:39:17 -08:00
Jonathan Eads e66e63c6d2 merged master 2014-01-08 17:34:23 -08:00
Jonathan Eads 601f46a22b added oauth requirements 2014-01-08 17:23:57 -08:00
mdoglio 327ed28648 improve environment setup via puppet 2014-01-07 15:24:35 +00:00
mdoglio 02395c9160 add argparse to requirements for py2.6 compatibility 2014-01-06 16:10:00 +00:00
mdoglio 0ff4a19477 change the gevent-socketio entry in requirements 2014-01-02 10:48:13 +01:00
mdoglio ac8689e178 add gevent-socketio machinery 2013-12-20 16:57:45 +00:00
Jonathan Eads 643a86e0d7 add oauth requirements 2013-12-17 16:10:08 -08:00
mdoglio b9eb464176 improve usability of the vagrant dev environment 2013-11-29 13:15:12 +00:00
mdoglio a180bca259 improve log parser performance using cython 2013-11-21 14:25:07 +00:00
mdoglio 82d46abcd1 update django-browserid version 2013-11-13 14:30:15 +00:00
mdoglio 4a8ec631c3 add persona authentication service 2013-08-13 16:06:00 +01:00
mdoglio 9a3a8fa9b1 add support for cors headers 2013-08-05 16:59:53 -07:00
mdoglio b7cf4d0b13 merge from master 2013-06-18 15:15:40 +02:00
Cameron Dawson 259521109d added datadiff module for diffing dicts. also new tinderboxprintline sub parser. 2013-06-10 16:44:49 -07:00
mdoglio 3edefd9f0c add simplejson to compiled requirements 2013-06-07 13:51:52 -04:00
mdoglio 4adc94b2fe add djangorestframework to pure requirements 2013-06-07 13:51:52 -04:00
mdoglio 1f0b3380e6 code cleaning 2013-05-15 13:54:42 +01:00
mdoglio 17d98479e2 add celery ecosystem 2013-05-13 19:19:19 +02:00
Cameron Dawson ce466a578d adding artifact test code and job model creation test code 2013-04-30 14:07:13 -07:00
Jonathan Eads 4b62e9f18f merged 2013-04-05 10:23:33 -07:00
Jonathan Eads ba56ab7540 new pulse consumer 2013-04-03 09:06:06 -07:00
mdoglio b7d194671b add sql-datasource; port datazilla sql datasource (with tests) to treeherder 2013-03-27 14:25:19 +00:00
mdoglio 5b8063cef8 add memcached setup 2013-03-26 16:24:38 +00:00
mdoglio 983932f1d9 update py version in dev requirements 2013-03-20 14:00:28 +00:00
mdoglio df70a95fa0 fix py.test version in dev requirements 2013-03-20 10:53:47 +00:00
mdoglio 8151206a2f upgraded pytest to use the new fixtures style 2013-03-19 18:59:00 +00:00
mdoglio ce4b07cb1d add south to pure requirements. install pure.txt inside the virtualenv 2013-03-11 16:44:52 +00:00
mdoglio 314a6b0ee6 add new line where missing 2013-03-06 17:19:12 +00:00
mdoglio ff8c73668c Add a vagrant setup for dev and a basic django webapp. 2013-03-06 17:08:21 +00:00