Π“Ρ€Π°Ρ„ ΠΊΠΎΠΌΠΌΠΈΡ‚ΠΎΠ²

35 ΠšΠΎΠΌΠΌΠΈΡ‚ΠΎΠ²

Автор SHA1 Π‘ΠΎΠΎΠ±Ρ‰Π΅Π½ΠΈΠ΅ Π”Π°Ρ‚Π°
Christopher Grebs c2b7f30d24
Add autograph signing server support (#6865)
Fixes #6640
Fixes #6866

This pull request adds support for our new Autograph signing server, adds it to our dockerized services and adds tests that now actually call our signing server.

* Add a waffle-switch for calls to our new autograph signing server
* Add the autograph signing server to docker-compose
* Add the autograph signing server to our travis setup
* avoid us specifying the signing server settings everywhere in the code, one single source of truth
* more use of `responses` instead of mocking, leaning towards
  the future where we can actually hit a signing server instead
  of a mock
* disallow http requests generically, unless configured otherwise
* Add migration for waffle flag
2017-11-13 17:29:57 +01:00
Christopher Grebs 176383b168 Upgrade to Celery 4 (#6667)
* Update celery, config and dependencies to 4.x

* Remove usage of TaskSet, replace with group(), update `ampq`
* Enable redis on travis for better celery 4.x testing
* Fix lib/celery_tests
* Correct test testing email sending retrying on errors
* Fix celery subtask mocking errors.

* Fix celery broker url env variable

* Integrate watchdog for celery autoreload

* Ensure dependencies are updated for worker and web container.

* Restart all services after the dependency update

* Remove explicit celery loader environment variable.

* Restart all services in web and worker after running 'update_docker'

* Increase sleep time a bit
2017-10-16 11:16:41 +02:00
Mathieu Pillard 43d88b4f55 Revert "Upgrade to Celery 4 (#6625)"
This reverts commit 541688d5f2.

This caused some breakage on dev. We suspect it's because newrelic
hooks into the celery task launching code but does not support
celery 4.x yet.
2017-10-13 00:04:27 +02:00
Christopher Grebs 541688d5f2 Upgrade to Celery 4 (#6625)
* Update celery config to seamlessly upgrade to 4.x

* Update celery initialization for new configs and 4.x

* Update dependencies to celery 4.x

* Fix flake8

* Fix typo

* Remove usage of TaskSet, replace with group(), update `ampq`

* Enable redis on travis for better celery 4.x testing

* Fix more test setting names

* Fix lib/celery_tests

* Correct test testing email sending retrying on errors

* Fix celery subtask mocking errors.

* Fix new line

* Fix celery broker url env variable

* Integrate watchdog for celery autoreload

* Try something weird... ui-tests

* do we need extra hosts?

* more sleep?

* Try logging, try docker run to avoid port collisions

* More debugging

* Cleanup again

* Fix logs?

* Ensure dependencies are updated for worker and web container.

* Remove not functioning log saving for onw

* Restart all services after the dependency update
2017-10-12 21:05:21 +02:00
Benjamin Forehand Jr d6bb402a44 Updated UI-tests to run inside of docker and switched to circleci 2.0 (#6457)
* Updated config to use circleci as well as configure ui-tests to run within docker

* Removed hacky certifi installs

* Update requirements to master versions

Fixes #4697 (though not only that)
2017-10-05 13:14:08 +02:00
Christopher Grebs 97342f6a86
Unify and set mysqld collation settings to utf-8.
Fixes #6183
2017-08-17 09:18:06 +02:00
Christopher Grebs ee685116c6
Limit memory ElasticSearch consumes to ~1G, hard limit container to 1G. 2017-07-26 16:18:29 +02:00
Christopher Grebs c35648da19 Potentially fix our reindex issue on -dev.
It took me days to find this and loads of useless refactoring but
apparently these tasks get immediately upgraded to a chord after we
chain them later with the other tasks (after the for-loop).

And, the only requirement for a chord is: do not ignore the results,
never!

Refs #3960

* Make sure index_stats isn't using call_command
* modernize create_subtasks, add support for countdowns, fix queries loading the world...
* half chunk size for stats reindexing
* Refactor stats reindex logging
* Upgrade elasticsearch to 5.4.1 for our docker config
* Make es test setup easier to inherit for our uitests.
* Restore order, make sure to start es before add-on get's created.
* Remove db requirement from es_test fixture
2017-06-16 12:06:12 +08:00
Christopher Grebs efc66b997c Update ElasticSearch, travis and docker-compose configs
* Bump elasticsearch in travis to 2.3.3
* Fix index store config option for es 2.3.3
* Install es 5.1.1
* Fix es reference in travis.yml
* Fix es startup
* Let's try and switch to use jdk8
* Fix bulk_index import
* Set es 5.1 for docker compose too
* Fix docker image to use official elastic images.
* small travis cleanup
* Make sure xpack authentication is disabled for testing (for now)
* Let's try disabling xpack on travis too...
* Stupid hack to support es5 default auth on travis...
* Remove custom travis_es script
* Use ES 5.3 for now...
2017-06-16 12:01:32 +08:00
bqbn 7e6b0a532e Upgrade mysql to v5.7 (#4487) 2017-01-30 12:02:32 -08:00
Stuart Colville ca1fc1a343 Add docs for docker for mac + windows and change port config 2016-09-02 18:28:41 +01:00
Mathieu Pillard ebbc8d3361 Bump elasticsearch version in docker to match other envs 2016-06-21 18:31:26 +01:00
Christopher Grebs 31e104b1ad Set OLYMPIA_SITE_URL to olympia.dev by default. (#2826)
This may fix #2792.
2016-06-02 09:37:03 +02:00
Jason Thomas b793be96bf Change default CELERY_RESULT_BACKEND to redis 2016-05-13 12:37:15 -04:00
Mark Striemer 0d1edc19f2 Allow setting the recursion limit with RECURSION_LIMIT (fixes #1911) 2016-03-15 17:31:26 +01:00
Christopher Grebs 0bc619d312 Fix #1747, remove single quotes as they aren't interpreted as quotes. 2016-02-24 17:45:35 +01:00
Christopher Grebs abac5ea5b3 Update redis configuration.
Use urls from environment and convert them to dictionaries
for redisutil.
2016-02-24 17:13:31 +01:00
Christopher Grebs 81845f9f84 First steps towards Django 1.7 support.
* Upgrade to Django 1.7.10
* Upgrade to Jingo 0.9
* Make sure the app minimalistically runs with Django 1.7
* Upgrades django-waffle and django-cache-machine
* Upgrades to a forked hack of django-piston
* Fixes systems checks
* update redisutils config
* Get rid of Jingo monkey patch.
* Update to proper SafeData support (which now supports __html__)
2016-02-24 17:11:46 +01:00
Kumar McMillan b1c2111262 Update docker image source 2016-02-09 15:16:49 -06:00
Stuart Colville 0eb1637fb3 Fix moz_header CSS refs 2016-01-12 14:46:34 +00:00
Christopher Grebs de65bad022 Fix rabbitmq container configuration, use correct 'expose' format. 2015-12-10 06:32:43 -05:00
Christopher Grebs 8746752006 Pin rabbitmq, redis and memcached images to use our prod-like versions. 2015-12-03 17:52:39 +01:00
Stuart Colville ec4ef86316 Remove name for rabbitmq to fix validation error 2015-11-23 18:27:14 +00:00
Kumar McMillan cb047c39c3 Add SITE_URL to local server from environ variable 2015-10-30 12:39:15 -05:00
Andy McKay bed5082225 run celery through supervisord, plus we can see logs 2015-10-27 14:18:19 -07:00
Kumar McMillan f6a973f753 Lock mysql image into 5.6
The mysql:latest image just got bumped to 5.7 which we're not ready to run yet
2015-10-26 10:38:36 -05:00
Andy McKay dbe399ab6e add in nginx and listen on port 80 2015-10-02 14:15:13 -07:00
Stuart Colville 5bf6773865 Use supervisord for runserver in docker 2015-09-18 12:59:08 +01:00
Stuart Colville 63e035bf25 Run from the hub build 2015-09-16 15:49:40 +01:00
Mark Striemer d547f71ee5 Use the new celery command with docker 2015-09-10 10:18:39 -05:00
Mark Striemer e62be1776e Support rabbitmq/celery with docker 2015-08-26 11:12:48 -05:00
Kris Maglione 4804f14dff Make Docker runs friendlier to the contents of the host filesystem, particularly for Linux users. 2015-08-07 21:35:52 -07:00
Kris Maglione d881f53917 Fix Docker build to use a more recent version of PIP, and clean up Dockerfile to avoid unnecessary image cache busting and file copying. 2015-08-07 21:35:50 -07:00
Mathieu Agopian ead24008a5 Use mkt's centos base images for our docker installs (bug 1162462) 2015-05-12 16:07:03 +02:00
Mathieu Agopian 9d4d2ae38f Fig deprecated in favor of docker-compose, better Dockerfile 2015-03-18 12:30:38 +01:00