Граф коммитов

713 Коммитов

Автор SHA1 Сообщение Дата
Christopher Grebs 176383b168 Upgrade to Celery 4 (#6667)
* Update celery, config and dependencies to 4.x

* Remove usage of TaskSet, replace with group(), update `ampq`
* Enable redis on travis for better celery 4.x testing
* Fix lib/celery_tests
* Correct test testing email sending retrying on errors
* Fix celery subtask mocking errors.

* Fix celery broker url env variable

* Integrate watchdog for celery autoreload

* Ensure dependencies are updated for worker and web container.

* Restart all services after the dependency update

* Remove explicit celery loader environment variable.

* Restart all services in web and worker after running 'update_docker'

* Increase sleep time a bit
2017-10-16 11:16:41 +02:00
Mathieu Pillard 43d88b4f55 Revert "Upgrade to Celery 4 (#6625)"
This reverts commit 541688d5f2.

This caused some breakage on dev. We suspect it's because newrelic
hooks into the celery task launching code but does not support
celery 4.x yet.
2017-10-13 00:04:27 +02:00
Christopher Grebs 541688d5f2 Upgrade to Celery 4 (#6625)
* Update celery config to seamlessly upgrade to 4.x

* Update celery initialization for new configs and 4.x

* Update dependencies to celery 4.x

* Fix flake8

* Fix typo

* Remove usage of TaskSet, replace with group(), update `ampq`

* Enable redis on travis for better celery 4.x testing

* Fix more test setting names

* Fix lib/celery_tests

* Correct test testing email sending retrying on errors

* Fix celery subtask mocking errors.

* Fix new line

* Fix celery broker url env variable

* Integrate watchdog for celery autoreload

* Try something weird... ui-tests

* do we need extra hosts?

* more sleep?

* Try logging, try docker run to avoid port collisions

* More debugging

* Cleanup again

* Fix logs?

* Ensure dependencies are updated for worker and web container.

* Remove not functioning log saving for onw

* Restart all services after the dependency update
2017-10-12 21:05:21 +02:00
Christopher Grebs b90bf13922 Merge pull request #5791 from mozilla/1573-implement-django-jinja
Loads of clean-ups along the way.

Fixes #1573

* Moves all helpers modules to templatetags.jinja_helpers - there are a few things in there that aren't jinja related so there'll be a follow-up to split that later
* Update Jinja2 to 2.9.6
* Add django-jinja 2.3.1
* move some jingo-minify helpers to olympia.lib to avoid any jingo imports
* unified |f and |fe helpers into one |format_html helper that always escapes everything unless the input is already |safe

* Move helpers, add requirements, fix imports.
* Give backend a proper name
* Port f and fe filters from jingo
* Make start porting reviews jinja helpers module, make first test pass
* Get a handful more tests working, get rid of get_env, more and more jingo calls.
* Disable extension matching, render .txt templates too, fixes more stats tests
* Fix csv_header template to produce some reasonable and csv parsable
* Set trim_blocks to be compatible with jingo
* Unify |f and |fe into one |format that simplifies escaping rules. Update tests.

I think having one unified |format filter is beneficial, especially
given that our current escaping rules were kinda complicated and allowed
for seriously dangerous combinations even with autoescape activated.

Now everything passed as an argument to |format is explicitly escaped
unless marked as |safe, there's no way around that anymore.

* Naive first version using |format instead of |f and |fe, might need more review.
* Fix format for unicode strings
* Rename |format to |format_html
* Move nl2br_xhtml to amo.jinja_helpers, use it in all our templates.
* Move datetime filter to our code temporarily, fix mocks, fix recursive error
* Move csrf call to django_jinja csrf_token tag, fix addons templatetags
* Fix |class_selected usage, fix render_with to get registered
* Remove hack from zadmin, fix zadmin templatetags
* Fix user delete photo test, don't rely on proper context updates that happen in order.
* Fix more nl2br tests
* Fix detail page escape, django escapes differently than jinja
* Remove context from edit_review_reply_form
* Fix date created format filter usage
* Remove templates setting user, fix can_review
* Fix collect_add_widget to not inherit the global context
* Remove happy unicode client
* Cleanup can_review, add tests
* Fix tests, django use different html character for double quote escaping
* Switch to firefox latest to check ui-tests
* Cleanup and fix do_truncate
* Remove jingo, copy jingo-minify helpers that depend on jingo to our lib for now
* Rename nl2br_xhtml -> nl2br
* Jinja 2.9 compat for reviews truncate filter
* Don't use TEMPLATE_DEBUG
* Set default value for q, happens on index page.
* Fix jinja2 formatting with newstyle gettext
2017-06-30 17:57:31 -07:00
Christopher Grebs 130436572b Revert "Refactor debug locales to match addons-frontend, prepares for rtl support (#5402)"
This reverts commit 0ffc528ae5.
2017-05-16 22:58:56 +07:00
Christopher Grebs 0ffc528ae5 Refactor debug locales to match addons-frontend, prepares for rtl support (#5402)
* Update compile-mo.sh to understand dbr and dbl locales

* Cleanup omg_new_locale, add support for dbr and dbl debug locales.

* Remove dbg locale

* Add dbr and dbl debug locales

* Add support for dbr, dbl, fix setting for rtl to be LANGUAGES_BIDI as this is what django uses these days

* Remove temporary comment

* Improve debug message

* Disable clean checking for now

* Fix dbg and dbl extracted locales

* Fix dbl generation

* Fix tests

* Revert unnecessary change to zadmin.forms

* Remove cleanness check

* Remove dbr for now, it's horribly broken.

* Various cleanups according to comments
2017-05-16 22:01:46 +07:00
Mathieu Pillard a06590e4ba Log to console using mozlog json format in dev/stage/prod 2017-04-06 13:10:38 +02:00
Andrew Williamson 5e25fb7f3b add all celery queues used in CELERY_ROUTES to CELERY_QUEUES 2017-03-22 11:17:44 +01:00
Andrew Williamson eb8887fba4 Revert "define CELERY_QUEUES (#4946)" (#4995)
This reverts commit 2ac0ba9827.
2017-03-22 11:01:39 +01:00
Andrew Williamson 2ac0ba9827 define CELERY_QUEUES (#4946)
* change CELERY_DEFAULT_QUEUE to celery
* Remove 'update_webext_descriptions_all' celery route to test default routing
2017-03-22 11:00:32 +01:00
Mark Striemer 1134acc4c9 Redirect to next_path on register from mobile pages (fixes #4742) (#4747) 2017-02-23 12:19:27 -06:00
Mark Striemer 49601660f5 Support amo frontend auth more closely to production (#4681) 2017-02-17 10:08:30 -06:00
Christopher Grebs f42f51f8b7 fix(package): update clean-css to version 4.0.2 (#4504)
* fix(package): update clean-css to version 4.0.2

With v4.0 clean-css has split it's command line tools into a separate
package.

Closes #4475

* fix paths
2017-01-30 14:18:06 +01:00
Andy McKay 8cda544825 github validate hook again 2016-12-23 11:43:57 -08:00
Christopher Grebs 717ca578ce Add configured domain to ALLOWED_HOSTS. Fixes circleci tests and our runserver. (#3918)
* Add configured domain to ALLOWED_HOSTS. Fixes circleci tests and our runserver.
* Correctly map uitests to olympia.dev
2016-11-02 16:56:10 +01:00
Andrew Williamson be18b6cbdf Make all responses to email API return a validation response. (#3650) 2016-10-04 11:53:58 +01:00
Mark Striemer b6000cfcb0 Define FxA config names in settings_base.py (#3574) 2016-09-21 10:56:39 -05:00
Mark Striemer 1ee3c80093 Support development FxA config on dev (#3540) 2016-09-20 17:08:09 -05:00
Mark Striemer 2b5d8a09fe Update incorrect FXA_CONFIG redirect_urls 2016-09-14 17:49:33 -05:00
Mark Striemer c939ccbc67 Support multiple FxA configurations (fixes #3496)
Fixes #3505
2016-09-14 17:49:25 -05:00
Andrew Williamson a0facd5236 Add API endpoint to process POST email content and add to activity log;
emails received send notification emails;
review emails and notification emails can be replied to.
2016-09-13 18:29:43 +01:00
Stuart Colville 3c3c6470f7 Remove 'self' and https://addons.mozilla.org from script-src 2016-09-09 15:01:25 +01:00
Mathieu Pillard 2e85926e59 Set SERVICES_DOMAIN and SERVICES_URL correctly for local development 2016-07-20 14:05:22 +02:00
Mark Striemer b8b7475ba7 Use redirect_url not redirect_uri in internal auth (#2511) 2016-04-27 09:54:15 -05:00
Mark Striemer c64fba4c48 Internal login JSON API (fixes #2425) 2016-04-21 15:31:31 -05:00
Mark Striemer 0cffe96db7 Internal login start endpoint (fixes #2424) 2016-04-20 13:23:28 -05:00
Mark Striemer 0d1edc19f2 Allow setting the recursion limit with RECURSION_LIMIT (fixes #1911) 2016-03-15 17:31:26 +01:00
Christopher Grebs 74f14b492a Remove VALIDATE_ADDONS setting.
There's no need for it anymore.
2016-03-14 17:20:16 +01:00
Christopher Grebs 81845f9f84 First steps towards Django 1.7 support.
* Upgrade to Django 1.7.10
* Upgrade to Jingo 0.9
* Make sure the app minimalistically runs with Django 1.7
* Upgrades django-waffle and django-cache-machine
* Upgrades to a forked hack of django-piston
* Fixes systems checks
* update redisutils config
* Get rid of Jingo monkey patch.
* Update to proper SafeData support (which now supports __html__)
2016-02-24 17:11:46 +01:00
Christopher Grebs 0cbb294201 Rename addons-validator to addons-linter and update to latest release.
Fixes #1742
2016-02-24 10:53:26 +01:00
Stuart Colville f3a1c4b06c Enforce CSP in Production 2016-02-08 09:59:48 +00:00
Christopher Grebs e9fb38a665 Merge branch 'master' of github.com:mozilla/olympia into feature/restructure-modules 2016-02-04 19:43:32 +01:00
Stuart Colville 952effefb0 Revert "Enforce CSP on prod + stage" 2016-02-02 14:29:57 +00:00
Christopher Grebs 0130503f3e Merge branch 'master' of github.com:mozilla/olympia into feature/restructure-modules 2016-02-01 19:31:18 +01:00
Stuart Colville 9a911ca080 Enforce CSP on prod + stage 2016-01-29 18:37:47 +00:00
Christopher Grebs 4e11d67d09 Merge branch 'master' of github.com:mozilla/olympia into feature/restructure-modules 2016-01-25 09:20:46 +01:00
Stuart Colville 95cd64946d Enforce CSP on local-dev 2016-01-22 10:08:06 +00:00
Christopher Grebs 400d52eb86 Merge branch 'master' of github.com:mozilla/olympia into feature/restructure-modules 2016-01-22 06:49:19 +01:00
Mathieu Agopian 2c7679e944 Make it easier to enable the Django Debug Toolbar, and make it work with CSP 2016-01-21 16:05:57 +01:00
Christopher Grebs ea92a3d2d9 Merge branch 'master' of github.com:mozilla/olympia into feature/restructure-modules 2016-01-18 16:03:44 +01:00
Stuart Colville f6d8c0fabb Add font-src and fix default-src 2016-01-14 13:45:35 +00:00
Stuart Colville c81f1dfa71 Initial iframe settings for PayPal 2016-01-14 09:26:06 +00:00
Stuart Colville e57841601c CSP: Allow GA on www subdomain over http for local dev 2016-01-12 09:08:49 +00:00
Stuart Colville 52b0917194 Use the csp-report endpoint in addons-nginx 2016-01-11 17:30:32 +00:00
Christopher Grebs 580ccf7710 Update gitignore, updates to mock/patch import paths, minor fixes along the way. 2016-01-06 10:48:04 +01:00
Christopher Grebs 7ec38cc446 Update setup.cfg, fix package imports, syntax errors, various cleanups.
* Update installed apps, fix grouping and naming.
* Fix app-names in settings
* re-add startup import to manage.py for now

Various more import fixes, all import rewrites are now done.

This unfortunately still failes because of some circular imports
depending on django not being setup early enough.
2016-01-06 10:48:03 +01:00
Christopher Grebs 0734dbcf67 Install addons-validator and configure it's path. Fixes #881 2015-12-04 00:45:07 +01:00
Mark Striemer 6f8a211445 Redirect flow for FxA (fixes #984) 2015-11-27 17:04:17 -06:00
Mark Striemer 3f51470766 Account registration with FxA (fixes #867) 2015-11-26 13:25:11 -06:00
Mark Striemer 266e8f59b9 Pull FxA config from body[data-fxa-config] (fixes #862) 2015-11-25 14:25:31 -06:00