Граф коммитов

611 Коммитов

Автор SHA1 Сообщение Дата
William Durand 0333d7e7ab
Remove all references to `UpdateCount` (#14818) 2020-07-07 17:18:01 +02:00
Andrew Williamson 08cffa0760 clear more user data, after 24 hours; after 7 years for addon devs 2020-06-30 15:37:58 +01:00
Mathieu Pillard 8c19afb5ed
Notify developers if their submission is pending review after a few hours (#14398)
* Notify developers if their submission is pending review after a few hours

* Make default None to make migration backwards-compatible and add test on notified_about_auto_approval_delay

* Move migration
2020-06-01 13:07:23 +02:00
Andrew Williamson 3445e9a95f kinto -> remote settings or legacy 2020-05-20 16:00:49 +01:00
Andrew Williamson a2cc9924ec
Merge branch 'master' into 14094-auto-import-blocklist 2020-05-05 17:32:14 +01:00
Mathieu Pillard 9134ca3679
Refactor l10n extraction script to be ran in either manual or automatic mode (#14157)
* Refactor l10n extraction script to be ran in either manual or automatic mode

(Remove travis support for now as it never worked)
2020-05-05 11:14:09 +02:00
Andrew Williamson d187ff4b4c run import_blocklist on cron and update/delete existing blocks 2020-05-01 15:44:17 +01:00
William Durand 321b188a58
Add a new `git_extraction` command (#14021) 2020-04-24 17:51:36 +02:00
Andrew Williamson 8c599abe59
Submit bloom filter as kinto attachment with cron job (#13659)
* refactor generateMLBF and export_blocklist for generic use

* submit mlbf as attachment to kinto api

* waffle cron job; switch to secrets.token_hex; use Version.unfiltered

* update cron tests
2020-03-09 19:06:42 +00:00
bqbn fd2363f550 Remove dogwrap (#12793) 2019-11-05 17:10:06 +00:00
Christopher Grebs b9ac5f4413
Run dockerfile commands with correct user. (#12579)
This updates various things…

* make use o `--user` argument of pip and `$PYTHONUSERBASE` to install python libraries in the correct places where the `olympia` user has permissions
* Add a new `rootshell` command

Fixes #12366

* Correct if statement

* Use separate tag for easier testing

* Try running directly with user olympia

* Small cleanup

* Add docs

* Fix comment

* Add 'rootshell' command

* Build circleci for local dev

* Fix pip execution by using 'python -m' to fetch the correct pip

* Pick up upstream user/group for builds and implement PYTHONUSERBASE and PIP_USER

* Correctly pass USER_ID and GROUP_ID to Dockerfile when building

* Small cleanups

* Build our test branch

* Fall back to manual uploads for testing

* Cleanup

* Revert back to :latest tag
2019-10-22 11:24:05 +02:00
Andrew Williamson 0c9624b27e
l10n for secondary hero shelves (#12105)
* Expand extract_disco_strings to extract hero shelf content too

* add l10n support to seconday hero API
2019-08-16 17:22:27 +01:00
Mathieu Pillard 40c04548d3 Clear last_login_ip on users deleted for more than a year 2019-08-05 14:08:31 +02:00
Andrew Williamson b9af944d34
drop Personas model (#12009)
* drop Personas model

* didn't mean to commit this icon file

* Rename 1110-drop-migrated-lwt-constraint.sql to 1109-drop-migrated-lwt-constraint.sql
2019-08-05 10:54:50 +01:00
Christopher Grebs 67cdf4456b
Disable weekly risk recalculation from crontab for now.
Refs #11790
2019-08-01 16:03:12 +02:00
Christopher Grebs 1e0351c37c
Recalculate risk score for already confirmed add-ons regularly. (#11950)
* Recalculate risk score for already confirmed add-ons regularly.

Fixes #11790

* Update task to be run on Sunday, 3pm

* Cleanup, don't take deleted reports into account
2019-07-30 20:05:53 +02:00
Abhi-khandelwal 3c95af058b remove scripts/hash_requirements.py 2019-07-24 16:28:20 +05:30
Christopher Grebs 5423c6476c
Sign add-ons with recommendation signer based on DiscoveryItem. (#11627)
* Sign add-ons with recommendation signer based on DiscoveryItem.

This also prepares for the possibility that we may have to use different
credentials for the recommendations signer. In case we don't, ops only
has to set the creds twice which seems fair.

Fixes #11062

* Unify travis and docker-compose configs, test separate signer hawk creds

* Add end-to-end test for reviewer tools signing

* Enable autograph for reviewers-and-zadmin
2019-06-12 15:01:36 +02:00
Christopher Grebs a4a9e699a2
Sign recommended add-ons with specific autograph signer (#11587)
Fixes #11062

* Upgrade autograph to 3.3.2
* Configure a new signer for recommended add-ons
* Sign recommended add-ons
* Adapt to recent specs
2019-06-06 12:37:30 +02:00
Mathieu Pillard cbc1dda9a9 Run hide_disabled_files once per hour to catch files not moved correctly 2019-05-30 12:25:12 +02:00
Andrew Williamson a7a6d50be7
drop global stats and dashboard (#11047) 2019-03-28 17:00:20 +00:00
pyup.io bot 12ef19a886 Update pygit2 to 0.28.0 (#10962)
This PR updates [pygit2](https://pypi.org/project/pygit2) from **0.27.4** to **0.28.0**.



<details>
  <summary>Changelog</summary>
  
  
   ### 0.28.0
   ```
   -------------------------

- Upgrade to libgit2 0.28
  `878 &lt;https://github.com/libgit2/pygit2/issues/878&gt;`_

- Add binary wheels for Linux
  `793 &lt;https://github.com/libgit2/pygit2/issues/793&gt;`_
  `869 &lt;https://github.com/libgit2/pygit2/pull/869&gt;`_
  `874 &lt;https://github.com/libgit2/pygit2/pull/874&gt;`_
  `875 &lt;https://github.com/libgit2/pygit2/pull/875&gt;`_
  `883 &lt;https://github.com/libgit2/pygit2/pull/883&gt;`_

- New ``pygit2.Mailmap``, see documentation
  `804 &lt;https://github.com/libgit2/pygit2/pull/804&gt;`_

- New ``Repository.apply(...)`` wraps ``git_apply(..)``
  `841 &lt;https://github.com/libgit2/pygit2/issues/841&gt;`_
  `843 &lt;https://github.com/libgit2/pygit2/pull/843&gt;`_

- Now ``Repository.merge_analysis(...)`` accepts an optional reference parameter
  `888 &lt;https://github.com/libgit2/pygit2/pull/888&gt;`_
  `891 &lt;https://github.com/libgit2/pygit2/pull/891&gt;`_

- Now ``Repository.add_worktree(...)`` accepts an optional reference parameter
  `814 &lt;https://github.com/libgit2/pygit2/issues/814&gt;`_
  `889 &lt;https://github.com/libgit2/pygit2/pull/889&gt;`_

- Now it&#39;s possible to set SSL certificate locations
  `876 &lt;https://github.com/libgit2/pygit2/issues/876&gt;`_
  `879 &lt;https://github.com/libgit2/pygit2/pull/879&gt;`_
  `884 &lt;https://github.com/libgit2/pygit2/pull/884&gt;`_
  `886 &lt;https://github.com/libgit2/pygit2/pull/886&gt;`_

- Test and documentation improvements
  `873 &lt;https://github.com/libgit2/pygit2/pull/873&gt;`_
  `887 &lt;https://github.com/libgit2/pygit2/pull/887&gt;`_

Breaking changes:

- Now ``worktree.path`` returns the path to the worktree directory, not to the
  `.git` file within
  `803 &lt;https://github.com/libgit2/pygit2/issues/803&gt;`_

- Remove undocumented ``worktree.git_path``
  `803 &lt;https://github.com/libgit2/pygit2/issues/803&gt;`_
   ```
   
  
</details>


 

<details>
  <summary>Links</summary>
  
  - PyPI: https://pypi.org/project/pygit2
  - Changelog: https://pyup.io/changelogs/pygit2/
  - Repo: http://github.com/libgit2/pygit2
</details>
2019-03-25 11:53:37 +01:00
Benjamin Forehand Jr 2d99d6f3da
Fix ui tests for new nginx config (#10888)
* Fixes for Ui-tests using new nginx config.
2019-03-11 19:20:06 -04:00
Andreas Wagner bd3500a392
Fix flake8 errors outside src/ 2019-03-04 16:01:00 +01:00
Adrian Utrilla ec6aa0bb78
Remove dump_apps cron job 2019-02-07 13:31:49 +01:00
Christopher Grebs 86d992941f
Remove potools dependency, remove debug locales from travis extraction.
Refs #10443
2019-01-18 17:34:03 +01:00
Adrian Utrilla f3c0a824d9
Remove collection_subscribers cron job
It seems this doesn't exist anymore
2019-01-18 16:34:07 +01:00
Christopher Grebs 04fe02162d
Remove django-product-details dependency. (#10371)
* Add new olympia.core.languages module as a replacement for supported
  languages
* Implement new ApplicationsVersions.get_latest_application_version
helper

Fixes #9516 

Fixes #8850 along the way, removes the need for #8779 and unblocks #2739
2019-01-14 14:33:56 +01:00
Adrian Utrilla edf5ae8311
Remove compatibility_report cron job 2019-01-08 16:54:03 +01:00
bqbn 86b3bd0d55
Postpone statistics processing by a couple hours (#9971)
* Postpone statistics processing by a couple hours

Data pipeline may fail and retry, when that happens the cron may exit early
due to non-existing S3 files.

* Update the comment
2018-12-04 11:09:02 -08:00
Benjamin Forehand Jr be84dfbbfc
Fix circleci hostname script. (#10153) 2018-12-03 14:33:12 -05:00
Andreas Wagner 4d41645987
Automate weekly review report (#10034)
Fix #6474.
2018-11-23 13:51:04 +01:00
bqbn f5966c372c
Postpone the statistics related crons by 1.5 hours (#9780)
* Postpone the statistics related crons by 1.5 hours

Per https://bugzilla.mozilla.org/show_bug.cgi?id=1500280
Main reason is we now need a little more time to process the log files
due to issues mentioned in https://bugzilla.mozilla.org/show_bug.cgi?id=1493234
2018-10-23 09:38:38 -07:00
Christopher Grebs d6e85cea5a
Add pygit2 dependency. (#9497)
* Add debian stretch backports repo as discussed with @autrilla
* Add libgit2-dev dependency that's needed by pygit2 (via debian stretch
to get the proper version that's required by up-to-date pygit2)
* Add pygit 0.27.1

Fixes #9496
2018-09-24 13:15:49 +02:00
Mathieu Pillard 286773d13b Remove obsolete update_addons_collections_downloads cron 2018-08-17 00:24:13 +02:00
Mathieu Pillard 0ab1a95f5d
Merge pull request #9000 from diox/remove-update-collections-votes
Remove more obsolete collection features: stats, downloads, watchers & votes
2018-07-30 13:56:36 +02:00
Mathieu Pillard eba5e64422 Remove more obsolete collection features: stats, downloads, watchers & votes. 2018-07-30 13:39:38 +02:00
Mathieu Pillard dec7cc87f6 Remove more traces of redis 2018-07-30 11:30:13 +02:00
Greg Guthe 626a01c326
ci: run autograph with docker for travis 2018-07-27 10:47:11 -04:00
Christopher Grebs 30d1e994c3
Merge pull request #8916 from autrilla/cron-alerting
Add DataDog monitoring to cron job runs
2018-07-19 10:37:42 +02:00
Adrian Utrilla 80162fd636 Add DataDog monitoring to cron job runs 2018-07-19 10:16:59 +02:00
Christopher Grebs b45ed1a557
Merge pull request #8818 from diox/discovery-editorialized-recommendations-extract-translations-enable
Start extracting discovery pane editorialized recommendations
2018-07-17 07:34:41 +02:00
Benjamin Forehand Jr cafc5d0519
Add UI devhub login and upload tests (#8559)
* Added devhub login and upload tests.
* Add ui-test webext.
* Remove management commands.
2018-07-13 08:55:40 -04:00
Christopher Grebs 7407b70aa2
Update to Django 1.11 (#8738)
Port code and tests to Django 1.11.

* Update requirements to Django 1.11.14, remove session_csrf
* Use --run-syncdb for migration calls
* Remove unused setup-docker script
* Port code and tests to Django 1.11.
* Remove django-session-csrf everywhere, it got replaced by django's own
  session csrf protection
* Make sure we are calling `client.get()` with `follow=True` where necessary
* Replace django.core.urlresolvers import with django.urls
* Port custom `IconWidgetRenderer` to Django 1.11 as `IconTypeSelect`
* Properly use `_queryset_class` for custom manager classes
* Make use of `base_manager_name` on our models `Meta` instead of `use_for_related_objects`
  on the manager where appropriate. This is required to make translations, soft-delete
  and more work. See comment on Addons.Meta for more details.
* Various fixes along the way to make tests work
* Port form errors for locale editing forms to Django 1.11 and make use of
  form.add_error instead of our own custom process
* Mark TestDetailPage.test_304 as xfail for now, somehow Etags seem to be broken
  for that view during tests but work fine in manual tests
* Fix amo.celery, we cannot have any imports at the module-level that may
  import the ORM
* Fix global_settings context processor for 500-server error cases
* Fix `changed_data` handling in `AMOModelForm`
* Remove `queryset_transform` and implement it directly in amo/models
* Fix pagination, Django changed how `num_pages` work and how `count` can be overwritten
* Add a new test that tests database transforms as `BaseQuerysetTestCase`
* Make sure `legacy_redirect` only appends `?` if there are actual GET parameters
* Re-implement `LicenseRadioChoiceInput` as `LicenseRadioSelect` which is now Django 1.11 compatible
* Remove our custom `form_kwargs` uplift from Django 1.9
* Correct how we're using `Category.objects.create` and only pass `db_name` instead of `name`, previously
  this didn't error but now it (luckily!) does
* Update `FileSelectWidget` to correctly work with Django 1.11, use custom rendering
* Fix decorator ordering for `files.views:browse`
* Update database settings to correctly use `TEST` object
* Fix `select_related` call in `RatingViewSet`
* Remove custom `DateTimeCast` implementation
* Fix `addon_factory` calls in `reviewers/tests/test_views.py` to correctly set
  `is_webextension`
* Port our `TranslationDescriptor` and `TranslatedField` to Django 1.11. Also, make sure form error handling works
* Add a new test that checks that `default=None` is a valid setting for translation fields
* Add a new test that checks that translations from related fields are correctly fetched
* Remove possible ambiguity from translations `TestWidget` tests
* Make sure that the correct `MEDIA_URL` is set in `TestDownloadsUnlistedVersions` to fix
  external cdn tests

* Remove custom happyforms code. Django cleans text fields now by default
* Move translations app to the top of INSTALLED_APPS, add a lengthy comment
* Pass additional arguments to contribute_to_class, fix smaller nits
* Set MEDIA_URL and STATIC_URL to an external value by default. That's how they're configured in dev, stage and prod anyway.

Please note that we didn't replace all our custom form rendering with proper templated widgets yet. This will
happening in some follow-up work.

Fixes #5271, Fixes #1569
2018-07-11 06:56:54 +02:00
Mathieu Pillard f4e96b74f4 Start extracting discovery pane editorialized recommendations 2018-07-10 20:47:26 +02:00
Mathieu Pillard 9d7d6e73f8 Add the command to the extraction process, but commented out for now 2018-07-06 19:50:34 +02:00
Mathieu Pillard 7faada75cf Remove code related to Firefox hotfixes, they are no longer used
They were replaced by system add-ons, which operate outside AMO.
2018-06-28 17:23:44 +02:00
Christopher Grebs 8068fe1185
Upgrade gimme and point go to 'stable' (1.10.3 currently) release.
This plus mozilla-services/autograph#103 should fix our recent build
problems.

autograph ci will use the 'stable' flag for their CI too so that we're
in-sync and should see failures fairly quickly.
2018-06-28 14:30:57 +02:00
Christopher Grebs 959a9e704a
Fix autograph, test... 2018-06-25 20:04:16 +02:00
Andrew Williamson fd916c252e
split local dependencies from pure test dependencies and only test deps in travis (#8639) 2018-06-25 11:53:45 +01:00