Граф коммитов

630 Коммитов

Автор SHA1 Сообщение Дата
Andrew Williamson 261f4f8e36
Use DB sessions; store refresh tokens in session; use for frontend auth too (#18475)
* Use DB sessions; store refresh tokens in session; use for frontend auth too

* add clearsessions to cron

* return ERROR_SIGNATURE_EXPIRED for every scenerio that can be expiring sessions

* fix tests after default_fxa_login_url removed

* Return ERROR_AUTHENTICATION_EXPIRED for SessionIDAuthentication problems
2022-01-25 18:24:19 +00:00
Andrew Williamson ef84f771bf
use modern syntax in gen-cron.py; format consistently (#18667)
* use modern syntax in gen-cron.py; format consistently

* change to format from f string; add test
2022-01-24 13:04:55 +00:00
Andrew Williamson d1fba99ab5
rm import (legacy) blocklist feature (#17841) 2021-09-10 14:44:22 +01:00
Andrew Williamson 80f526e840
run pyupgrade (#17603)
* let pyupgrade work as command line tool

* run_pyupgrade and black on src/ tests/ services/

* delete the comment as absolute_import is gone
2021-08-05 15:00:44 +01:00
Mathieu Pillard d4bace5c89
Replace legacy assets cachebusting by staticfiles's ManifestStaticFilesStorage from django (#17464)
* Replace legacy assets cachebusting by staticfiles's ManifestStaticFilesStorage from django

* Run tests without ManifestStaticFilesStorage

* Fix tests

* Reformatting

* It's fine, since collectstatic also copies the original

* Register static directly

* Reformat comment
2021-07-12 16:06:20 +02:00
Andrew Williamson 1435930206
enable sitemap generation cron (#17247)
* enable sitemap generation cron

* change time to 23:00
2021-06-11 16:48:14 +01:00
William Durand 13dcd75c97
Remove category_totals cron (#16592) 2021-02-22 19:49:40 +01:00
Andrew Williamson de374c4ceb
drop AppSupport model (#16326)
* drop AppSupport model

* in language-tools api, application param only mandatory for appversion, and ignored otherwise

* Delete 0029_delete_appsupport.py
2021-01-19 16:07:59 +00:00
William Durand 2a3ce33286
Migrate to Circle CI (#16189) 2020-12-18 12:13:48 +01:00
William Durand 5f00968a39
Remove legacy download stats (#15664) 2020-10-13 11:19:28 +02:00
Andrew Williamson 68f49f8f2a
sign promoted addons for specific applications, where available (#15364) 2020-08-26 13:54:41 +01:00
bqbn 37479685e0
Fix 15135 (#15240)
* Fix 15135

Remove the `update_addon_total_downloads` per https://github.com/mozilla/addons-server/issues/15135#issuecomment-670196397

* Update the run time for update_addon_weekly_downloads
2020-08-11 17:18:29 +01:00
Andrew Williamson 7ef68fe745
sign addons as promoted via the autograph recommended signer (#15221) 2020-08-07 18:02:13 +01:00
Andreas Wagner e59e468ce8
Remove legacy file viewer (#15180) 2020-08-05 16:41:11 +02:00
Mathieu Pillard a22f9fb7ce
Notify developers again about pending rejection as they get close to the deadline (#15128)
* Notify developers again about pending rejection as they get close to the deadline

Only one notification is sent per "batch" of pending rejections, until a new
delayed rejection is scheduled.

* Make user_factory() less likely to hit username/email collisions

* Add crontab (and remove old one about info requests)

* Update logger name
2020-08-03 17:49:24 +02:00
William Durand 733d31e1c7
Use BigQuery in `weekly_downloads()` cron task (#15045) 2020-07-27 14:40:31 +02:00
Piotr Zarycki 97b0875004
Rename delivery_hotness cron task to update_addon_hotness (#15065) 2020-07-27 10:41:29 +02:00
William Durand 7ed40d8223
Use weekly_downloads and skip update task when flag/switch are active (#15056) 2020-07-24 17:33:34 +02:00
Mathieu Pillard 931852cd05
Implement delayed review rejections in reviewer tools (#14968)
* Implement delayed review rejections in reviewer tools

This removes the ability to have an info request with a deadline, and
instead makes it possible to delay review rejections when using the
reject multiple versions action.
2020-07-17 13:15:55 +02:00
William Durand 0333d7e7ab
Remove all references to `UpdateCount` (#14818) 2020-07-07 17:18:01 +02:00
Andrew Williamson 08cffa0760 clear more user data, after 24 hours; after 7 years for addon devs 2020-06-30 15:37:58 +01:00
Mathieu Pillard 8c19afb5ed
Notify developers if their submission is pending review after a few hours (#14398)
* Notify developers if their submission is pending review after a few hours

* Make default None to make migration backwards-compatible and add test on notified_about_auto_approval_delay

* Move migration
2020-06-01 13:07:23 +02:00
Andrew Williamson 3445e9a95f kinto -> remote settings or legacy 2020-05-20 16:00:49 +01:00
Andrew Williamson a2cc9924ec
Merge branch 'master' into 14094-auto-import-blocklist 2020-05-05 17:32:14 +01:00
Mathieu Pillard 9134ca3679
Refactor l10n extraction script to be ran in either manual or automatic mode (#14157)
* Refactor l10n extraction script to be ran in either manual or automatic mode

(Remove travis support for now as it never worked)
2020-05-05 11:14:09 +02:00
Andrew Williamson d187ff4b4c run import_blocklist on cron and update/delete existing blocks 2020-05-01 15:44:17 +01:00
William Durand 321b188a58
Add a new `git_extraction` command (#14021) 2020-04-24 17:51:36 +02:00
Andrew Williamson 8c599abe59
Submit bloom filter as kinto attachment with cron job (#13659)
* refactor generateMLBF and export_blocklist for generic use

* submit mlbf as attachment to kinto api

* waffle cron job; switch to secrets.token_hex; use Version.unfiltered

* update cron tests
2020-03-09 19:06:42 +00:00
bqbn fd2363f550 Remove dogwrap (#12793) 2019-11-05 17:10:06 +00:00
Christopher Grebs b9ac5f4413
Run dockerfile commands with correct user. (#12579)
This updates various things…

* make use o `--user` argument of pip and `$PYTHONUSERBASE` to install python libraries in the correct places where the `olympia` user has permissions
* Add a new `rootshell` command

Fixes #12366

* Correct if statement

* Use separate tag for easier testing

* Try running directly with user olympia

* Small cleanup

* Add docs

* Fix comment

* Add 'rootshell' command

* Build circleci for local dev

* Fix pip execution by using 'python -m' to fetch the correct pip

* Pick up upstream user/group for builds and implement PYTHONUSERBASE and PIP_USER

* Correctly pass USER_ID and GROUP_ID to Dockerfile when building

* Small cleanups

* Build our test branch

* Fall back to manual uploads for testing

* Cleanup

* Revert back to :latest tag
2019-10-22 11:24:05 +02:00
Andrew Williamson 0c9624b27e
l10n for secondary hero shelves (#12105)
* Expand extract_disco_strings to extract hero shelf content too

* add l10n support to seconday hero API
2019-08-16 17:22:27 +01:00
Mathieu Pillard 40c04548d3 Clear last_login_ip on users deleted for more than a year 2019-08-05 14:08:31 +02:00
Andrew Williamson b9af944d34
drop Personas model (#12009)
* drop Personas model

* didn't mean to commit this icon file

* Rename 1110-drop-migrated-lwt-constraint.sql to 1109-drop-migrated-lwt-constraint.sql
2019-08-05 10:54:50 +01:00
Christopher Grebs 67cdf4456b
Disable weekly risk recalculation from crontab for now.
Refs #11790
2019-08-01 16:03:12 +02:00
Christopher Grebs 1e0351c37c
Recalculate risk score for already confirmed add-ons regularly. (#11950)
* Recalculate risk score for already confirmed add-ons regularly.

Fixes #11790

* Update task to be run on Sunday, 3pm

* Cleanup, don't take deleted reports into account
2019-07-30 20:05:53 +02:00
Abhi-khandelwal 3c95af058b remove scripts/hash_requirements.py 2019-07-24 16:28:20 +05:30
Christopher Grebs 5423c6476c
Sign add-ons with recommendation signer based on DiscoveryItem. (#11627)
* Sign add-ons with recommendation signer based on DiscoveryItem.

This also prepares for the possibility that we may have to use different
credentials for the recommendations signer. In case we don't, ops only
has to set the creds twice which seems fair.

Fixes #11062

* Unify travis and docker-compose configs, test separate signer hawk creds

* Add end-to-end test for reviewer tools signing

* Enable autograph for reviewers-and-zadmin
2019-06-12 15:01:36 +02:00
Christopher Grebs a4a9e699a2
Sign recommended add-ons with specific autograph signer (#11587)
Fixes #11062

* Upgrade autograph to 3.3.2
* Configure a new signer for recommended add-ons
* Sign recommended add-ons
* Adapt to recent specs
2019-06-06 12:37:30 +02:00
Mathieu Pillard cbc1dda9a9 Run hide_disabled_files once per hour to catch files not moved correctly 2019-05-30 12:25:12 +02:00
Andrew Williamson a7a6d50be7
drop global stats and dashboard (#11047) 2019-03-28 17:00:20 +00:00
pyup.io bot 12ef19a886 Update pygit2 to 0.28.0 (#10962)
This PR updates [pygit2](https://pypi.org/project/pygit2) from **0.27.4** to **0.28.0**.



<details>
  <summary>Changelog</summary>
  
  
   ### 0.28.0
   ```
   -------------------------

- Upgrade to libgit2 0.28
  `878 &lt;https://github.com/libgit2/pygit2/issues/878&gt;`_

- Add binary wheels for Linux
  `793 &lt;https://github.com/libgit2/pygit2/issues/793&gt;`_
  `869 &lt;https://github.com/libgit2/pygit2/pull/869&gt;`_
  `874 &lt;https://github.com/libgit2/pygit2/pull/874&gt;`_
  `875 &lt;https://github.com/libgit2/pygit2/pull/875&gt;`_
  `883 &lt;https://github.com/libgit2/pygit2/pull/883&gt;`_

- New ``pygit2.Mailmap``, see documentation
  `804 &lt;https://github.com/libgit2/pygit2/pull/804&gt;`_

- New ``Repository.apply(...)`` wraps ``git_apply(..)``
  `841 &lt;https://github.com/libgit2/pygit2/issues/841&gt;`_
  `843 &lt;https://github.com/libgit2/pygit2/pull/843&gt;`_

- Now ``Repository.merge_analysis(...)`` accepts an optional reference parameter
  `888 &lt;https://github.com/libgit2/pygit2/pull/888&gt;`_
  `891 &lt;https://github.com/libgit2/pygit2/pull/891&gt;`_

- Now ``Repository.add_worktree(...)`` accepts an optional reference parameter
  `814 &lt;https://github.com/libgit2/pygit2/issues/814&gt;`_
  `889 &lt;https://github.com/libgit2/pygit2/pull/889&gt;`_

- Now it&#39;s possible to set SSL certificate locations
  `876 &lt;https://github.com/libgit2/pygit2/issues/876&gt;`_
  `879 &lt;https://github.com/libgit2/pygit2/pull/879&gt;`_
  `884 &lt;https://github.com/libgit2/pygit2/pull/884&gt;`_
  `886 &lt;https://github.com/libgit2/pygit2/pull/886&gt;`_

- Test and documentation improvements
  `873 &lt;https://github.com/libgit2/pygit2/pull/873&gt;`_
  `887 &lt;https://github.com/libgit2/pygit2/pull/887&gt;`_

Breaking changes:

- Now ``worktree.path`` returns the path to the worktree directory, not to the
  `.git` file within
  `803 &lt;https://github.com/libgit2/pygit2/issues/803&gt;`_

- Remove undocumented ``worktree.git_path``
  `803 &lt;https://github.com/libgit2/pygit2/issues/803&gt;`_
   ```
   
  
</details>


 

<details>
  <summary>Links</summary>
  
  - PyPI: https://pypi.org/project/pygit2
  - Changelog: https://pyup.io/changelogs/pygit2/
  - Repo: http://github.com/libgit2/pygit2
</details>
2019-03-25 11:53:37 +01:00
Benjamin Forehand Jr 2d99d6f3da
Fix ui tests for new nginx config (#10888)
* Fixes for Ui-tests using new nginx config.
2019-03-11 19:20:06 -04:00
Andreas Wagner bd3500a392
Fix flake8 errors outside src/ 2019-03-04 16:01:00 +01:00
Adrian Utrilla ec6aa0bb78
Remove dump_apps cron job 2019-02-07 13:31:49 +01:00
Christopher Grebs 86d992941f
Remove potools dependency, remove debug locales from travis extraction.
Refs #10443
2019-01-18 17:34:03 +01:00
Adrian Utrilla f3c0a824d9
Remove collection_subscribers cron job
It seems this doesn't exist anymore
2019-01-18 16:34:07 +01:00
Christopher Grebs 04fe02162d
Remove django-product-details dependency. (#10371)
* Add new olympia.core.languages module as a replacement for supported
  languages
* Implement new ApplicationsVersions.get_latest_application_version
helper

Fixes #9516 

Fixes #8850 along the way, removes the need for #8779 and unblocks #2739
2019-01-14 14:33:56 +01:00
Adrian Utrilla edf5ae8311
Remove compatibility_report cron job 2019-01-08 16:54:03 +01:00
bqbn 86b3bd0d55
Postpone statistics processing by a couple hours (#9971)
* Postpone statistics processing by a couple hours

Data pipeline may fail and retry, when that happens the cron may exit early
due to non-existing S3 files.

* Update the comment
2018-12-04 11:09:02 -08:00
Benjamin Forehand Jr be84dfbbfc
Fix circleci hostname script. (#10153) 2018-12-03 14:33:12 -05:00