Граф коммитов

657 Коммитов

Автор SHA1 Сообщение Дата
Kevin Meinhardt aa31195786
Remove egg-info without breaking locale extraction (#22384)
* Remove egg-info without breaking locale extraction

* Merge setup to pyproject
2024-06-21 15:19:29 +02:00
Kevin Meinhardt 59156f8674
Stability fixes for docker compose lifecycle (#22378)
* Stability fixes for docker compose lifecycle

* Update docs/topics/development/setup_and_configuration.md

Co-authored-by: Andrew Williamson <awilliamson@mozilla.com>

* TMP: response to comments

* Update docs/topics/development/setup_and_configuration.md

Co-authored-by: William Durand <will+git@drnd.me>

---------

Co-authored-by: Andrew Williamson <awilliamson@mozilla.com>
Co-authored-by: William Durand <will+git@drnd.me>
2024-06-21 14:22:42 +02:00
Kevin Meinhardt 215d96a43e
Fix-pip-packages (#22344)
* Fix invalid syntax and missing context in check pip packages

* Update scripts/check_pip_packages.sh

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>

---------

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-06-11 12:53:07 +02:00
Andreas Wagner 2bbb6ff52c
Hard-code super user name and email (#22296) 2024-06-05 18:20:59 +02:00
Kevin Meinhardt 299dc4922b
More efficient utilization of github action cache (#22314)
* More efficient utilization of github action cache

* Set cache from/to only in CI

* Update Dockerfile

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>

---------

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-06-05 14:48:42 +02:00
Kevin Meinhardt f4bdaec5bb
Add configurable compose file to make up flow (#22299) 2024-05-30 13:02:26 +02:00
Kevin Meinhardt ddade2a62b
Fix Docker build and add concurrency limit (#22273)
* Fix Docker build:
- get correct Image ID from the build.
- set docker tag correctly supporting tag and digest
- add concurrency limit to github action ci jobs

* TMP: remove easy way to get build digest as it is not really intended for local dev

* Update .circleci/config.yml

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>

* TMP: recomment build

---------

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-05-24 10:09:09 +02:00
Kevin Meinhardt d3b3a50ac5
Docker digest (#22260)
* Refactor unified setup script to manage .env and version.json files in readable python

* Support using digest to run docker image

* Update scripts/setup.py

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>

* TMP: build image

* TMP: better logs

---------

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-05-21 13:02:19 +02:00
Kevin Meinhardt 14fabcbeb9
verify pip dependencies in CI (#22254)
* TMP: verify pip dependencies in CI

* TMP: Use pip freeze with more granular check for name and version matching
2024-05-20 12:34:34 +02:00
Kevin Meinhardt adc37153dd
Optimize multi stage docker build (#22195)
* Add checks to verify built docker image

TMP: rename dependencies.txt

* Remove unused and uninstalled package

* More efficient multi stage docker buildTMP: reorganize docker more efficiently

* Organize dockerfile
- split base and olympia stages
- use heredocs for multiline RUN steps
- move file copy to source layer
- merge run steps where possible

* TMP: fix invalid bash syntax in dockerfile

* TMP: add comments to dockerfile
2024-05-06 12:50:34 +02:00
Kevin Meinhardt 9879a4defa
Add "build" to version.json (#22205)
* Add "build" to version.json

* Add test for version.json in the docker container
2024-04-29 17:41:59 +02:00
Kevin Meinhardt 541e0bdacb
Generate version.json as part of docker build: (#22186)
* Generate version.json as part of docker build:
- remove git dependency from version.json generation
- use only version.json file for sentry release with soft/hard fail

* TMP: remove invalid comment

* TMP: Prefix branch tags

* TMP: re-comment the ci build in circle
2024-04-26 17:23:05 +02:00
Kevin Meinhardt 42c25e9226
Fix git commit error missing committer identity (#22059) 2024-03-22 08:53:24 +01:00
Kevin Meinhardt 110b0bc907
only git status on push command (#22043)
* Fix extract locales in CI

- reset current git config values after pushing
- only use git commands in push script
- fix typo in CI config

* Commit with flags instead of seting global configs.
2024-03-20 12:22:24 +01:00
Kevin Meinhardt 45353a80b7
Ignore only timestamp diff on push l10n extraction (#22040) 2024-03-20 08:32:37 +01:00
Kevin Meinhardt 7f1ff51138
Automate L10n extract/merge with reusable docker run github action (#21966)
* Reusable Docker run action (Bunch of other stuff here to make it work)

* extract locales

* remove extraneous log

---------

Co-authored-by: Mozilla Add-ons Robot <addons-dev-automation+github@mozilla.com>
2024-03-18 11:42:04 +01:00
Kevin Meinhardt 45421840da
Sync suppressed emails daily (#21998)
* Raname suppression sync task

* Add cron job to sync suppressed emails daily
2024-03-12 18:18:26 +01:00
Kevin Meinhardt 04cf44bbb2
Merge requirements files and document dependency management (#21838) 2024-02-21 13:20:01 +01:00
Kevin Meinhardt e978c20fdc
Extract l10n extract/merge to CI runnable job/script (#21734) 2024-01-30 09:50:34 +01:00
Andrew Williamson 9ffd8c12a7
switch from black to ruff format (#21384)
* switch from black to ruff format

* Update Makefile-docker
2023-11-02 14:35:10 +00:00
Andrew Williamson e4038c3805
Enable isort (#20718)
* Enable isort in ruff

* auto-format codebase with isort
2023-05-23 15:36:16 +01:00
Andrew Williamson 6219da7127
Make BlockSubmission delayable (#20490)
* Make BlockSubmission delayable

* drop errant assert that was added during testing; unnessecary migration
2023-03-27 10:09:09 +01:00
Mathieu Pillard 5c0e7a3c88
Merge deployment and development Dockerfiles (#20480)
* Merge deployment and development Dockerfiles
* Stop using root to install dependencies
* Run make commands from os with --user olympia
2023-03-23 15:46:56 +01:00
Mathieu Pillard 71d5f6286a
Send initial acknowledgement email for Add-ons for all channels (#20331)
* Stop notifying developers about auto-approval delay for each version

* Send initial acknowledgement email for Add-ons for all channels
2023-02-13 11:25:44 +01:00
Mathieu Pillard 65d613ace7
Remove guarded_addons directory and associated code, migrate existing (#19113)
* Remove guarded_addons directory and associated code, migrate existing

Files are now all kept in the same directory, and download_file() view
controls access.

This removes the code that was moving the files to the guarded_addons
directory, fallback code to deal with files not yet moved, and the
crons that ensures files were moved if needed.

* Remove old setting and obsolete test

* Add migration command

* Fix test/codestyle

* Unused imports

* Remove guarded-addons directory from git

* Tweaks and tests

* Compute ETA with full elapsed time

* Simplify command: remove Entry namedtuple, passing file/dir names instead
2022-04-25 14:35:48 +02:00
Mathieu Pillard 3a19fe3346
Remove puente: add necessary babel configuration instead (#19097)
* Remove puente: add necessary babel configuration instead

* Update comment

* We don't actually need lstrip, and it breaks a bunch of our templates

* Comment why we are doing this

* Remove obsolete test (the setting is gone, this is done in babel.cfg now)

* Add tests. We don't actually need the silent bit

* Set ORGANIZATION, limit paths to src/olympia
2022-04-11 14:13:54 +02:00
Mathieu Pillard bd4c6b8922
Do not generate fuzzy matches when extracting locales (#19095) 2022-04-11 11:28:33 +02:00
Andrew Williamson 261f4f8e36
Use DB sessions; store refresh tokens in session; use for frontend auth too (#18475)
* Use DB sessions; store refresh tokens in session; use for frontend auth too

* add clearsessions to cron

* return ERROR_SIGNATURE_EXPIRED for every scenerio that can be expiring sessions

* fix tests after default_fxa_login_url removed

* Return ERROR_AUTHENTICATION_EXPIRED for SessionIDAuthentication problems
2022-01-25 18:24:19 +00:00
Andrew Williamson ef84f771bf
use modern syntax in gen-cron.py; format consistently (#18667)
* use modern syntax in gen-cron.py; format consistently

* change to format from f string; add test
2022-01-24 13:04:55 +00:00
Andrew Williamson d1fba99ab5
rm import (legacy) blocklist feature (#17841) 2021-09-10 14:44:22 +01:00
Andrew Williamson 80f526e840
run pyupgrade (#17603)
* let pyupgrade work as command line tool

* run_pyupgrade and black on src/ tests/ services/

* delete the comment as absolute_import is gone
2021-08-05 15:00:44 +01:00
Mathieu Pillard d4bace5c89
Replace legacy assets cachebusting by staticfiles's ManifestStaticFilesStorage from django (#17464)
* Replace legacy assets cachebusting by staticfiles's ManifestStaticFilesStorage from django

* Run tests without ManifestStaticFilesStorage

* Fix tests

* Reformatting

* It's fine, since collectstatic also copies the original

* Register static directly

* Reformat comment
2021-07-12 16:06:20 +02:00
Andrew Williamson 1435930206
enable sitemap generation cron (#17247)
* enable sitemap generation cron

* change time to 23:00
2021-06-11 16:48:14 +01:00
William Durand 13dcd75c97
Remove category_totals cron (#16592) 2021-02-22 19:49:40 +01:00
Andrew Williamson de374c4ceb
drop AppSupport model (#16326)
* drop AppSupport model

* in language-tools api, application param only mandatory for appversion, and ignored otherwise

* Delete 0029_delete_appsupport.py
2021-01-19 16:07:59 +00:00
William Durand 2a3ce33286
Migrate to Circle CI (#16189) 2020-12-18 12:13:48 +01:00
William Durand 5f00968a39
Remove legacy download stats (#15664) 2020-10-13 11:19:28 +02:00
Andrew Williamson 68f49f8f2a
sign promoted addons for specific applications, where available (#15364) 2020-08-26 13:54:41 +01:00
bqbn 37479685e0
Fix 15135 (#15240)
* Fix 15135

Remove the `update_addon_total_downloads` per https://github.com/mozilla/addons-server/issues/15135#issuecomment-670196397

* Update the run time for update_addon_weekly_downloads
2020-08-11 17:18:29 +01:00
Andrew Williamson 7ef68fe745
sign addons as promoted via the autograph recommended signer (#15221) 2020-08-07 18:02:13 +01:00
Andreas Wagner e59e468ce8
Remove legacy file viewer (#15180) 2020-08-05 16:41:11 +02:00
Mathieu Pillard a22f9fb7ce
Notify developers again about pending rejection as they get close to the deadline (#15128)
* Notify developers again about pending rejection as they get close to the deadline

Only one notification is sent per "batch" of pending rejections, until a new
delayed rejection is scheduled.

* Make user_factory() less likely to hit username/email collisions

* Add crontab (and remove old one about info requests)

* Update logger name
2020-08-03 17:49:24 +02:00
William Durand 733d31e1c7
Use BigQuery in `weekly_downloads()` cron task (#15045) 2020-07-27 14:40:31 +02:00
Piotr Zarycki 97b0875004
Rename delivery_hotness cron task to update_addon_hotness (#15065) 2020-07-27 10:41:29 +02:00
William Durand 7ed40d8223
Use weekly_downloads and skip update task when flag/switch are active (#15056) 2020-07-24 17:33:34 +02:00
Mathieu Pillard 931852cd05
Implement delayed review rejections in reviewer tools (#14968)
* Implement delayed review rejections in reviewer tools

This removes the ability to have an info request with a deadline, and
instead makes it possible to delay review rejections when using the
reject multiple versions action.
2020-07-17 13:15:55 +02:00
William Durand 0333d7e7ab
Remove all references to `UpdateCount` (#14818) 2020-07-07 17:18:01 +02:00
Andrew Williamson 08cffa0760 clear more user data, after 24 hours; after 7 years for addon devs 2020-06-30 15:37:58 +01:00
Mathieu Pillard 8c19afb5ed
Notify developers if their submission is pending review after a few hours (#14398)
* Notify developers if their submission is pending review after a few hours

* Make default None to make migration backwards-compatible and add test on notified_about_auto_approval_delay

* Move migration
2020-06-01 13:07:23 +02:00
Andrew Williamson 3445e9a95f kinto -> remote settings or legacy 2020-05-20 16:00:49 +01:00