Граф коммитов

74 Коммитов

Автор SHA1 Сообщение Дата
Kevin Meinhardt a790d973a2
Refactor CI workflow and enable parallelization (#22306)
* Fix flaky tests

* Reorganize and consolidate CI workflows

* TMP: squash

* TMP: recomment
2024-06-06 14:03:42 +02:00
Kevin Meinhardt ef033d0c8a
Implement All CircleCI tests in github actions (#22250)
* TMP: move test definition to make file

TMP: squash

* TMP: add the github version

* TMP: squash (no need to parallelize this test)
2024-05-31 11:53:45 +02:00
Kevin Meinhardt 22e51f015d
Fix build image CircleCI job (#22290) 2024-05-27 15:46:34 +02:00
Kevin Meinhardt ddade2a62b
Fix Docker build and add concurrency limit (#22273)
* Fix Docker build:
- get correct Image ID from the build.
- set docker tag correctly supporting tag and digest
- add concurrency limit to github action ci jobs

* TMP: remove easy way to get build digest as it is not really intended for local dev

* Update .circleci/config.yml

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>

* TMP: recomment build

---------

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-05-24 10:09:09 +02:00
Kevin Meinhardt c2a775b6e2
Disable build-image in circleci (#22268) 2024-05-21 17:54:17 +02:00
Kevin Meinhardt d3b3a50ac5
Docker digest (#22260)
* Refactor unified setup script to manage .env and version.json files in readable python

* Support using digest to run docker image

* Update scripts/setup.py

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>

* TMP: build image

* TMP: better logs

---------

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-05-21 13:02:19 +02:00
Mathieu Pillard 3f88010a5b
Upgrade to python 3.11 (#22247)
* Upgrade to python 3.11
2024-05-16 14:53:15 +02:00
Kevin Meinhardt c4f4ba6487
"Fix makefile env variables definition" (#22246)
* TMP: refactor buildx bake definition and test

* TMP: better initialization and organization of make file env vars (docker relevant +)

* TMP: cleaner code.

* TMP: remove build
2024-05-16 14:49:37 +02:00
Kevin Meinhardt bc186195bc
Load service data via portable and persistent data volumes (#22235)
* Infer superuser credentials from git config

* Load service data via portable and persistent data volumes

Load storage via persistent data volume (host bound)

Make up/down commands to easily recreate local environments

* TMP: add redis volume too

* TMP: better control over volume state

* TMP: remove dead code

* TMP: more dead code gone

* TMP: add wait for mysql before restoring snapshots
2024-05-14 16:17:35 +02:00
Kevin Meinhardt b78b07d84e
Print docker image digest as a part of the CircleCI build (#22243)
* Tmp: print digest and tags after build

* TMP: remove build
2024-05-14 11:30:07 +02:00
Kevin Meinhardt 6212cc2c9e
Use environment variables to configure docker compose variable properties and build with bake (#22225)
* Remove redundant docker-cache directory

* Use environment variables to configure docker compose variable properties
2024-05-10 09:44:54 +02:00
Kevin Meinhardt 9879a4defa
Add "build" to version.json (#22205)
* Add "build" to version.json

* Add test for version.json in the docker container
2024-04-29 17:41:59 +02:00
Kevin Meinhardt 5a86497ddf
Compile locales independently of prod.txt pip install (#22194)
* Compile locales independently of prod.txt pip install- install compile-mo.sh deps independently- properly named stage- allows locale compilation to occur in parallel of pip install prod.txt

* TMP: remove quiet mode
2024-04-29 13:45:47 +02:00
Kevin Meinhardt 541e0bdacb
Generate version.json as part of docker build: (#22186)
* Generate version.json as part of docker build:
- remove git dependency from version.json generation
- use only version.json file for sentry release with soft/hard fail

* TMP: remove invalid comment

* TMP: Prefix branch tags

* TMP: re-comment the ci build in circle
2024-04-26 17:23:05 +02:00
Mathieu Pillard cf5e2019ea
Remove obsolete `docs` job from CircleCI (#22094)
docs are built (and deployed, for commits from `master`) as a GitHub action now.
2024-04-02 11:34:56 +02:00
Mathieu Pillard 487e284f5c
Switch ubuntu image to 2004:current (ubuntu-2004:202201-02 is deprecated) (#22037) 2024-03-20 10:34:23 +01:00
Kevin Meinhardt 86d0f1f998
Use buildx to build docker image in circleci (#21960) 2024-03-05 14:26:07 +01:00
Kevin Meinhardt 04cf44bbb2
Merge requirements files and document dependency management (#21838) 2024-02-21 13:20:01 +01:00
Kevin Meinhardt e978c20fdc
Extract l10n extract/merge to CI runnable job/script (#21734) 2024-01-30 09:50:34 +01:00
Kevin Meinhardt 84c2a4e440
chore(ci): minor upgrade mysql version in ci (#21630) 2023-12-19 10:31:19 +01:00
Mathieu Pillard 1fc7e71b11
Switch to Node.js 18.x (#21557) 2023-12-05 15:02:31 +01:00
Andrew Williamson 8e3948be68
Revert "Switch to Node.js 18.x (#21400)" (#21420)
This reverts commit 42f26f29dc.
2023-11-09 22:07:43 +00:00
Mathieu Pillard 42f26f29dc
Switch to Node.js 18.x (#21400) 2023-11-06 16:48:52 +01:00
Mathieu Pillard 77e3392ef2
Update mysql-apt-config package in CI (#20760)
* Update mysql-apt-config package in CI

* Use repo.mysql.com
2023-05-26 19:34:23 +02:00
Mathieu Pillard 7730f6f3bb
Drop Django 3.2 tests (#20693) 2023-05-15 14:51:24 +02:00
Andrew Williamson e8d549c6c2
Enable django4.2 deployment (#20612)
* allow django41 installation via make; add CI matrix

* ManifestStaticFilesStorage with sourceMappingURL

* test against django4.2rc1

* import django.core.files.File directly

* handle django4.2 being precise with timeuntil

* bump django4.2 to release

* fix reviewer tools css/js

* don't downgrade django3.2

* prettier fix

* handle timesince being more picky (again)

* default to django42
2023-04-26 09:44:31 +01:00
Mathieu Pillard dc2652338a
Update Github RSA SSH host key (#20504) 2023-03-24 16:17:35 +01:00
Mathieu Pillard 5c0e7a3c88
Merge deployment and development Dockerfiles (#20480)
* Merge deployment and development Dockerfiles
* Stop using root to install dependencies
* Run make commands from os with --user olympia
2023-03-23 15:46:56 +01:00
Mathieu Pillard e906a7f6bf
Switch to Node 16 by default (#19751)
* Switch to Node 16 by default

* Fix python image tag to include node
2022-10-04 19:28:59 +02:00
Mathieu Pillard f96b4ca591
In CI set CPUCOUNT, CC with other en variables, move that above install steps (#19645)
* In CI set CPUCOUNT, CC with other en variables, move that above install steps

* Quotes
2022-09-01 15:43:35 +02:00
Mathieu Pillard 78e467a104
Define CC & CPUCOUNT to workaround uwsgi build issues on CircleCI (#19644) 2022-09-01 14:52:29 +02:00
Andrew Williamson d42c7750f5
upgrade to python 3.10 (#19568)
* run CI with python3.10

* change Dockerfile.deploy too
2022-08-17 18:25:13 +01:00
Mathieu Pillard 41d4eba243
Upgrade pygit2 to 1.10.0, remove libgit2-dev dependency (#19570)
We shouldn't need libgit2-dev anymore (and it outdated anyway) because
the latest pygit2 versions provide precompiled wheels that match our
setup.
2022-08-17 10:18:46 +02:00
Mathieu Pillard 97ba20c9a2
Run CI/local envs with ES 7 and update client libs (#19441)
* Run CI/local envs with ES 7 and update client libs

Also drive-by update CI to have the right versions of MySQL/Redis

* Remove deprecated, no longer necessary send_get_body_as parameter

* Fix deprecation warnings

* Update tests

* Unused import

* More deprecation fixes
2022-07-11 11:35:18 +02:00
Mathieu Pillard 4b97ad368c
Elasticsearch 7.x compatibility & cleanups (#19126)
* Elasticsearch 7.x compatibility & cleanups

* Fix double import

* Bump versions

* Add position back
2022-04-21 15:28:32 +02:00
Mathieu Pillard 74b5dbc53a
Replace circleci/mysql image with the official mysql docker image (#18956)
* Replace circleci/mysql image with the official mysql docker image

Downgrading (!) the version too to match prod.

* Match circleci/mysql behavior
2022-03-10 10:39:31 +01:00
Mathieu Pillard 84d01415e0
Update CircleCI executor config to use an explicitly supported ubuntu image (#18935)
* Update CircleCI executor config to use an explicitly supported ubuntu image

* ugh yaml is terrible
2022-03-08 10:38:58 +01:00
Mathieu Pillard 676b4b2576
Update MySQL releases GPG key (#18636)
Per
https://dev.mysql.com/downloads/repo/apt/
https://dev.mysql.com/doc/refman/8.0/en/checking-gpg-signature.html
2022-01-18 12:03:57 +01:00
Mathieu Pillard 1039ab04b8
Switch CircleCI to Node 14 (#18033)
* Switch CircleCI to Node 14

* Use latest orb, and ensure node-version is a string

* Fix indent
2021-10-04 16:03:29 +02:00
Andrew Williamson 837951428c
upgrade to python39 (#17945)
* upgrade to python3.9

* py3.9 fix - replace .getiterator with .iter

* include libgit2-dev in Dockerfile[.deploy] setup too
2021-09-22 14:52:54 +01:00
Andrew Williamson 5ad242636f
pin mysql to v8.0.25 in circleci config (#17520) 2021-07-20 14:28:10 +01:00
Andrew Williamson 1157e9c2cd
drop django2.2 compat (#17515)
* drop django22 CI & support in Dockerfile/Makefile

* rm obsolete fallbacks

* drop django-jsonfield-backport
2021-07-20 10:03:10 +01:00
Andrew Williamson 84b32673bf
deploy stage with django32 (#17480) 2021-07-13 16:33:08 +01:00
Andrew Williamson 4b4b8b2407
default local dev to django3.2; deploy to addons-dev with 3.2 (#17452) 2021-07-08 10:31:48 +01:00
Andrew Williamson 5740aee15c
Fix TestIndexCommand under django3.2 (#17438) 2021-07-07 12:17:28 +01:00
William Durand 4c0af60287
Avoid pyenv shim and use dennis-cmd directly (#17136) 2021-05-12 14:38:21 +02:00
William Durand ce8529feb3
Remove MYSQL_ALLOW_EMPTY_PASSWORD env var in circle config (#16780)
It's already set in the base image we're using
2021-03-18 14:05:17 +01:00
Andrew Williamson 7a3be4cf86
django3.2 fixes for main test job (#16481)
* `static` is new name for `admin_static` template tag library

* escaping test fixes

* add obj arg to CollectionAddonInline.has_add_permission

* TestExceptionHandlerWithViewSet fix

* TranslationMultiDbTests fix

* re-enable main job with django32

* update blocklist tests with django's fancy quotes and dashes
2021-02-08 15:06:19 +00:00
Andrew Williamson ac82909f8d
handle django3.2 using fancy quotes; enable devhub job for 3.2 (#16469)
* handle django3.2 using fancy quotes; enable devhub job for 3.2

* directly test django version for fancy quotes
2021-02-08 09:44:02 +00:00
Andrew Williamson 4e12e60380
workaround Response._headers going away; enable amo-lib-locales-and-signing job for 3.2 (#16471) 2021-02-05 10:05:26 +00:00