Kevin Meinhardt
a790d973a2
Refactor CI workflow and enable parallelization ( #22306 )
...
* Fix flaky tests
* Reorganize and consolidate CI workflows
* TMP: squash
* TMP: recomment
2024-06-06 14:03:42 +02:00
Kevin Meinhardt
ef033d0c8a
Implement All CircleCI tests in github actions ( #22250 )
...
* TMP: move test definition to make file
TMP: squash
* TMP: add the github version
* TMP: squash (no need to parallelize this test)
2024-05-31 11:53:45 +02:00
Kevin Meinhardt
22e51f015d
Fix build image CircleCI job ( #22290 )
2024-05-27 15:46:34 +02:00
Kevin Meinhardt
ddade2a62b
Fix Docker build and add concurrency limit ( #22273 )
...
* Fix Docker build:
- get correct Image ID from the build.
- set docker tag correctly supporting tag and digest
- add concurrency limit to github action ci jobs
* TMP: remove easy way to get build digest as it is not really intended for local dev
* Update .circleci/config.yml
Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
* TMP: recomment build
---------
Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-05-24 10:09:09 +02:00
Kevin Meinhardt
c2a775b6e2
Disable build-image in circleci ( #22268 )
2024-05-21 17:54:17 +02:00
Kevin Meinhardt
d3b3a50ac5
Docker digest ( #22260 )
...
* Refactor unified setup script to manage .env and version.json files in readable python
* Support using digest to run docker image
* Update scripts/setup.py
Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
* TMP: build image
* TMP: better logs
---------
Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-05-21 13:02:19 +02:00
Mathieu Pillard
3f88010a5b
Upgrade to python 3.11 ( #22247 )
...
* Upgrade to python 3.11
2024-05-16 14:53:15 +02:00
Kevin Meinhardt
c4f4ba6487
"Fix makefile env variables definition" ( #22246 )
...
* TMP: refactor buildx bake definition and test
* TMP: better initialization and organization of make file env vars (docker relevant +)
* TMP: cleaner code.
* TMP: remove build
2024-05-16 14:49:37 +02:00
Kevin Meinhardt
bc186195bc
Load service data via portable and persistent data volumes ( #22235 )
...
* Infer superuser credentials from git config
* Load service data via portable and persistent data volumes
Load storage via persistent data volume (host bound)
Make up/down commands to easily recreate local environments
* TMP: add redis volume too
* TMP: better control over volume state
* TMP: remove dead code
* TMP: more dead code gone
* TMP: add wait for mysql before restoring snapshots
2024-05-14 16:17:35 +02:00
Kevin Meinhardt
b78b07d84e
Print docker image digest as a part of the CircleCI build ( #22243 )
...
* Tmp: print digest and tags after build
* TMP: remove build
2024-05-14 11:30:07 +02:00
Kevin Meinhardt
6212cc2c9e
Use environment variables to configure docker compose variable properties and build with bake ( #22225 )
...
* Remove redundant docker-cache directory
* Use environment variables to configure docker compose variable properties
2024-05-10 09:44:54 +02:00
Kevin Meinhardt
9879a4defa
Add "build" to version.json ( #22205 )
...
* Add "build" to version.json
* Add test for version.json in the docker container
2024-04-29 17:41:59 +02:00
Kevin Meinhardt
5a86497ddf
Compile locales independently of prod.txt pip install ( #22194 )
...
* Compile locales independently of prod.txt pip install- install compile-mo.sh deps independently- properly named stage- allows locale compilation to occur in parallel of pip install prod.txt
* TMP: remove quiet mode
2024-04-29 13:45:47 +02:00
Kevin Meinhardt
541e0bdacb
Generate version.json as part of docker build: ( #22186 )
...
* Generate version.json as part of docker build:
- remove git dependency from version.json generation
- use only version.json file for sentry release with soft/hard fail
* TMP: remove invalid comment
* TMP: Prefix branch tags
* TMP: re-comment the ci build in circle
2024-04-26 17:23:05 +02:00
Mathieu Pillard
cf5e2019ea
Remove obsolete `docs` job from CircleCI ( #22094 )
...
docs are built (and deployed, for commits from `master`) as a GitHub action now.
2024-04-02 11:34:56 +02:00
Mathieu Pillard
487e284f5c
Switch ubuntu image to 2004:current (ubuntu-2004:202201-02 is deprecated) ( #22037 )
2024-03-20 10:34:23 +01:00
Kevin Meinhardt
86d0f1f998
Use buildx to build docker image in circleci ( #21960 )
2024-03-05 14:26:07 +01:00
Kevin Meinhardt
04cf44bbb2
Merge requirements files and document dependency management ( #21838 )
2024-02-21 13:20:01 +01:00
Kevin Meinhardt
e978c20fdc
Extract l10n extract/merge to CI runnable job/script ( #21734 )
2024-01-30 09:50:34 +01:00
Kevin Meinhardt
84c2a4e440
chore(ci): minor upgrade mysql version in ci ( #21630 )
2023-12-19 10:31:19 +01:00
Mathieu Pillard
1fc7e71b11
Switch to Node.js 18.x ( #21557 )
2023-12-05 15:02:31 +01:00
Andrew Williamson
8e3948be68
Revert "Switch to Node.js 18.x ( #21400 )" ( #21420 )
...
This reverts commit 42f26f29dc
.
2023-11-09 22:07:43 +00:00
Mathieu Pillard
42f26f29dc
Switch to Node.js 18.x ( #21400 )
2023-11-06 16:48:52 +01:00
Mathieu Pillard
77e3392ef2
Update mysql-apt-config package in CI ( #20760 )
...
* Update mysql-apt-config package in CI
* Use repo.mysql.com
2023-05-26 19:34:23 +02:00
Mathieu Pillard
7730f6f3bb
Drop Django 3.2 tests ( #20693 )
2023-05-15 14:51:24 +02:00
Andrew Williamson
e8d549c6c2
Enable django4.2 deployment ( #20612 )
...
* allow django41 installation via make; add CI matrix
* ManifestStaticFilesStorage with sourceMappingURL
* test against django4.2rc1
* import django.core.files.File directly
* handle django4.2 being precise with timeuntil
* bump django4.2 to release
* fix reviewer tools css/js
* don't downgrade django3.2
* prettier fix
* handle timesince being more picky (again)
* default to django42
2023-04-26 09:44:31 +01:00
Mathieu Pillard
dc2652338a
Update Github RSA SSH host key ( #20504 )
2023-03-24 16:17:35 +01:00
Mathieu Pillard
5c0e7a3c88
Merge deployment and development Dockerfiles ( #20480 )
...
* Merge deployment and development Dockerfiles
* Stop using root to install dependencies
* Run make commands from os with --user olympia
2023-03-23 15:46:56 +01:00
Mathieu Pillard
e906a7f6bf
Switch to Node 16 by default ( #19751 )
...
* Switch to Node 16 by default
* Fix python image tag to include node
2022-10-04 19:28:59 +02:00
Mathieu Pillard
f96b4ca591
In CI set CPUCOUNT, CC with other en variables, move that above install steps ( #19645 )
...
* In CI set CPUCOUNT, CC with other en variables, move that above install steps
* Quotes
2022-09-01 15:43:35 +02:00
Mathieu Pillard
78e467a104
Define CC & CPUCOUNT to workaround uwsgi build issues on CircleCI ( #19644 )
2022-09-01 14:52:29 +02:00
Andrew Williamson
d42c7750f5
upgrade to python 3.10 ( #19568 )
...
* run CI with python3.10
* change Dockerfile.deploy too
2022-08-17 18:25:13 +01:00
Mathieu Pillard
41d4eba243
Upgrade pygit2 to 1.10.0, remove libgit2-dev dependency ( #19570 )
...
We shouldn't need libgit2-dev anymore (and it outdated anyway) because
the latest pygit2 versions provide precompiled wheels that match our
setup.
2022-08-17 10:18:46 +02:00
Mathieu Pillard
97ba20c9a2
Run CI/local envs with ES 7 and update client libs ( #19441 )
...
* Run CI/local envs with ES 7 and update client libs
Also drive-by update CI to have the right versions of MySQL/Redis
* Remove deprecated, no longer necessary send_get_body_as parameter
* Fix deprecation warnings
* Update tests
* Unused import
* More deprecation fixes
2022-07-11 11:35:18 +02:00
Mathieu Pillard
4b97ad368c
Elasticsearch 7.x compatibility & cleanups ( #19126 )
...
* Elasticsearch 7.x compatibility & cleanups
* Fix double import
* Bump versions
* Add position back
2022-04-21 15:28:32 +02:00
Mathieu Pillard
74b5dbc53a
Replace circleci/mysql image with the official mysql docker image ( #18956 )
...
* Replace circleci/mysql image with the official mysql docker image
Downgrading (!) the version too to match prod.
* Match circleci/mysql behavior
2022-03-10 10:39:31 +01:00
Mathieu Pillard
84d01415e0
Update CircleCI executor config to use an explicitly supported ubuntu image ( #18935 )
...
* Update CircleCI executor config to use an explicitly supported ubuntu image
* ugh yaml is terrible
2022-03-08 10:38:58 +01:00
Mathieu Pillard
676b4b2576
Update MySQL releases GPG key ( #18636 )
...
Per
https://dev.mysql.com/downloads/repo/apt/
https://dev.mysql.com/doc/refman/8.0/en/checking-gpg-signature.html
2022-01-18 12:03:57 +01:00
Mathieu Pillard
1039ab04b8
Switch CircleCI to Node 14 ( #18033 )
...
* Switch CircleCI to Node 14
* Use latest orb, and ensure node-version is a string
* Fix indent
2021-10-04 16:03:29 +02:00
Andrew Williamson
837951428c
upgrade to python39 ( #17945 )
...
* upgrade to python3.9
* py3.9 fix - replace .getiterator with .iter
* include libgit2-dev in Dockerfile[.deploy] setup too
2021-09-22 14:52:54 +01:00
Andrew Williamson
5ad242636f
pin mysql to v8.0.25 in circleci config ( #17520 )
2021-07-20 14:28:10 +01:00
Andrew Williamson
1157e9c2cd
drop django2.2 compat ( #17515 )
...
* drop django22 CI & support in Dockerfile/Makefile
* rm obsolete fallbacks
* drop django-jsonfield-backport
2021-07-20 10:03:10 +01:00
Andrew Williamson
84b32673bf
deploy stage with django32 ( #17480 )
2021-07-13 16:33:08 +01:00
Andrew Williamson
4b4b8b2407
default local dev to django3.2; deploy to addons-dev with 3.2 ( #17452 )
2021-07-08 10:31:48 +01:00
Andrew Williamson
5740aee15c
Fix TestIndexCommand under django3.2 ( #17438 )
2021-07-07 12:17:28 +01:00
William Durand
4c0af60287
Avoid pyenv shim and use dennis-cmd directly ( #17136 )
2021-05-12 14:38:21 +02:00
William Durand
ce8529feb3
Remove MYSQL_ALLOW_EMPTY_PASSWORD env var in circle config ( #16780 )
...
It's already set in the base image we're using
2021-03-18 14:05:17 +01:00
Andrew Williamson
7a3be4cf86
django3.2 fixes for main test job ( #16481 )
...
* `static` is new name for `admin_static` template tag library
* escaping test fixes
* add obj arg to CollectionAddonInline.has_add_permission
* TestExceptionHandlerWithViewSet fix
* TranslationMultiDbTests fix
* re-enable main job with django32
* update blocklist tests with django's fancy quotes and dashes
2021-02-08 15:06:19 +00:00
Andrew Williamson
ac82909f8d
handle django3.2 using fancy quotes; enable devhub job for 3.2 ( #16469 )
...
* handle django3.2 using fancy quotes; enable devhub job for 3.2
* directly test django version for fancy quotes
2021-02-08 09:44:02 +00:00
Andrew Williamson
4e12e60380
workaround Response._headers going away; enable amo-lib-locales-and-signing job for 3.2 ( #16471 )
2021-02-05 10:05:26 +00:00