Граф коммитов

93 Коммитов

Автор SHA1 Сообщение Дата
Kevin Meinhardt b3d0a224f1
Sync storage with make up flow (#22805)
* Sync storage with make up flow

* data_load should clean storage directory
2024-11-12 16:32:27 +01:00
Kevin Meinhardt 90f997a2d2
Small fixes to docker setup (logs, static file routing, healthcheck, dockerignore) (#22679)
* Only log docker compose if specified in CI run-docker step

* Better and alphabetized ignore paths for git and docker

* Less aggressive post start health checks

* Clean up redundant code

* Add better documentation about dockerignore/gitignore

* Update start period
2024-09-24 19:54:25 +02:00
Kevin Meinhardt 23b15add5d
Remove data_deps from docker compose (#22644)
* Isolate locale dependencies

* Better dockerignore

* Faster health checks

* Drop data_deps volume
2024-09-10 18:56:33 +02:00
Kevin Meinhardt 2a64618e9d
Enable Production Mode via DEBUG or docker-compose.ci.yml (#22613)
* TMP: clean bake metadata file

* SPLIT: Log UWSGI in docker compose console

Remove PID

* SPLIT: Raise error in update_assets if file not found

* Enable Production mode via DEBUG and or docker-compose.ci.yml

* Option 1: Load node_modules from statifiles directory

* Option 2: Load node_modules via django-node-asset

* separate ./static from locally built static files

* Add docs for static file serving

* TMP: fixes from code review

* Update docs/topics/development/static-files.md

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>

* TMP: update docs

---------

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-09-05 16:20:03 +02:00
Kevin Meinhardt f5d21109a9
Use default buildx builder for faster build (#22631)
* Use default buildx builder for faster build

* Update Docs

* Rename metadata.json

* Remove uneeded build.py

* TMP: clarify the reason for docker driver

* Keep explicit builder declaration for backwards compatibility

* TMP: shorten metadata file
2024-09-04 15:30:38 +02:00
Kevin Meinhardt d7b21e18e6
Remove supervisor and enable more efficient container startup (#22592)
* TMP: add http server to expose version endpoint

* Use data volume for mounting repository files

* Use watchmedo directly from docker to run celery

* TMP: fix test

* TMP: remove data_olympia volume on ci yml

* TMP: add settings djanmgo modeul to celery worker.

* TMP: remove references to ssupervisor

* Update docs/topics/development/building_and_running_services.md

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>

---------

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-08-27 12:42:10 +02:00
Kevin Meinhardt e4ceb64b9e
Remove the chown command from entrypoint. (#22584)
* Remove the chown command from entrypoint.

* TMP: remove redundant timeout on the health check for worker/web containers
2024-08-23 12:00:32 +02:00
Kevin Meinhardt 84d514e744
Remove version.json file from host environment (#22571)
* Remove version.json file from host environment

* tmp: fix

* TMP: fix tests

* TMP: remove unecessary test

* TMP: fix test for get_version_json

* TMP: fixy
2024-08-21 10:33:31 +02:00
Kevin Meinhardt be592a247a
Ditch the /deps volume (#22332)
* Ditch the /deps volume

* TMP: remove update deps at the beggingin

* TMP: add comment
2024-06-10 13:18:25 +02:00
Kevin Meinhardt f4bdaec5bb
Add configurable compose file to make up flow (#22299) 2024-05-30 13:02:26 +02:00
Kevin Meinhardt ddade2a62b
Fix Docker build and add concurrency limit (#22273)
* Fix Docker build:
- get correct Image ID from the build.
- set docker tag correctly supporting tag and digest
- add concurrency limit to github action ci jobs

* TMP: remove easy way to get build digest as it is not really intended for local dev

* Update .circleci/config.yml

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>

* TMP: recomment build

---------

Co-authored-by: Mathieu Pillard <diox@users.noreply.github.com>
2024-05-24 10:09:09 +02:00
Kevin Meinhardt bc186195bc
Load service data via portable and persistent data volumes (#22235)
* Infer superuser credentials from git config

* Load service data via portable and persistent data volumes

Load storage via persistent data volume (host bound)

Make up/down commands to easily recreate local environments

* TMP: add redis volume too

* TMP: better control over volume state

* TMP: remove dead code

* TMP: more dead code gone

* TMP: add wait for mysql before restoring snapshots
2024-05-14 16:17:35 +02:00
Kevin Meinhardt 541e0bdacb
Generate version.json as part of docker build: (#22186)
* Generate version.json as part of docker build:
- remove git dependency from version.json generation
- use only version.json file for sentry release with soft/hard fail

* TMP: remove invalid comment

* TMP: Prefix branch tags

* TMP: re-comment the ci build in circle
2024-04-26 17:23:05 +02:00
Kevin Meinhardt 823e825a30
Efficiently cache docker build (#21914)
* local docker build command

* Move copy . to after installing packages (prevents always re-installing)

* Enable buildkit cache mount to cache pip/npm dependencies
- cache npm/pip dependencies across builds
- add clear logging to npm install for cache hit/miss
- move copy npm files to update_assets

* Split build into stages
- splitting to stages offers better caching of layers and more efficient use of disk/time
- The initial gains will be with better caching of locale compilation, but will expand as we can move more logic from the final stage

TODO: split up apt depedencies to specific stages, move update_assets to pre-final stage to prevent re-running on every build with a * file change.

* Document the docker file and build process

* update docs
2024-03-01 11:47:11 +01:00
Andreas Wagner bbeecd3bd4
Add .pdbhistory and .mysql_history to .gitignore (#21726) 2024-01-18 16:41:23 +01:00
Mathieu Pillard 5c0e7a3c88
Merge deployment and development Dockerfiles (#20480)
* Merge deployment and development Dockerfiles
* Stop using root to install dependencies
* Run make commands from os with --user olympia
2023-03-23 15:46:56 +01:00
Andrew Williamson 6101446f3c
implement sitemap.xml with basic site and addon support (#16904)
* implement sitemap.xml with basic site and addon support

* rm commented out lines from development
2021-04-13 11:04:48 +01:00
Andrew Williamson bc039ac584 move the actual mlbf upload to a celery task 2020-04-06 12:26:17 +01:00
William Durand a5a4bb6dfc
Run yara task on submission (with waffle switch) (#12059) 2019-08-29 13:07:36 +02:00
William Durand 458cc64170
Add task to run `customs` (over HTTP) (#12191) 2019-08-29 12:21:20 +02:00
William Durand 0e5a4d0e6d
Create a run_yara task (#12005) 2019-08-07 17:34:54 +02:00
Mathieu Pillard a8c1b2b976 Ignore docs/_build again (in the global .gitignore this time) 2019-02-13 17:38:08 +01:00
Mathieu Pillard 3b2a5855e7
Generate and use /static/js/i18n/{locale}.js instead of using a dynamic view (#10372)
Generate and use /static/js/i18n/{locale}.js instead of using a dynamic view
2019-01-15 11:49:31 +01:00
Christopher Grebs 8840c4eaa8
Add storage/git-storage to gitignore
Fixes #10073
2018-11-26 15:38:27 +01:00
Christopher Grebs cf629f5ba0
Expose correct addons and user-media paths in docker container. (#9706)
Fixes #9705
2018-10-16 13:45:29 +02:00
Mathieu Pillard 7f37460be2 Add command to generate a file containing disco pane editorial strings for extraction 2018-07-06 18:49:27 +02:00
Christopher Grebs 48b31ef4f4
Add product details into our repository. (#8780)
Fixes #8597 

This should make our CI and docker builds a bit faster. Next step would be to automate syncing product details as part of our l10n process. #8779 takes care of that.
2018-07-06 17:20:43 +02:00
Christopher Grebs e29f181a71
Add .cache and .vscode to gitignore 2018-04-10 08:00:42 +02:00
Andrew Williamson 7632de947b
.pytest-cache to .pytest_cache/* 2018-02-03 00:34:21 +08:00
Andrew Williamson bd8bdf1daf
pytest-cache to .pytest-cache 2018-02-03 00:32:12 +08:00
Mathieu Pillard 719fc4603e Simplify the hack needed to support `cak` locale
Trying to fake our way in doesn't work because when formatting later
we'll need the locale data, which Babel will fail to load. We could
load data preventively... but then we might as well just return the
english Locale directly.
2018-02-02 12:19:48 +01:00
Andrew Williamson 695f88ee4f
change pytest cache folder .gitignore and tidy up (#7463)
Most of it looked like Marketplace cruft
2018-02-01 20:15:29 +08:00
Andrew Williamson 1d0d8334a6 Add guarded-addons folder to gitignore (#6738) 2017-10-19 18:15:43 +01:00
Andrew Williamson d7ee42bfa9 jquery-minicolors from npm (#5714) 2017-06-21 16:06:31 +01:00
Andrew Williamson aa2f179578 use npm for just jquery (#5530) 2017-06-01 12:32:58 +01:00
Andrew Williamson 677f00a3df revert all of use npm for js libs (#5523) 2017-05-30 17:08:30 +01:00
Andrew Williamson 2af008a479 use npm for js libs (#5485) 2017-05-30 13:09:31 +01:00
Stuart Colville f3db2381ef Fix up docs and make the common case the default 2016-09-05 17:23:48 +01:00
Stuart Colville ca1fc1a343 Add docs for docker for mac + windows and change port config 2016-09-02 18:28:41 +01:00
Christopher Grebs 8142b9d82c Add no-cache backend for product-details.
This avoids hitting the cache for product details
and uses the old behaviour of 0.7.x times.
2016-02-25 21:39:55 +01:00
Christopher Grebs 580ccf7710 Update gitignore, updates to mock/patch import paths, minor fixes along the way. 2016-01-06 10:48:04 +01:00
Christopher Grebs a707ce4f7e Ignore .egg-info files. 2016-01-06 10:48:03 +01:00
Christopher Grebs 580de6f78e Start renaming, re-ordering folder/module structure.
We now have something like that:

 - /
 -- src/
 --------- olympia/
 -------------- {access,accounts,amo,addons,...}
 -------------- wsgi.py
 -------------- urls.py
 -------------- migrations/
 -------------- libs/
 ...

Which generally feels more django-like again and makes porting
our sys.path hacks to django 1.7 and it's app-refactoring
a lot easier.

* Update setup.py to bring it to a more modern format
* Update gitignore
2016-01-06 10:48:02 +01:00
Stuart Colville 5bf6773865 Use supervisord for runserver in docker 2015-09-18 12:59:08 +01:00
Kris Maglione 7b195421cd Bug 1172044: Part 2 - Allow editors to flag or unflag validator messages as ignorable. 2015-08-10 21:56:51 -07:00
Kris Maglione 4804f14dff Make Docker runs friendlier to the contents of the host filesystem, particularly for Linux users. 2015-08-07 21:35:52 -07:00
Mathieu Agopian 7c9c856873 Use pytest (bug 1090184) 2014-12-09 09:45:40 +01:00
Mathieu ROBIN 8822905da3 Fixing migration from config.json to .jshintrc
Last move was unfinished

Added .idea folder to gitignore

Prevent adding of jetbrains IDEs configs

Added a forgotten semi-colon

Maybe something to do to declare globally undefined variable format

Not needed comma

Unused variable

Unused variable

Unused params

Could be confusing

Unused params

Could be confusing

JShint validation

JSON dot notation
+
Strict compare between integers
+
Missing semi-colon
+
Unused variables
+
Unused params

Fixing migration from config.json to .jshintrc

Last move was unfinished

Added .idea folder to gitignore

Prevent adding of jetbrains IDEs configs

Added a forgotten semi-colon

Maybe something to do to declare globally undefined variable format

Not needed comma

Unused variable

Unused variable

Unused params

Could be confusing

Unused params

Could be confusing
2014-11-12 19:45:54 +01:00
Mathieu Agopian a1e1c8c5fb Remove the need for a settings_local.py (bug 1050155) 2014-09-01 14:51:04 +02:00
Mathieu Agopian a79684ca8c Revert "Remove the default app (bug 1050154)" 2014-08-19 11:28:19 +02:00