Граф коммитов

44 Коммитов

Автор SHA1 Сообщение Дата
Tasos Katsoulas 4914546f46
Drop version from compose file. 2024-04-02 15:26:55 +03:00
smith 22ec88d873 Add Celery queue for low resource tasks
* Added priority queue
* Pointed email tasks to priority
2023-12-14 09:12:09 -05:00
Ryan Johnson 28238acfbd
flip the switch to postgres (#5609)
* switch database to postgres

* modify kitsune/dashboards/readouts.py to work with postgres

* modify dashboards/models.py to work with postgres

* modify cache_most_unhelpful_kb_articles.py to work with postgres

* modify wiki/views.py to work with postgres

* modify kpi/api.py to work with postgres

* modify auto_archive_old_questions.py to work with postgres

* ignore email when falsy in FXAAuthBackend.update_user

* fix NotificationsTests.test_solution_notification

* account for postgres ordering of num_visits

* fix question num_votes_past_week when no votes

* fix order_by within the fix_current_revisions command

* improve performance of usernames API

* ensure null values are ordered as expected (1464)

* ensure postgres uses index for helpful votes query (1485)

* ensure announcement query uses timestamp indexes (1492)

* ensure HelpfulVote.created queries use DB index (1492)

* ensure forums.Post.created queries use DB index (1492)

* ensure Question.created queries use DB index (1492)

* ensure QuestionVote.created queries use DB index (1492)

* ensure Question.updated queries use DB index (1492)

* ensure Answer.created/Revision.created queries use DB index (1492)

* limit expensive KPI queries to the last 365 days
2023-11-09 13:33:32 -08:00
smith c854fa2e7c
Merge branch 'main' into remove-es7-prefixes 2022-12-01 16:33:10 -05:00
Smith Ellis 8e57e3164d Remove es7/elasticsearch7 references
Replace es7 and ES7 references with es and ES
Make name in docker version agnostic
Replace name in circle
2022-12-01 21:14:25 +00:00
Tasos Katsoulas 4fc8717f81 Switch mariadb to version 10.7 2022-11-30 15:01:57 +02:00
Tasos Katsoulas c0aadfe2e8 Bump MariaDB to 10.8 2022-11-25 15:46:21 +02:00
Ryan Johnson e095d9e377
remove celery-flower from local docker config (#5199) 2022-08-10 12:28:59 -07:00
Tasos Katsoulas ba78e9cd2a Use gunicorn for local dev.
* Run black on project.
2022-03-10 15:05:17 +02:00
Tasos Katsoulas 500fec16f9 Switch to poetry.
Bump all packages.
2022-03-10 15:05:14 +02:00
Leo McArdle daee4f3fb3
fix db problems in local dev (#4999)
django-debug-toolbar 3.2.3 was causing strings to be truncated when saving to db
mariadb >=10.2.4 includes STRICT_TRANS_TABLES by default, which was causing errors
2022-01-20 16:26:20 +00:00
Tasos Katsoulas 078f819fdc Bump MAriaDB to 10.4 2022-01-07 19:25:39 +02:00
Tasos Katsoulas 78af00f0d8 Update JVM options for ES7 2021-12-13 15:07:25 +02:00
Leo McArdle 2871ee4cb4
move build pipeline to circleci (#4923) 2021-12-07 11:57:44 +00:00
Tasos Katsoulas 3ebcbd5382 Remove ES2 code-base. 2021-05-26 18:09:31 +03:00
Leo McArdle 2428573b49
add support for synonyms and character mappings to search (#4666)
- store synonyms in files
- add reload synonyms option to es7_init
- use non-oss kibana and elasticsearch images to get the reload analyzer api
- add command to create an elastic cloud bundle out of synonym files
- protect specific stop-word containing phrases from tokenization with char mappings
- add docs

https://github.com/mozilla/sumo-project/issues/721
https://github.com/mozilla/sumo-project/issues/748
2021-03-01 18:01:44 +00:00
Tasos Katsoulas d7bf204143 Bump ES7 images to 7.10 2020-12-09 12:49:01 +02:00
Leo McArdle d4728285ca
Merge branch 'master' into elasticsearch-v7 2020-10-21 13:27:38 +01:00
Tasos Katsoulas 2a57a1a066 Remove celery beat and custom FxA queue. 2020-10-21 11:50:50 +03:00
Leo McArdle 99f8ec9ffc
Merge branch 'master' into elasticsearch-v7 2020-10-05 16:50:17 +01:00
Tasos Katsoulas e83a538a72 Add kibana to docker-compose. 2020-09-10 12:43:58 +03:00
Vipul Kumar 91645ed37e
[Fix] set pip's timeout time
If user has low bandwidth, they may get a timeout error while
downloading Python packages from PyPi repository. This happens because
default timeout of pip is set to 60 seconds, which is very less for
large batch process; and it can be changed using "PIP_DEFAULT_TIMEOUT"
environment variable or by passing --default-timeout as an argument to
pip command[1].

[1]: https://pip.pypa.io/en/stable/user_guide/#environment-variables

Docker's "ARG" instruction allows us to pass variable's value at build
time using the `--build-arg <varname>=<value>` flag to `docker
build`[2][3] and `docker-compose build`[4] command. Default value of
"PIP_DEFAULT_TIMEOUT" variable is still set to 60 seconds because bogus
value may increase production built time which we want to fail pretty
fast, if we're not able to fetch something from PyPi. We can set it to 5
mins by running `docker build --build-arg PIP_DEFAULT_TIMEOUT=300` and
`docker-compose build --build-arg PIP_DEFAULT_TIMEOUT=300` for `docker`
and `docker-compose` command respectively.

[2]: https://vsupalov.com/docker-build-time-env-values/
[3]: https://docs.docker.com/engine/reference/builder/#arg
[4]: https://docs.docker.com/compose/reference/build/

Now we can change default timeout value of pip, by pass PIP_TIMEOUT as
an argument[1]. For example, if we want to set timeout value to 5
minutes, run `make build PIP_TIMEOUT=300` or `make build-ci
PIP_TIMEOUT=300` command; default value of PIP_TIMEOUT is 60 which also
the default timeout value of pip, itself.

[5]: https://stackoverflow.com/a/2826178

We only need to use 'PIP_TIMEOUT' variable, where 'base' image is
building because only 'base' image is fetching a lots of Python packages
from PyPi.

And add instruction about, how user can change default timeout value of
pip in the documentation.

Resolves: #4511
2020-08-29 06:50:48 +00:00
Leo McArdle 66e37e1f94 add kibana to docker-compose 2020-08-20 14:36:15 +01:00
Tasos Katsoulas bd765f7cb4 Bump ES7 to version 7.8.1
* Fix typo in Dockerfile
* Expose ES* ports.
2020-08-06 16:37:50 +03:00
Tasos Katsoulas d7d8af1ace Intial ES7 work.
* Initial KB index.
* Task and management commands for indexing
* Monkeypatch for dual search services
* Install ES7 in /vendor
2020-07-27 15:58:08 +03:00
Leo McArdle d003b76c75
add mailcatcher container and docs (#4435) 2020-07-17 18:54:05 +01:00
Leo McArdle 1683716e19
celery: add fxa queue and priority to default queue (#4415) 2020-07-01 11:37:06 +01:00
Leo McArdle f0a31cf29a
split celery worker from flower and beat containers (#4413) 2020-06-10 11:33:39 +01:00
Tasos Katsoulas 072296e5a6 Add celery and celery beat containers. 2020-06-05 13:21:55 +03:00
Tasos Katsoulas 22230f7a86
Remove bower from the project. 2019-11-27 16:49:52 +02:00
Tasos Katsoulas 038659b0d1
Allow attaching in a running container. 2019-10-03 12:54:20 +03:00
eziegenhorn d6f420be88 Initial switch from mozmeao dockerhub and github repos to IT SRE repos 2019-05-10 17:28:20 -05:00
Paul McLanahan c20dfd8d3c Fix build issues
* Ensure docker environment is setup for l10n linting (use make)
* Ensure docker build args are passed to docker (GIT_SHA, and LOCALE_ENV)
* Make git commands for locale repo cleaner with -C
2019-01-03 19:38:38 -05:00
Paul McLanahan 84840e1681 Lint and push l10n files during docker build (#3435)
Also move prod l10n strings repo from "production" branch on the
l10n team's repo to github.com/mozmeao/sumo-l10n-prod.

Fix #3434
2019-01-02 11:11:00 -06:00
Paul McLanahan 3d3a14ed70 Move to a single Dockerfile and docker-compose file
Use make to create easy to use and remember commands for building
and running things.

* Remove Jenkins IRC notifications
* Update the README for the new commands
2018-11-12 11:22:56 -05:00
Giorgos Logiotatidis 5da275e73a Revert "Add max_allow_packet to mysql container."
This reverts commit b940399a23.
2018-03-06 05:58:05 -06:00
Giorgos Logiotatidis b940399a23 Add max_allow_packet to mysql container.
This should fix the 'MySQL has gone away' error during testing.
2018-02-22 04:31:28 -06:00
Giorgos Logiotatidis 0839e86cc3 Create base-dev docker image with npm installed. Add dev instructions. 2017-12-04 10:37:46 -05:00
Giorgos Logiotatidis e40cb0ecc2 Docker compose for dev and testing. 2017-11-30 15:39:49 +02:00
Giorgos Logiotatidis 8405ae1545 Switch docker repo to mozmeao/kitsune. 2017-11-23 09:58:28 +02:00
Giorgos Logiotatidis 2a07a092f4 Get docker caching working in Travis. 2017-11-22 13:28:26 +02:00
Giorgos Logiotatidis b7dddf07dc Run tests on travis. 2017-11-20 13:07:07 +02:00
Giorgos Logiotatidis fac1ce026a Update docker. 2017-11-20 12:54:12 +02:00
Safwan Rahman ba91696d97 Implement docker with docker-compose (#2884)
* First phase implementing docker

* fix Dockerfile

* update hash

* Adding factory boy

* Update to pass more test

* More fixup as per review
2017-11-20 12:50:28 +02:00