Граф коммитов

70 Коммитов

Автор SHA1 Сообщение Дата
Sebastian Hengst 8e3c9588f3 add pkg-config required by mysqlcient >=2.2 2024-03-05 18:49:02 +01:00
Sebastian Hengst b708a58085 Update yarn in Dockerfile to 1.22.21 2024-02-05 23:07:31 +01:00
Valentin Rigal 307abe8106
Publish ingestion metrics on statsd (#7875)
* Add statsd service

* Add celery task to publish stats

* Add task to prod misc worker

* Fix beat task

* Aggregate stats

* Publish on statsd

* Fix date range filter

* Allow to change statsd host and port

* Add a prefix for stats publication
2023-11-21 20:37:53 +01:00
renovate[bot] e13848b23b Update Node.js to v21 2023-11-08 12:32:09 +01:00
Sebastian Hengst 1e0eddac89
Renovate node20 (#7813)
* Update Node.js to v20.6.1

---------

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-09-20 01:49:58 +02:00
renovate[bot] 1b0aa257f0 Update python Docker tag to v3.9.18
Use Debian bullseye to be able to pull the packages, else error message
'NO_PUBKEY' shown for fetching from Debian Bookworm.
2023-09-01 17:29:58 +02:00
Valentin Rigal f47da7b38d Separate services for postgres and mysql 2023-08-11 11:45:43 +02:00
Valentin Rigal 1a9cbf5593 Ensure postgres is reacheable before starting the application 2023-08-11 11:45:43 +02:00
EvaBardou b50a5d131b Pin current versions for dev requirements + Remove duplicated ones 2023-06-19 10:32:46 +02:00
Joel Maher f41c363333
add --no-deps to pip install. r=suhaib (#7664)
Co-authored-by: Ronan Maher <ronanhmaher@gmail.com>
2023-03-22 10:34:23 -07:00
Sebastian Hengst 6ef986571c fix backend build in Python tests 2023-02-10 23:32:29 +01:00
Joel Maher 0d84ea7458
add glean to treeherder for measuring failure outcomes (#7583)
* add glean to treeherder for measuring failure outcomes

* add glean to treeherder for measuring failure outcomes

* allow for notification of glean metrics and ability to turn on/off glean

* add data review bug

* add updatePinnedJobs function to failureSummaryTab
2023-01-04 14:58:12 -08:00
Joel Maher fc44d42c60
Update python Docker tag to v3.9.16 (#7599)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2022-12-12 12:40:29 -08:00
Joel Maher b46deefbfd
upgrade node to 19.0.1 (#7561) 2022-11-09 08:33:19 -08:00
Joel Maher 7bdca95e90
Update python Docker tag to v3.9.15 (#7566)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2022-11-08 09:23:59 -08:00
Joel Maher 30fc1210f2
adjust wsgi timeout from 20 to 30 seconds. (#7559) 2022-11-02 17:01:05 -07:00
renovate[bot] ec1812bac5
Update Node.js to v19 (#7550)
* Update Node.js to v19

* adjust node in package.json as well

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: Joel Maher <joel.maher@gmail.com>
2022-10-31 10:37:57 -07:00
Joel Maher a3b4e83219
upgrade yarn to 1.22.19 (#7483) 2022-07-12 08:50:49 -07:00
Joel Maher 6931b4c33c
node 18 upgrade (#7481) 2022-07-12 07:20:03 -07:00
Bastien Abadie 6c56b6cd64 Update references to Python 3.9 2022-06-02 15:48:06 +02:00
Bastien Abadie 051dd81bb0 Prod dockerfile needs babel config 2022-05-19 15:36:14 +02:00
Bastien Abadie 2d73bf3e65 Remove neutrino config 2022-05-19 15:36:14 +02:00
Bastien Abadie 68596acba4
Bump to python 3.8 (#7438)
* Bump to python 3.8

* Avoid RuntimeError: dictionary keys changed during iteration

* Fix hanging test_tracker_updates_records_with_missing_data

* Disable pytest warning on on Unraisable exceptions
2022-05-16 11:30:31 -07:00
Sebastian Hengst 4249a80f9f
Celery 5 upgrade: pass application name first in docker entrypoint script (#7442) 2022-05-12 11:36:59 -07:00
Bastien Abadie ec5327138a
Upgrade Celery to v5 (#7434)
* Update position of global celery parameters

* Update celery to 5.2.6

* Reference directly cached-property

* Use shared_task instead of task

* Update env for celery

* Check rabbitmq is up in dev entrypoint

* Setup HOME in dev Dockerfile to avoid mozci crash

* Use INFO log level for celery to see what is going on

* Fix lint on docker/entrypoint.sh

* Update retryable unit test
2022-05-05 23:30:20 +02:00
EvaBardou 32679c1f5a
Bug 1746622 - Listen to mozci classification pulse messages and save results in Treeherder database (#7356)
* Listen to mozci classification pulse messages and save results in Treeherder database

* Nits and suggestions

* Fix tests

* Revert changes

* Add unit tests + Fix review related code snippets

* Nit

* Add a dedicated command to listen to mozci classification pulse messages

Co-authored-by: Eva Bardou <ebardou@teklia.com>
2022-02-07 09:27:51 -08:00
Sebastian Hengst 5541f65cef
Bug 1720181 - migration to remove SETA table (#7371) 2022-01-31 13:06:15 -08:00
Sarah Clements 5a6adb785d
Update to 16.13.2 for latest security release (#7360) 2022-01-17 14:34:09 +00:00
Sebastian Hengst 8a9f7e1481
Bug 1730918 - use default security groups as defined by product in Bugzilla (#7281)
Support for filing issues as security bugs got added in bug 1369067. Having the
security group hardcoded and not matching the default one for the component
causes bugs to get missed during triage.
2021-10-07 11:25:06 +01:00
beatrice-acasandrei 52914339c3
Bug 1732296 - Add report_backfill_outcome to newrelic.ini and entrypoint_prod.sh (#7276) 2021-09-23 14:12:40 +01:00
Renovate Bot 0064611469 Update python Docker tag to v3.7.12 2021-09-20 04:59:20 +00:00
Sarah Clements 7ea0760c58
Remove heroku v2 (#7271)
* update dockerfile and remove post_compile
* remove more heroku mentions
* remove redis heroku ref
* update middleware and CSP
* remove irrelevant test and script references to heroku
remove tox heroku command from circleCI config
* more references removed
* remove prototype2 reference
* remove old TLS check for redis
2021-09-16 11:30:12 +01:00
Sebastian Hengst d397389863
Bug 1429030 - automatically suggest Bugzilla product and component when bug filer gets opened (#7151)
* Add model for file-to-bugzilla-component relation and its ingestion process
* add API endpoint to get Bugzilla product and component for source file path/search term
* bug filer: identify bugzilla product and component to use based on file path
2021-09-13 11:43:45 +01:00
Sarah Clements d7849ac7af
Revert "heroku cleanup (#7219)" (#7245)
This reverts commit 7cb8d8abe7.
2021-08-18 18:22:13 +01:00
renovate[bot] b70d3b3f2b
Update Node.js to v16 (#7136)
* Update Node.js to v16

* update node version

Co-authored-by: Renovate Bot <bot@renovateapp.com>
Co-authored-by: Sarah Clements <sclements313@gmail.com>
2021-08-16 19:51:06 +01:00
Sarah Clements 7cb8d8abe7
heroku cleanup (#7219)
* update dockerfile and remove post_compile
* remove redis heroku ref
* update middleware and CSP
* remove irrelevant test and script references to heroku
remove tox heroku command from circleCI config
* remove get_tls_redis_url and reconfigure default TLS_PATH_CERT in docker file
2021-08-16 14:49:07 +01:00
Renovate Bot b6a723cc3d Update python Docker tag to v3.7.11 2021-07-12 03:20:38 +00:00
Ben Hearsum (he/him) e1c8733be9
Always assume we're in the root of the treeherder repo in entrypoint_prod.sh (#7146) 2021-05-20 13:52:10 -04:00
Jeremiah Orem 84b2974f5b
entrypoint_prod: pass all args to cycle_data and perf sheriff 2021-05-10 14:29:16 -07:00
Jeremiah Orem 3e6c68dd52
Dockerfile: copy schemas in to docker image (#7096) 2021-04-09 09:19:37 -07:00
renovate[bot] dc78379d17
Update Node.js to v14 (#7063)
* update node in docker files
* update docker image to avoid yarn error


Co-authored-by: Renovate Bot <bot@renovateapp.com>
Co-authored-by: Sarah Clements <sclements313@gmail.com>
2021-04-07 11:59:29 -07:00
Ben Hearsum (he/him) 66f1eac118
Add CloudOps-ready Docker builds (#7072)
* First stab at dockerflow support

* Add dockerfile and entrypoint for production builds

* Add docker build to circle

* Add stub version.json file

* Fix linting issues

* Add entrypoints for cronjobs
2021-03-26 16:21:57 -04:00
Ben Hearsum (he/him) dd0216ae40
Re-re-re-remove activedata and bigquery (#7056)
* Bump python to 3.7.10 to try to fix issues with typing module

* Remove requirement on typing again

* Remove bigquery and activedata references (#7051)

* Remove activedata and bigquery again

* Add importlib-metadata to dev requirements

* Remove remnants of selenium tests from setup.cfg

* Don't call taskcluster.aio.createSession outside of async functions (it's not allowed)

* Disable newrelic linters to fix issue with imp module

See https://discuss.newrelic.com/t/python-warnings-during-pytest/114897

* Fix linting errors

* Use pytest-xdist to speed up tests

* Properly ignore newrelic warnings

* Disable django.contrib.staticfiles in tests, because it breaks everything

* Set TREEHERDER_DEBUG=False for unit tests, because it breaks some tests

* Fix linting issues
2021-03-23 09:15:32 -04:00
Cameron Dawson 9908f72189
Bug 1576966 - Convert last Selenium tests to React Testing Library (#6928) 2020-12-21 12:54:07 -08:00
Armen Zambrano 8aab95ad4b
Docker: No need for shellcheck within the Docker container (#6698) 2020-08-10 09:08:07 -04:00
Armen Zambrano c9b86aa403
Bug 1630293 - Docker, docs and logging changes (#6665)
* Docker: Bug 1630293 - Increase max MySql connections

* docs: Set a concurrency of 1

* docs: Remove the usage of -B for Docker set up

Using -B in more than one instance will cause the remaining celery beats to
execute in more than one container.

* Reduce unsupported known failure line while still reporting to New Relic
2020-07-30 10:23:29 -04:00
Armen Zambrano 5ca21043df
Make poetry the default method for generating the docs (#6424)
This makes sure that serving the documentation via poetry does not regress
and we have a single way of generating them.

Setting the build backend in `pyproject.toml` makes `pip` to use `poetry` to install the dependencies. By doing so, readthedocs will be able to install the required dependencies to generate the docs (since they don't support poetry directly).
2020-05-15 15:12:35 -04:00
Armen Zambrano 7fc7df5b2c
Bug 1630293 - Increase max connections for Docker set up (#6346)
The recent addition of Celery workers consumption has increased the usage
of number of connections to the database.

In certain cases like loading a large number of pushes we can hit the maximum
limit of connections.

This change increases the default `max_connections` to 300 (about double).
2020-04-23 14:06:47 -04:00
Armen Zambrano a3a50d4ccd
Travis: Run Python tests outside of Docker container (#5943)
* Add Travis job to run Python tests outside of Docker
* `runtests.sh` is renamed to `runchecks.sh` and it does not run Python tests
* `manage.py check --deploy` was duplicated in Travis
* Update testing documentation
* Remove `-bb` since it is not needed since Python 3.5
2020-03-20 14:58:11 -04:00
Armen Zambrano a2e7e81adc
Bug 1611502 - Do not run initialize_data in Docker container if DATABASE_URL is being used (#5940) 2020-02-06 19:21:28 -05:00