Граф коммитов

62 Коммитов

Автор SHA1 Сообщение Дата
EvaBardou b50a5d131b Pin current versions for dev requirements + Remove duplicated ones 2023-06-19 10:32:46 +02:00
Joel Maher f41c363333
add --no-deps to pip install. r=suhaib (#7664)
Co-authored-by: Ronan Maher <ronanhmaher@gmail.com>
2023-03-22 10:34:23 -07:00
Sebastian Hengst 6ef986571c fix backend build in Python tests 2023-02-10 23:32:29 +01:00
Joel Maher 0d84ea7458
add glean to treeherder for measuring failure outcomes (#7583)
* add glean to treeherder for measuring failure outcomes

* add glean to treeherder for measuring failure outcomes

* allow for notification of glean metrics and ability to turn on/off glean

* add data review bug

* add updatePinnedJobs function to failureSummaryTab
2023-01-04 14:58:12 -08:00
Joel Maher fc44d42c60
Update python Docker tag to v3.9.16 (#7599)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2022-12-12 12:40:29 -08:00
Joel Maher b46deefbfd
upgrade node to 19.0.1 (#7561) 2022-11-09 08:33:19 -08:00
Joel Maher 7bdca95e90
Update python Docker tag to v3.9.15 (#7566)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2022-11-08 09:23:59 -08:00
Joel Maher 30fc1210f2
adjust wsgi timeout from 20 to 30 seconds. (#7559) 2022-11-02 17:01:05 -07:00
renovate[bot] ec1812bac5
Update Node.js to v19 (#7550)
* Update Node.js to v19

* adjust node in package.json as well

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: Joel Maher <joel.maher@gmail.com>
2022-10-31 10:37:57 -07:00
Joel Maher a3b4e83219
upgrade yarn to 1.22.19 (#7483) 2022-07-12 08:50:49 -07:00
Joel Maher 6931b4c33c
node 18 upgrade (#7481) 2022-07-12 07:20:03 -07:00
Bastien Abadie 6c56b6cd64 Update references to Python 3.9 2022-06-02 15:48:06 +02:00
Bastien Abadie 051dd81bb0 Prod dockerfile needs babel config 2022-05-19 15:36:14 +02:00
Bastien Abadie 2d73bf3e65 Remove neutrino config 2022-05-19 15:36:14 +02:00
Bastien Abadie 68596acba4
Bump to python 3.8 (#7438)
* Bump to python 3.8

* Avoid RuntimeError: dictionary keys changed during iteration

* Fix hanging test_tracker_updates_records_with_missing_data

* Disable pytest warning on on Unraisable exceptions
2022-05-16 11:30:31 -07:00
Sebastian Hengst 4249a80f9f
Celery 5 upgrade: pass application name first in docker entrypoint script (#7442) 2022-05-12 11:36:59 -07:00
Bastien Abadie ec5327138a
Upgrade Celery to v5 (#7434)
* Update position of global celery parameters

* Update celery to 5.2.6

* Reference directly cached-property

* Use shared_task instead of task

* Update env for celery

* Check rabbitmq is up in dev entrypoint

* Setup HOME in dev Dockerfile to avoid mozci crash

* Use INFO log level for celery to see what is going on

* Fix lint on docker/entrypoint.sh

* Update retryable unit test
2022-05-05 23:30:20 +02:00
EvaBardou 32679c1f5a
Bug 1746622 - Listen to mozci classification pulse messages and save results in Treeherder database (#7356)
* Listen to mozci classification pulse messages and save results in Treeherder database

* Nits and suggestions

* Fix tests

* Revert changes

* Add unit tests + Fix review related code snippets

* Nit

* Add a dedicated command to listen to mozci classification pulse messages

Co-authored-by: Eva Bardou <ebardou@teklia.com>
2022-02-07 09:27:51 -08:00
Sebastian Hengst 5541f65cef
Bug 1720181 - migration to remove SETA table (#7371) 2022-01-31 13:06:15 -08:00
Sarah Clements 5a6adb785d
Update to 16.13.2 for latest security release (#7360) 2022-01-17 14:34:09 +00:00
Sebastian Hengst 8a9f7e1481
Bug 1730918 - use default security groups as defined by product in Bugzilla (#7281)
Support for filing issues as security bugs got added in bug 1369067. Having the
security group hardcoded and not matching the default one for the component
causes bugs to get missed during triage.
2021-10-07 11:25:06 +01:00
beatrice-acasandrei 52914339c3
Bug 1732296 - Add report_backfill_outcome to newrelic.ini and entrypoint_prod.sh (#7276) 2021-09-23 14:12:40 +01:00
Renovate Bot 0064611469 Update python Docker tag to v3.7.12 2021-09-20 04:59:20 +00:00
Sarah Clements 7ea0760c58
Remove heroku v2 (#7271)
* update dockerfile and remove post_compile
* remove more heroku mentions
* remove redis heroku ref
* update middleware and CSP
* remove irrelevant test and script references to heroku
remove tox heroku command from circleCI config
* more references removed
* remove prototype2 reference
* remove old TLS check for redis
2021-09-16 11:30:12 +01:00
Sebastian Hengst d397389863
Bug 1429030 - automatically suggest Bugzilla product and component when bug filer gets opened (#7151)
* Add model for file-to-bugzilla-component relation and its ingestion process
* add API endpoint to get Bugzilla product and component for source file path/search term
* bug filer: identify bugzilla product and component to use based on file path
2021-09-13 11:43:45 +01:00
Sarah Clements d7849ac7af
Revert "heroku cleanup (#7219)" (#7245)
This reverts commit 7cb8d8abe7.
2021-08-18 18:22:13 +01:00
renovate[bot] b70d3b3f2b
Update Node.js to v16 (#7136)
* Update Node.js to v16

* update node version

Co-authored-by: Renovate Bot <bot@renovateapp.com>
Co-authored-by: Sarah Clements <sclements313@gmail.com>
2021-08-16 19:51:06 +01:00
Sarah Clements 7cb8d8abe7
heroku cleanup (#7219)
* update dockerfile and remove post_compile
* remove redis heroku ref
* update middleware and CSP
* remove irrelevant test and script references to heroku
remove tox heroku command from circleCI config
* remove get_tls_redis_url and reconfigure default TLS_PATH_CERT in docker file
2021-08-16 14:49:07 +01:00
Renovate Bot b6a723cc3d Update python Docker tag to v3.7.11 2021-07-12 03:20:38 +00:00
Ben Hearsum (he/him) e1c8733be9
Always assume we're in the root of the treeherder repo in entrypoint_prod.sh (#7146) 2021-05-20 13:52:10 -04:00
Jeremiah Orem 84b2974f5b
entrypoint_prod: pass all args to cycle_data and perf sheriff 2021-05-10 14:29:16 -07:00
Jeremiah Orem 3e6c68dd52
Dockerfile: copy schemas in to docker image (#7096) 2021-04-09 09:19:37 -07:00
renovate[bot] dc78379d17
Update Node.js to v14 (#7063)
* update node in docker files
* update docker image to avoid yarn error


Co-authored-by: Renovate Bot <bot@renovateapp.com>
Co-authored-by: Sarah Clements <sclements313@gmail.com>
2021-04-07 11:59:29 -07:00
Ben Hearsum (he/him) 66f1eac118
Add CloudOps-ready Docker builds (#7072)
* First stab at dockerflow support

* Add dockerfile and entrypoint for production builds

* Add docker build to circle

* Add stub version.json file

* Fix linting issues

* Add entrypoints for cronjobs
2021-03-26 16:21:57 -04:00
Ben Hearsum (he/him) dd0216ae40
Re-re-re-remove activedata and bigquery (#7056)
* Bump python to 3.7.10 to try to fix issues with typing module

* Remove requirement on typing again

* Remove bigquery and activedata references (#7051)

* Remove activedata and bigquery again

* Add importlib-metadata to dev requirements

* Remove remnants of selenium tests from setup.cfg

* Don't call taskcluster.aio.createSession outside of async functions (it's not allowed)

* Disable newrelic linters to fix issue with imp module

See https://discuss.newrelic.com/t/python-warnings-during-pytest/114897

* Fix linting errors

* Use pytest-xdist to speed up tests

* Properly ignore newrelic warnings

* Disable django.contrib.staticfiles in tests, because it breaks everything

* Set TREEHERDER_DEBUG=False for unit tests, because it breaks some tests

* Fix linting issues
2021-03-23 09:15:32 -04:00
Cameron Dawson 9908f72189
Bug 1576966 - Convert last Selenium tests to React Testing Library (#6928) 2020-12-21 12:54:07 -08:00
Armen Zambrano 8aab95ad4b
Docker: No need for shellcheck within the Docker container (#6698) 2020-08-10 09:08:07 -04:00
Armen Zambrano c9b86aa403
Bug 1630293 - Docker, docs and logging changes (#6665)
* Docker: Bug 1630293 - Increase max MySql connections

* docs: Set a concurrency of 1

* docs: Remove the usage of -B for Docker set up

Using -B in more than one instance will cause the remaining celery beats to
execute in more than one container.

* Reduce unsupported known failure line while still reporting to New Relic
2020-07-30 10:23:29 -04:00
Armen Zambrano 5ca21043df
Make poetry the default method for generating the docs (#6424)
This makes sure that serving the documentation via poetry does not regress
and we have a single way of generating them.

Setting the build backend in `pyproject.toml` makes `pip` to use `poetry` to install the dependencies. By doing so, readthedocs will be able to install the required dependencies to generate the docs (since they don't support poetry directly).
2020-05-15 15:12:35 -04:00
Armen Zambrano 7fc7df5b2c
Bug 1630293 - Increase max connections for Docker set up (#6346)
The recent addition of Celery workers consumption has increased the usage
of number of connections to the database.

In certain cases like loading a large number of pushes we can hit the maximum
limit of connections.

This change increases the default `max_connections` to 300 (about double).
2020-04-23 14:06:47 -04:00
Armen Zambrano a3a50d4ccd
Travis: Run Python tests outside of Docker container (#5943)
* Add Travis job to run Python tests outside of Docker
* `runtests.sh` is renamed to `runchecks.sh` and it does not run Python tests
* `manage.py check --deploy` was duplicated in Travis
* Update testing documentation
* Remove `-bb` since it is not needed since Python 3.5
2020-03-20 14:58:11 -04:00
Armen Zambrano a2e7e81adc
Bug 1611502 - Do not run initialize_data in Docker container if DATABASE_URL is being used (#5940) 2020-02-06 19:21:28 -05:00
Armen Zambrano cea5c06fc7
SETA related changes (#5851)
* Development Docker container to initialize data

`docker-compose up` will now initialize the data for the local database.
This will also include initializing SETA's data.

* Change SETA's logging level and preseed information

The preseed information was all for Buildbot
The logging level changes is in preparation for when production switching to INFO messages instead of WARNING

* Docker container to log INFO messages instead of DEBUG messages

`LOGGING_LEVEL` is now set for the Docker container and it sets the logging
to `INFO` instead of `DEBUG`. The Django app will still be initialize in
debug mode but the default logging will be informative messages.

You can still log debugging messages by setting `LOGGING_LEVEL=DEBUG` before
initializing the Docker container.
2020-01-22 14:28:18 -05:00
Armen Zambrano G 11d465a45a Revert "Fix incorrect version of graphql_relay being released"
This reverts commit 989626a007.
2019-07-16 13:32:11 -04:00
Sarah Clements 989626a007 Fix incorrect version of graphql_relay being released
See https://github.com/graphql-python/graphql-relay-py/issues/23 for details
2019-07-15 16:51:32 -04:00
Armen Zambrano deaf8c850c Bug 1169263 - Switch from Vagrant to docker-compose (#4901)
* Change permissions for docker/entrypoint.sh
* Allow using Django in localhost
* Documentation changes
Allow running shellcheck tests
Use docker-compose for the Selenium tests
Install docs updates
Switch to yarn cache instead of npm
Install UI dependencies
* Add ability to override DATABASE_URL and use a .env file
2019-05-16 14:56:02 -07:00
Ed Morley 8375a4aa02 Bug 1225154 - Remove out of date fig/docker configs
We will likely switch to a Docker based solution in the future, however
for now the configs are unused and out of date (fig has been replaced
with docker-compose, we no longer generate per-repo credentials etc).
In addition, there are tools that can convert the Heroku Procfile into
Docker configs, so we may end up using a solution based on that instead.

As such, let's remove the configs (they'll always be available in
version control history) to reduce the maintenance burden and clutter in
the repo.
2015-11-16 16:13:12 +00:00
Ed Morley 50cec5c1fe Bug 1221806 - Change the stage/prod Gunicorn timeout from 120s to 30s
To help prevent excessively demanding queries from having a detrimental
effect on the API/DBs.
2015-11-05 14:22:30 +00:00
Mauro Doglio 829cf22bc4 Bug 1193836 - Update vm provisioning
This patch replaces the use of init_master_db with django `migrate`
and `load_initial_data` commands.
2015-10-27 11:19:17 +00:00
Ed Morley a5999ac2b9 Bug 1197186 - Move wsgi.py to a generic config/ directory
Since it's not specific to the Django app 'webapp'.
2015-10-08 19:59:44 +01:00