Граф коммитов

388 Коммитов

Автор SHA1 Сообщение Дата
Valentin Rigal 4252aa4d5a
Update Django from 4.2 to 5.1 (#8218)
* Bump Django to 5.1.1 and django rest framework to 3.15.2

* Bump Python to 3.10

Also updates old references

* Replace AlterIndexTogether in migrations

https://docs.djangoproject.com/en/4.2/releases/4.2/#index-together-option-is-deprecated-in-favor-of-indexes

* Fix linters deprecation errors
2024-10-07 16:04:32 +02:00
EvaBardou 494ca3c615
Remove MySQL integration and dedicated code (#7814)
* Remove MySQL integration and dedicated code

* Nit

* Clean up a few more files

* Fix linting

* Propagate DATABASE_URL in other containers
2024-05-30 15:19:56 +02:00
Yoann Schneider 81af089e0e Remove flake8 from requirements and update pip-deps 2024-02-02 21:03:46 +01:00
Tooru Fujisawa 45d0c6749d Bug 1864105 - Add yarn build step to UI Development document. 2023-11-23 15:23:16 +01:00
EliDoesStuff 50430f5396
Bug 1836150 - Adjust treeherder doc to use sheriffs channel instead of treeherder channel (#7708)
* Fixed pre-commit black bug

* Bug 1836150 - Adjust treeherder doc to use sheriffs channel instead of treeherder channel

* Fixed black to python 3.9

* Removed code from another bug
2023-06-22 10:44:48 -07:00
Bastien Abadie 3f1ecd1c06
Update markdown lint to fix CI (#7494)
* Update npm command

* Remove unused references

* Bump markdown lint cli to 0.32.0

* Bump CI node version to 16.16

* Revert "Bump CI node version to 16.16"

This reverts commit 728af86a62.
2022-07-18 15:08:20 -07:00
Sebastian Hengst 5bebdbfe74 Bug 1753209 - remove repositories which have reached end of life or are not accessed anymore through Treeherder 2022-05-13 20:41:21 +02:00
Sarah Clements 0508ab9018
Update docs (#7368)
* Add a data ingestion section
* Update section on deployments
2022-02-08 18:09:41 +00:00
Sebastian Hengst 5541f65cef
Bug 1720181 - migration to remove SETA table (#7371) 2022-01-31 13:06:15 -08:00
Sebastian Hengst a19ef39ee0
Bug 1742068 - update whatsdeployed.io link with version including prototype instance (#7321) 2021-11-22 11:14:40 +00:00
Sebastian Hengst 33de91b9cb
Bug 1740594 - replace references to IRC (#7316) 2021-11-18 11:37:01 +00:00
Sarah Clements 091d422ca0
Make changes to docs (#7184)
* Make changes to docs
* Add cert for prototype connections
* Add TLS_CERT_PATH variable to docker yaml file
* Change troubleshooting and database sections of docs
2021-06-22 16:49:41 -07:00
esanuandra a49e15df68
Fix conflict, add pollyjs dependecies (#7084)
Bug 1698835 - Add puppeteer adapter, add sample test for graphs view

Bug 1698835 - Update sample test with puppeteer

Bug 1698835 - Fix UnhandledPromiseRejectionWarning

Bug 1698835 - Configure jest-puppeteer

Bug 1698835 - Separate integration tests from unit tests

Bug 1698835 - Update yarn.lock

Bug 1698835 - Fix lint errors

Bug 1698835 - Update yarn.lock

Bug 1698835 - Add @neutrinojs/jest to dependencies

Bug 1698835 - Update yarn.lock

Bug 1698835 - Address pr requests, move recordings folder

Bug 1698835 - Fix chromium error

Bug 1698835 - Clean up and update recordings

Bug 1698835 - Add documentation

Bug 1698835 - Update docs
2021-05-31 15:12:57 +03:00
Sarah Clements 5ae9957414
Update docs with new procedures with Treeherder migration off heroku (#7145)
* changes to infrastructure and troubleshooting pages
* remove architecture page
* remove mention of heroku elsewhere in docs
* Remove additional mentions of RDS and move RDS replica access section
2021-05-24 11:39:44 -07:00
Sarah Clements 0b4602c8a3
Improvements to ingesting data locally - doc and docker changes (#7134)
* Update docker-shared-user for pulse_url and add PROJECTS_TO_INGEST to backend container
* Update docs to make them clearer
* Fix exception caught in pytest.raises
2021-05-13 14:20:07 -07:00
Sebastian Hengst 8114e5f129
Bug 1707635 - update documentation how to ingest specific queues with new names (#7118)
Bug 1679162 had split the parsing of logs for failed tasks into multiple dimensions:
- monitored by code sheriffs or not
- raw or JSON data

This added 4 new queues:
- log_parser_fail_raw_sheriffed
- log_parser_fail_json_sheriffed
- log_parser_fail_raw_unsheriffed
- log_parser_fail_json_unsheriffed

The sheriffed ones handle the autoland and mozilla-* trees watched by code
sheriffs, the unsheriffed ones all other trees (e.g. 'try').
2021-04-26 10:32:09 -07:00
Sebastian Hengst e7d9661a71
Bug 1701075 - correct docs how to ingest last N mercurial pushes (#7071) 2021-04-16 11:08:20 -07:00
beatrice-acasandrei 8a4e98588d
Bug 1690259 - Keep perf data with historical value 2021-03-25 14:50:42 +02:00
Ben Hearsum (he/him) dd0216ae40
Re-re-re-remove activedata and bigquery (#7056)
* Bump python to 3.7.10 to try to fix issues with typing module

* Remove requirement on typing again

* Remove bigquery and activedata references (#7051)

* Remove activedata and bigquery again

* Add importlib-metadata to dev requirements

* Remove remnants of selenium tests from setup.cfg

* Don't call taskcluster.aio.createSession outside of async functions (it's not allowed)

* Disable newrelic linters to fix issue with imp module

See https://discuss.newrelic.com/t/python-warnings-during-pytest/114897

* Fix linting errors

* Use pytest-xdist to speed up tests

* Properly ignore newrelic warnings

* Disable django.contrib.staticfiles in tests, because it breaks everything

* Set TREEHERDER_DEBUG=False for unit tests, because it breaks some tests

* Fix linting issues
2021-03-23 09:15:32 -04:00
Ben Hearsum (he/him) 07b0208d73
Backout activedata work again (#7057) 2021-03-17 16:50:16 -04:00
Ben Hearsum (he/him) 687146ce28
Remove bigquery and activedata references (#7051) 2021-03-17 15:24:35 -04:00
Ben Hearsum b6e844093c
Revert activedata & bigquery EOL (#7050) 2021-03-12 14:31:34 -05:00
Ben Hearsum 204783a4be
Bug 1696065 - Remove bigquery and activedata references (#7047) 2021-03-11 13:50:39 -08:00
ionutgoldan df7fe1848e
Bug 1683042 - Document Perfherder's data retention policy 2021-01-13 09:44:44 +02:00
Sarah Clements 21d5561673
Replace Travis with CircleCi (#6935)
* Add .circleci/config.yml
* Initial set up with node and yarn config
* set up heroku builds
* add python test config
* remove most travis references and travis.yml
2020-12-23 17:09:58 -08:00
Cameron Dawson 9908f72189
Bug 1576966 - Convert last Selenium tests to React Testing Library (#6928) 2020-12-21 12:54:07 -08:00
Cameron Dawson f326613cf3
Add new perf table to GRANT docs (#6820) 2020-10-21 09:15:47 -07:00
Armen Zambrano c9b86aa403
Bug 1630293 - Docker, docs and logging changes (#6665)
* Docker: Bug 1630293 - Increase max MySql connections

* docs: Set a concurrency of 1

* docs: Remove the usage of -B for Docker set up

Using -B in more than one instance will cause the remaining celery beats to
execute in more than one container.

* Reduce unsupported known failure line while still reporting to New Relic
2020-07-30 10:23:29 -04:00
Armen Zambrano a49979c5fb
docs: Update info for creating MySql users (#6484) 2020-06-03 13:40:17 -04:00
Armen Zambrano 030b2547dc
docs: Drop info about submitting data via Pulse (#6448) 2020-05-27 08:25:45 -04:00
Armen Zambrano b684475684
docs: Instruction on how to delete data for a project (#6449) 2020-05-22 17:07:28 -04:00
Kimberly Sereduck 08af433cac
specificed that a .env file must first be created (#6428)
Co-authored-by: Kimberly <ksereduck@mozilla.com>
2020-05-18 11:05:35 -07:00
Armen Zambrano 5ca21043df
Make poetry the default method for generating the docs (#6424)
This makes sure that serving the documentation via poetry does not regress
and we have a single way of generating them.

Setting the build backend in `pyproject.toml` makes `pip` to use `poetry` to install the dependencies. By doing so, readthedocs will be able to install the required dependencies to generate the docs (since they don't support poetry directly).
2020-05-15 15:12:35 -04:00
Shubhank Saxena 1892968e10
Document Tox as a requirement for running tests (#6338) 2020-04-22 11:15:44 -04:00
Armen Zambrano 857d72bff1
Move poetry configuration for docs to the top level (#6306)
There were some issues with the original instructions using poetry
for serving the docs.
2020-04-14 01:29:53 -04:00
Cameron Dawson 63646ad34e
Bug 1629139 - Update Pulse Docs and allow skip of ingestion (#6295) 2020-04-13 10:47:07 -07:00
Sarah Clements ca001cb46e
Update docs with grant access (#6276) 2020-04-13 09:45:50 -07:00
Kyle Lahnakoski 53a806d3cc
Test integrate black (#6277)
* Configuration for black

* changes congiguration

* change pyproject's directory

* add files to be excluded and skip string normalization

* removed isort from pre-commit

* remove version locks for black

* fix

* remove all isort

* update requirements

Co-authored-by: SuyashSalampuria <suyash546@gmail.com>
Co-authored-by: Kyle Lahnakoski <kyle@lahnakoski.com>
2020-04-08 14:47:37 -04:00
Cameron Dawson a31426bce0
Bug 1611334 - Remove support for GraphQL (#6235)
Co-authored-by: Kyle Lahnakoski <kyle@lahnakoski.com>
2020-04-07 17:36:57 -04:00
Suyash Salampuria d300d2424f
Merge ingest_push into ingest management command (#6197) 2020-04-07 16:38:53 -04:00
Shubham Kumar 10a2040774 Add markdownlint pre-commit hook and fixed docs
We also add it as part of the Travis execution.
2020-04-07 09:41:54 -04:00
Sarah Clements 29ffbe0ae2
Revert "Run markdown checks in Travis and add it as a pre-commit hook (#6236)" (#6269)
This reverts commit bf67e894b7.
2020-04-03 16:41:16 -04:00
Shubham Kumar bf67e894b7
Run markdown checks in Travis and add it as a pre-commit hook (#6236)
Closes #6185 

- Add markdownlint default rules
- Add `pre-commit` in `dev.txt` with proper hashing required when running Travis
- Add hook in `.pre-commit-config.yaml`
- Refer [here](https://github.com/igorshubovych/markdownlint-cli) for documentation
2020-04-03 09:50:26 -04:00
Kyle Lahnakoski 0fe0362759
Use pip-tools for requirements (#6140)
* update imports, add pip-tools

* first compiled output

* add *.in files (copy of *.txt)

* common.txt from master

* update *.in

* allow upgrade on big-query requirements.txt

* run --upgrade

* example upgrade

* docs

* fix install order

* show how to slim requirements/common.in

* isort

* slim common.in

* isort

* run pip-compile

* fix formatting

* ensure requirements/common.txt is installed last

Co-authored-by: Kyle Lahnakoski <kyle@lahnakoski.com>
2020-04-01 08:15:15 -04:00
Armen Zambrano a3a50d4ccd
Travis: Run Python tests outside of Docker container (#5943)
* Add Travis job to run Python tests outside of Docker
* `runtests.sh` is renamed to `runchecks.sh` and it does not run Python tests
* `manage.py check --deploy` was duplicated in Travis
* Update testing documentation
* Remove `-bb` since it is not needed since Python 3.5
2020-03-20 14:58:11 -04:00
Sarah Clements fbd8c4cc23
Enable pdb in a docker container (#6159)
Add config changes to docker-compose file to support pdb and update docs
2020-03-19 11:07:31 -07:00
Armen Zambrano 24194441aa
Bug 1509181 - Github ingestion: Ingest pushes in the right order (#6070)
Git based projects can list pushes in the UI incorrectly. This can be caused by commits having been ammended on a PR or merges of old commits.

Using the committer's date (the date when the PR gets merged) instead of the author's date to determine push time fixes the sorting problem.

This change also includes:
* Support for manual ingestion of Git pushes
* Support for ingesting the latest commits for a repo
* Script to compare pushes between Treeherder instances

## Script to compare pushes between Treeherder instances

`compare_pushes.py` compares the last 50 pushes of various projects for different Treeherder instances. The output generates links to each instance and revision to visually compare.

```console
% ./misc/compare_pushes.py --projects android-components,fenix,reference-browser,servo-master,servo-auto,servo-try
Comparing android-components against production.
Comparing fenix against production.
Comparing reference-browser against production.
{"values_changed": {"root['push_timestamp']": {"new_value": 1582580346, "old_value": 1582581477}}}
https://treeherder.allizom.org/#/jobs?repo=reference-browser&revision=547a18b97534b237fa87bd22650f342836014c4e
https://treeherder.mozilla.org/#/jobs?repo=reference-browser&revision=547a18b97534b237fa87bd22650f342836014c4e
Comparing servo-master against production.
Comparing servo-auto against production.
Comparing servo-try against production.
```
2020-03-10 14:29:07 -04:00
Shubhank Saxena 4a3472cddf
Docs: Polish pre-commit section (#6113)
Co-authored-by: Armen Zambrano <armenzg@users.noreply.github.com>
2020-03-10 11:37:04 -04:00
Shubhank Saxena 6e309c67e2
Use poetry to generate docs (#6067) 2020-03-09 13:58:01 -04:00
ionutgoldan d6fbb10458
Bug 1544367 - Update the full-stack development section of TH 2020-03-06 11:53:09 +02:00