Граф коммитов

193 Коммитов

Автор SHA1 Сообщение Дата
Marco Castelluccio 3d36786b58 Install libffi-dev, required for cffi 2019-10-15 14:20:09 +02:00
Marco Castelluccio 7f8e08c20d Add a task to train the test selection model 2019-10-12 17:31:28 +01:00
Marco Castelluccio 2cfd8fc01a Try using relman-svc-compute for the test scheduling history retrieval task 2019-10-10 18:52:08 +01:00
Marco Castelluccio 6ace4d78bc Use relman-svc-memory for the test scheduling history retriever task 2019-10-10 11:08:45 +01:00
dependabot-preview[bot] 86823f36d7 Bump taskcluster from 18.0.3 to 19.0.0 (#1011)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 18.0.3 to 19.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v18.0.3...v19.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-07 23:45:17 +01:00
dependabot-preview[bot] 98937401c2 Bump taskcluster from 18.0.2 to 18.0.3 (#1003)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 18.0.2 to 18.0.3.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v18.0.2...v18.0.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-03 22:51:10 +01:00
dependabot-preview[bot] 71822d21b4 Bump taskcluster from 16.2.0 to 18.0.2 (#1002)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 16.2.0 to 18.0.2.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v16.2.0...v18.0.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-03 20:29:00 +01:00
Marco Castelluccio e397311415 Use absolute paths for classify-patch git repos
And call the directory where gecko-dev is cloned gecko-dev...
2019-10-01 15:49:14 +02:00
Marco Castelluccio c6bd5ec970 Add required arguments to bugbug-classify-commit 2019-10-01 14:10:12 +02:00
Marco Castelluccio 509ecc5368 Run method-level risk analysis 2019-10-01 13:17:06 +02:00
dependabot-preview[bot] 53f40dd8fb Bump python from 3.7.3-slim to 3.7.4-slim in /infra (#996)
Bumps python from 3.7.3-slim to 3.7.4-slim.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-01 13:02:18 +02:00
Marco Castelluccio 251c2712ea Train a more interpretable regressor model 2019-09-30 15:22:02 +02:00
Marco Castelluccio 16e36cb54b Fix similarity model path
It's 25, not 52...

Fixes #939
2019-09-28 18:15:28 +02:00
Marco Castelluccio 10a96964aa Use relman-svc-compute for the classify patch task, as feature importance calculation requires quite a bit of memory 2019-09-28 12:58:53 +02:00
Marco Castelluccio 2add7ecc21 Temporarily disable integration test
Until #985 is fixed
2019-09-27 15:33:42 +02:00
Marco Castelluccio e6cc990f59 Re-enable regressor finder 2019-09-27 12:40:57 +02:00
Boris Feld 5aa036c06d Ensure the integration tests are green before deploying a new HTTP service (#979)
Fixes #949
2019-09-26 15:20:28 +02:00
Marco Castelluccio 0412d894de Offer dataset files from the regressor model as artifacts 2019-09-25 16:56:52 +02:00
Marco Castelluccio 2054e93a1c Generate a DB of past test runs, with their failure history
Also move the artifacts to be in relative directories rather than absolute
2019-09-18 19:58:13 +02:00
Marco Castelluccio 53603d4a4b Don't use bash l option 2019-09-12 14:17:20 +02:00
Marco Castelluccio 7e084dd91a The script is not downloaded in scripts/ 2019-09-12 09:53:23 +02:00
Marco Castelluccio 833c56bb7b Get the raw file from GitHub, not the HTML view 2019-09-12 01:45:46 +02:00
Marco Castelluccio 2492ed58b4 Add a task to retrieve test scheduling history 2019-09-11 21:16:19 +02:00
Adrian-Tamas 625889c9e4 Rearrange requirements alphabetically (#943)
And add a pre-commit hook to enforce it
2019-09-11 12:41:06 +02:00
Marco d65ba69ff3
Add a Dockerfile for tools using bugbug nlp stuff (#934)
* Add a Dockerfile for tools using bugbug nlp stuff

* Use the bugbug-base-nlp image for the similarity training task

Fixes #933
2019-09-07 00:45:47 +02:00
Boris Feld 1b4c47407b Bump training tasks timeout (#932)
We want to keep tasks and metrics artifacts around so we can monitor their
evolution but we don't want to keep the models for a too long period of time
to reduce storage usage.
2019-09-05 11:54:15 +02:00
Marco Castelluccio 7a3909f030 Temporarily disable regressor finder
While I work on a few improvements to it
2019-09-05 00:37:43 +02:00
Ayush Shridhar 59ed555325 Add a task to train a similarity model (the BM25 one) (#874) 2019-09-04 14:38:33 +02:00
Bastien Abadie 69b9c34289 Use taskboot to deploy to PyPI (#923) 2019-09-04 12:37:58 +02:00
dependabot-preview[bot] fc22d839ae Bump taskcluster from 16.0.0 to 16.2.0 (#900)
Bump [taskcluster](https://github.com/taskcluster/taskcluster) from 16.0.0 to 16.2.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v16.0.0...v16.2.0)
2019-09-01 21:23:56 +02:00
Marco Castelluccio cc21b76c51 Use relman-svc instead of releng-svc
Also fix typo in 'svc'
2019-08-09 15:57:17 +02:00
Pankaj Patil e9676d0c2a Rename spawn_data_pipeline.py to spawn_pipeline.py (#855) 2019-08-05 14:27:03 +02:00
Boris Feld 8b4cfd2dc4 Check metrics evolution (#836)
Fixes #360 and fixes #641.
2019-08-05 10:22:55 +02:00
Marco Castelluccio f045e235d4 Revert "Disable multithreaded regressor finder temporarily"
This reverts commit 9b11016b3e.
2019-08-03 00:48:29 +02:00
dependabot-preview[bot] a3bc175ac2 Bump taskcluster from 15.0.0 to 16.0.0 (#843)
Bump [taskcluster](https://github.com/taskcluster/taskcluster) from 15.0.0 to 16.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v15.0.0...v16.0.0)
2019-08-03 00:41:28 +02:00
Marco 8aac03002a
Use relman-* workers instead of releng-svc (#842)
Fixes #324
2019-08-03 00:40:38 +02:00
calixteman 6b34fcf850 Update mercurial to version 5.1 (#841)
Fixes #549.
2019-08-02 17:22:12 +02:00
Marco Castelluccio 9b11016b3e Disable multithreaded regressor finder temporarily
Until we figure out why it's hanging on Taskcluster.
2019-08-02 17:03:02 +02:00
Marco Castelluccio 4980af7070 Use 'reviewers' hg template instead of manually reimplementing its functionality
Fixes #550
2019-08-01 22:31:25 +02:00
dependabot-preview[bot] 001fba1242 Bump pyyaml from 5.1.1 to 5.1.2 (#815)
Bump [pyyaml](https://github.com/yaml/pyyaml) from 5.1.1 to 5.1.2.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/commits)
2019-08-01 01:20:50 +02:00
Marco Castelluccio b2db1fd018 Perform the python->python2 modification in the git hyper-blame script directly as part of the patch 2019-07-31 11:40:37 +02:00
Marco Castelluccio 29ed2b4ed8 Run SZZ on up to 1000 commits at a time, to avoid the task running out of time 2019-07-29 18:22:11 +02:00
Boris Feld afd67402e2 Fix copy-paste typo with the new indexing schema (#801) 2019-07-28 20:38:05 +02:00
Boris Feld a43ad03b2a Add a new indexing schema for training tasks (#795)
In order to efficiently solve #614, we need a new indexing schema
so getting all metrics following a given date is easy.
2019-07-26 18:28:04 +02:00
Marco Castelluccio 60a979be9d Store commits to ignore in a bugbug DB and generate them progressively
In the future, we will be able to get commits to ignore directly from the normal commits DB
generated by bugbug/repositor.py.
2019-07-26 18:14:57 +02:00
Marco Castelluccio 38db5e19dc Fix regressor-finder artifact paths 2019-07-26 16:09:50 +02:00
Marco Castelluccio adb39df6bb Switch to a version-control-tools version fixing an error with the 'bug' mercurial template 2019-07-25 23:56:38 +02:00
Marco Castelluccio f8a5d8f97f Fix paths of the artifacts for the regressor-finder task 2019-07-25 15:56:23 +02:00
Marco Castelluccio 93a2ac8425 Apply a patch to speed-up git hyper-blame and fix a bug due to colliding short hashes 2019-07-25 01:25:05 +02:00
Marco Castelluccio a614d34735 Move download of bugs linked to commits in the bug-retriever script
Also, make the bug-retriever task depend on the commit-retriever one, making the
download of bugs linked to commits actually work :)
2019-07-25 01:05:25 +02:00