mozilla
/
bugbug
зеркало из https://github.com/mozilla/bugbug.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
1 450 коммитов 47 Ветки 548 Теги 398 MiB
Граф коммитов

77 Коммитов

Автор SHA1 Сообщение Дата
Marco Castelluccio 4a642f215f Add the past failures support DB to the artifacts list of the test scheduling history retrieval task 2019-10-22 17:46:15 +01:00
Marco Castelluccio f01badfb11 Add the version file of the test scheduling history DB to the artifacts list of the retrieval task 2019-10-22 17:46:15 +01:00
Marco Castelluccio 898d911013 Fix path in Taskcluster worker to the test scheduling history DB 2019-10-22 17:46:15 +01:00
Marco Castelluccio 0cfacecb57 Fix push_data.json.zst artifact path 2019-10-20 14:04:20 +01:00
Marco Castelluccio 940e97cdcf Be quiet when installing bugbug package in the test scheduling history push data retrieval task 2019-10-19 21:22:42 +01:00
Marco Castelluccio 86a6d0a6b9 Fix dependency name 
Regressed by dc3c3b83da
 2019-10-18 14:20:57 +01:00
Marco Castelluccio 5713425500 Use relman-svc compute for the ADR task 
Since the tasks were split with dc3c3b83da,
the ADR task is not bounded by performance yet.
 2019-10-18 13:38:13 +01:00
Marco Castelluccio dc3c3b83da Split test scheduling history retriever task into two 2019-10-18 13:33:53 +01:00
Marco Castelluccio 7f8e08c20d Add a task to train the test selection model 2019-10-12 17:31:28 +01:00
Marco Castelluccio 2cfd8fc01a Try using relman-svc-compute for the test scheduling history retrieval task 2019-10-10 18:52:08 +01:00
Marco Castelluccio 6ace4d78bc Use relman-svc-memory for the test scheduling history retriever task 2019-10-10 11:08:45 +01:00
Marco Castelluccio 251c2712ea Train a more interpretable regressor model 2019-09-30 15:22:02 +02:00
Marco Castelluccio 16e36cb54b Fix similarity model path 
It's 25, not 52...

Fixes #939
 2019-09-28 18:15:28 +02:00
Marco Castelluccio 2add7ecc21 Temporarily disable integration test 
Until #985 is fixed
 2019-09-27 15:33:42 +02:00
Boris Feld 5aa036c06d Ensure the integration tests are green before deploying a new HTTP service (#979) 
Fixes #949
 2019-09-26 15:20:28 +02:00
Marco Castelluccio 0412d894de Offer dataset files from the regressor model as artifacts 2019-09-25 16:56:52 +02:00
Marco Castelluccio 2054e93a1c Generate a DB of past test runs, with their failure history 
Also move the artifacts to be in relative directories rather than absolute
 2019-09-18 19:58:13 +02:00
Marco Castelluccio 53603d4a4b Don't use bash l option 2019-09-12 14:17:20 +02:00
Marco Castelluccio 7e084dd91a The script is not downloaded in scripts/ 2019-09-12 09:53:23 +02:00
Marco Castelluccio 833c56bb7b Get the raw file from GitHub, not the HTML view 2019-09-12 01:45:46 +02:00
Marco Castelluccio 2492ed58b4 Add a task to retrieve test scheduling history 2019-09-11 21:16:19 +02:00
Marco d65ba69ff3
Add a Dockerfile for tools using bugbug nlp stuff (#934) 
* Add a Dockerfile for tools using bugbug nlp stuff

* Use the bugbug-base-nlp image for the similarity training task

Fixes #933
 2019-09-07 00:45:47 +02:00
Boris Feld 1b4c47407b Bump training tasks timeout (#932) 
We want to keep tasks and metrics artifacts around so we can monitor their
evolution but we don't want to keep the models for a too long period of time
to reduce storage usage.
 2019-09-05 11:54:15 +02:00
Ayush Shridhar 59ed555325 Add a task to train a similarity model (the BM25 one) (#874) 2019-09-04 14:38:33 +02:00
Marco Castelluccio cc21b76c51 Use relman-svc instead of releng-svc 
Also fix typo in 'svc'
 2019-08-09 15:57:17 +02:00
Boris Feld 8b4cfd2dc4 Check metrics evolution (#836) 
Fixes #360 and fixes #641.
 2019-08-05 10:22:55 +02:00
Marco 8aac03002a
Use relman-* workers instead of releng-svc (#842) 
Fixes #324
 2019-08-03 00:40:38 +02:00
Boris Feld afd67402e2 Fix copy-paste typo with the new indexing schema (#801) 2019-07-28 20:38:05 +02:00
Boris Feld a43ad03b2a Add a new indexing schema for training tasks (#795) 
In order to efficiently solve #614, we need a new indexing schema
so getting all metrics following a given date is easy.
 2019-07-26 18:28:04 +02:00
Marco Castelluccio a614d34735 Move download of bugs linked to commits in the bug-retriever script 
Also, make the bug-retriever task depend on the commit-retriever one, making the
download of bugs linked to commits actually work :)
 2019-07-25 01:05:25 +02:00
Marco Castelluccio 66367584cd Revert "Enable feature importance calculation for the defect/enhancement/task model" 
This reverts commit d9cdcdc238.

It's running out of memory on releng-svc-compute workers (c5.4xlarge), so we need to temporarily disable it.
 2019-07-15 15:49:28 +02:00
Anurag Aggarwal 656d6e844b Remove bugs_retrieval image and use the base image instead in its place (#691) 
* Fixes #633
 2019-07-12 14:17:41 +02:00
Marco Castelluccio d9cdcdc238 Enable feature importance calculation for the defect/enhancement/task model 2019-07-11 20:44:07 +02:00
Marco Castelluccio 17b027c767 Enable feature importance calculation at training time for the regressor model 2019-07-10 16:25:38 +02:00
Boris Feld e7add98563 Update task-boot to 0.1.9 (#675) 2019-07-05 15:36:16 +02:00
Marco Castelluccio 6ce18762de 'payload.command' should be an array 2019-07-02 13:26:46 +02:00
Marco Castelluccio d12a25f644 Upload feature visualization image as an artifact of the training tasks 2019-07-01 13:10:39 +02:00
Boris Feld 7459f79317 Use the base image for training models (#656) 
Fixes #350
 2019-06-29 00:01:51 +02:00
Boris Feld d24993d0ac Remove dependency on rollbacktest in docker build. (#653) 
Fixes #651
 2019-06-28 15:32:39 +02:00
Boris Feld 54e41d1497 Use taskboot 0.1.8 (#645) 
The new taskboot release solves the double build on non-tag commits and
allows the heroku deploy to be fully atomic.
 2019-06-28 11:11:48 +02:00
x249wang ab28e8ace2 Use zstandard instead of xz (#524) 
Fixes #461.
 2019-06-24 13:16:44 +02:00
Boris Feld 9834053a36 Start tracking training metrics as Taskcluster artifacts (#604) 
Fixes #342
 2019-06-22 14:18:08 -07:00
Boris Feld 27f9104fb5 Make sure the Docker build task uses the tagged code (#610) 
If not, new master code might get released and conflict with the code in the
bugbug images.

 Fixes #609
 2019-06-21 08:20:08 -07:00
Boris Feld c06db28442 Bump taskboot to version 1.0.7 (#583) 
Now that https://github.com/mozilla/task-boot/issues/39 is fixed, let's update
task-boot version to use it.

Also add missing tags and cache option when building Docker images in
data-pipeline.yml
 2019-06-12 20:11:34 +02:00
Marco Castelluccio 89b37b96ae Upload version file too in the bugs retrieval task 2019-06-09 00:13:20 +02:00
Marco Castelluccio 353d21d01b Clone repository quietly 2019-06-08 11:19:01 +02:00
Marco Castelluccio 4a991ac6ef Fix download of bugs DB in the rollback test 2019-06-08 11:17:15 +02:00
Marco Castelluccio 9de91456f6 Update to taskboot 0.1.6 2019-06-07 22:03:00 +02:00
Boris Feld a8faa48d8a Support classifying batches of bugs with a background worker (#321) 2019-06-07 21:22:14 +02:00
Marco Castelluccio 82d9c0ece0 Update to taskboot 0.1.5 2019-06-07 16:47:28 +02:00