mozilla
/
bugbug
зеркало из https://github.com/mozilla/bugbug.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
1 886 коммитов 47 Ветки 548 Теги 397 MiB
Граф коммитов

301 Коммитов

Автор SHA1 Сообщение Дата
Philemon Johnson 2047243f2e When using pip in .taskcluster.yml and in Docker files, add options --disable-pip-version-check, --no-cache-dir and --quiet (#1032) 2019-10-21 17:42:39 +01:00
Marco Castelluccio 0cfacecb57 Fix push_data.json.zst artifact path 2019-10-20 14:04:20 +01:00
Marco Castelluccio 940e97cdcf Be quiet when installing bugbug package in the test scheduling history push data retrieval task 2019-10-19 21:22:42 +01:00
Marco Castelluccio 86a6d0a6b9 Fix dependency name 
Regressed by dc3c3b83da
 2019-10-18 14:20:57 +01:00
Marco Castelluccio 5713425500 Use relman-svc compute for the ADR task 
Since the tasks were split with dc3c3b83da,
the ADR task is not bounded by performance yet.
 2019-10-18 13:38:13 +01:00
Marco Castelluccio dc3c3b83da Split test scheduling history retriever task into two 2019-10-18 13:33:53 +01:00
dependabot-preview[bot] 13973a6cc0 Bump taskcluster from 20.0.0 to 21.0.0 (#1026) 
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 20.0.0 to 21.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v20.0.0...v21.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-18 11:55:23 +02:00
dependabot-preview[bot] 90c676a4ce Bump taskcluster from 19.0.0 to 20.0.0 (#1020) 
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 19.0.0 to 20.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v19.0.0...v20.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-16 14:47:04 +02:00
Marco Castelluccio 3d36786b58 Install libffi-dev, required for cffi 2019-10-15 14:20:09 +02:00
Marco Castelluccio 7f8e08c20d Add a task to train the test selection model 2019-10-12 17:31:28 +01:00
Marco Castelluccio 2cfd8fc01a Try using relman-svc-compute for the test scheduling history retrieval task 2019-10-10 18:52:08 +01:00
Marco Castelluccio 6ace4d78bc Use relman-svc-memory for the test scheduling history retriever task 2019-10-10 11:08:45 +01:00
dependabot-preview[bot] 86823f36d7 Bump taskcluster from 18.0.3 to 19.0.0 (#1011) 
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 18.0.3 to 19.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v18.0.3...v19.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-07 23:45:17 +01:00
dependabot-preview[bot] 98937401c2 Bump taskcluster from 18.0.2 to 18.0.3 (#1003) 
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 18.0.2 to 18.0.3.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v18.0.2...v18.0.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-03 22:51:10 +01:00
dependabot-preview[bot] 71822d21b4 Bump taskcluster from 16.2.0 to 18.0.2 (#1002) 
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 16.2.0 to 18.0.2.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v16.2.0...v18.0.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-03 20:29:00 +01:00
Marco Castelluccio e397311415 Use absolute paths for classify-patch git repos 
And call the directory where gecko-dev is cloned gecko-dev...
 2019-10-01 15:49:14 +02:00
Marco Castelluccio c6bd5ec970 Add required arguments to bugbug-classify-commit 2019-10-01 14:10:12 +02:00
Marco Castelluccio 509ecc5368 Run method-level risk analysis 2019-10-01 13:17:06 +02:00
dependabot-preview[bot] 53f40dd8fb Bump python from 3.7.3-slim to 3.7.4-slim in /infra (#996) 
Bumps python from 3.7.3-slim to 3.7.4-slim.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-01 13:02:18 +02:00
Marco Castelluccio 251c2712ea Train a more interpretable regressor model 2019-09-30 15:22:02 +02:00
Marco Castelluccio 16e36cb54b Fix similarity model path 
It's 25, not 52...

Fixes #939
 2019-09-28 18:15:28 +02:00
Marco Castelluccio 10a96964aa Use relman-svc-compute for the classify patch task, as feature importance calculation requires quite a bit of memory 2019-09-28 12:58:53 +02:00
Marco Castelluccio 2add7ecc21 Temporarily disable integration test 
Until #985 is fixed
 2019-09-27 15:33:42 +02:00
Marco Castelluccio e6cc990f59 Re-enable regressor finder 2019-09-27 12:40:57 +02:00
Boris Feld 5aa036c06d Ensure the integration tests are green before deploying a new HTTP service (#979) 
Fixes #949
 2019-09-26 15:20:28 +02:00
Marco Castelluccio 0412d894de Offer dataset files from the regressor model as artifacts 2019-09-25 16:56:52 +02:00
Marco Castelluccio 2054e93a1c Generate a DB of past test runs, with their failure history 
Also move the artifacts to be in relative directories rather than absolute
 2019-09-18 19:58:13 +02:00
Marco Castelluccio 53603d4a4b Don't use bash l option 2019-09-12 14:17:20 +02:00
Marco Castelluccio 7e084dd91a The script is not downloaded in scripts/ 2019-09-12 09:53:23 +02:00
Marco Castelluccio 833c56bb7b Get the raw file from GitHub, not the HTML view 2019-09-12 01:45:46 +02:00
Marco Castelluccio 2492ed58b4 Add a task to retrieve test scheduling history 2019-09-11 21:16:19 +02:00
Adrian-Tamas 625889c9e4 Rearrange requirements alphabetically (#943) 
And add a pre-commit hook to enforce it
 2019-09-11 12:41:06 +02:00
Marco d65ba69ff3
Add a Dockerfile for tools using bugbug nlp stuff (#934) 
* Add a Dockerfile for tools using bugbug nlp stuff

* Use the bugbug-base-nlp image for the similarity training task

Fixes #933
 2019-09-07 00:45:47 +02:00
Boris Feld 1b4c47407b Bump training tasks timeout (#932) 
We want to keep tasks and metrics artifacts around so we can monitor their
evolution but we don't want to keep the models for a too long period of time
to reduce storage usage.
 2019-09-05 11:54:15 +02:00
Marco Castelluccio 7a3909f030 Temporarily disable regressor finder 
While I work on a few improvements to it
 2019-09-05 00:37:43 +02:00
Ayush Shridhar 59ed555325 Add a task to train a similarity model (the BM25 one) (#874) 2019-09-04 14:38:33 +02:00
Bastien Abadie 69b9c34289 Use taskboot to deploy to PyPI (#923) 2019-09-04 12:37:58 +02:00
dependabot-preview[bot] fc22d839ae Bump taskcluster from 16.0.0 to 16.2.0 (#900) 
Bump [taskcluster](https://github.com/taskcluster/taskcluster) from 16.0.0 to 16.2.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v16.0.0...v16.2.0)
 2019-09-01 21:23:56 +02:00
Marco Castelluccio cc21b76c51 Use relman-svc instead of releng-svc 
Also fix typo in 'svc'
 2019-08-09 15:57:17 +02:00
Pankaj Patil e9676d0c2a Rename spawn_data_pipeline.py to spawn_pipeline.py (#855) 2019-08-05 14:27:03 +02:00
Boris Feld 8b4cfd2dc4 Check metrics evolution (#836) 
Fixes #360 and fixes #641.
 2019-08-05 10:22:55 +02:00
Marco Castelluccio f045e235d4 Revert "Disable multithreaded regressor finder temporarily" 
This reverts commit 9b11016b3e.
 2019-08-03 00:48:29 +02:00
dependabot-preview[bot] a3bc175ac2 Bump taskcluster from 15.0.0 to 16.0.0 (#843) 
Bump [taskcluster](https://github.com/taskcluster/taskcluster) from 15.0.0 to 16.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v15.0.0...v16.0.0)
 2019-08-03 00:41:28 +02:00
Marco 8aac03002a
Use relman-* workers instead of releng-svc (#842) 
Fixes #324
 2019-08-03 00:40:38 +02:00
calixteman 6b34fcf850 Update mercurial to version 5.1 (#841) 
Fixes #549.
 2019-08-02 17:22:12 +02:00
Marco Castelluccio 9b11016b3e Disable multithreaded regressor finder temporarily 
Until we figure out why it's hanging on Taskcluster.
 2019-08-02 17:03:02 +02:00
Marco Castelluccio 4980af7070 Use 'reviewers' hg template instead of manually reimplementing its functionality 
Fixes #550
 2019-08-01 22:31:25 +02:00
dependabot-preview[bot] 001fba1242 Bump pyyaml from 5.1.1 to 5.1.2 (#815) 
Bump [pyyaml](https://github.com/yaml/pyyaml) from 5.1.1 to 5.1.2.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/commits)
 2019-08-01 01:20:50 +02:00
Marco Castelluccio b2db1fd018 Perform the python->python2 modification in the git hyper-blame script directly as part of the patch 2019-07-31 11:40:37 +02:00
Marco Castelluccio 29ed2b4ed8 Run SZZ on up to 1000 commits at a time, to avoid the task running out of time 2019-07-29 18:22:11 +02:00
Boris Feld afd67402e2 Fix copy-paste typo with the new indexing schema (#801) 2019-07-28 20:38:05 +02:00
Boris Feld a43ad03b2a Add a new indexing schema for training tasks (#795) 
In order to efficiently solve #614, we need a new indexing schema
so getting all metrics following a given date is easy.
 2019-07-26 18:28:04 +02:00
Marco Castelluccio 60a979be9d Store commits to ignore in a bugbug DB and generate them progressively 
In the future, we will be able to get commits to ignore directly from the normal commits DB
generated by bugbug/repositor.py.
 2019-07-26 18:14:57 +02:00
Marco Castelluccio 38db5e19dc Fix regressor-finder artifact paths 2019-07-26 16:09:50 +02:00
Marco Castelluccio adb39df6bb Switch to a version-control-tools version fixing an error with the 'bug' mercurial template 2019-07-25 23:56:38 +02:00
Marco Castelluccio f8a5d8f97f Fix paths of the artifacts for the regressor-finder task 2019-07-25 15:56:23 +02:00
Marco Castelluccio 93a2ac8425 Apply a patch to speed-up git hyper-blame and fix a bug due to colliding short hashes 2019-07-25 01:25:05 +02:00
Marco Castelluccio a614d34735 Move download of bugs linked to commits in the bug-retriever script 
Also, make the bug-retriever task depend on the commit-retriever one, making the
download of bugs linked to commits actually work :)
 2019-07-25 01:05:25 +02:00
Marco Castelluccio 5ef2a5039f Upload version files as artifacts too 
Plus the tokenized bug introducing commits
 2019-07-24 22:15:04 +02:00
Marco Castelluccio 22d73e3637 Apply regressor finder also on the microannotated repository with comments removed 
Fixes #627
 2019-07-24 22:15:04 +02:00
Marco Castelluccio 839ebf8fcf Make git repo URL a parameter, so we can find regressors using different git repositories 2019-07-24 21:01:53 +02:00
dependabot-preview[bot] e2fa9b63e6 Bump taskcluster from 14.3.1 to 15.0.0 (#774) 
Bump [taskcluster](https://github.com/taskcluster/taskcluster) from 14.3.1 to 15.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v14.3.1...v15.0.0)
 2019-07-24 11:14:39 +02:00
Marco Castelluccio 63c967f9a0 Move regressor-finder task after the microannotate ones 2019-07-24 10:59:45 +02:00
Marco Castelluccio 61ab656795 Add regressor-finder to run-again's dependencies 2019-07-24 10:56:43 +02:00
Marco Castelluccio 5b8ac293b9 Use releng-svc-compute for the regressor finder script 2019-07-24 01:46:33 +02:00
Marco Castelluccio d245c9e998 Use rust-code-analysis v0.0.2 2019-07-23 13:37:27 +02:00
Marco Castelluccio 1e35bc3605 Disable detached head warning 2019-07-23 12:26:38 +02:00
Marco Castelluccio 539dbc223f Remove some unused directories of version-control-tools and depot_tools 2019-07-23 12:26:12 +02:00
Marco Castelluccio f28fc651d0 Install rust-code-analysis in the commit retrieval image 2019-07-23 12:16:13 +02:00
Marco Castelluccio debf7d4e02 Add all microannotate-* tasks as dependencies of run-again 2019-07-23 10:51:21 +02:00
Marco Castelluccio a03e9e8df1 Fix mirror repository URL 2019-07-23 10:50:41 +02:00
Marco Castelluccio 7bd391e307 Generate mirror repositories with comments removed and both tokenized and with comments removed 2019-07-23 02:14:22 +02:00
Marco Castelluccio ab048e0a6b Support generating mirror repositories with comments removed 2019-07-23 02:14:22 +02:00
Marco Castelluccio fbaef0661d Store regressor finder results in bugbug DBs and make it run only on commits which haven't been analyzed yet 2019-07-23 02:14:22 +02:00
Marco Castelluccio 7608dd56cf Make git-hyper-blame run with Python 2 2019-07-22 23:20:01 +02:00
Marco Castelluccio 453bd8125f Checkout to a specific revision of depot_tools, to make everything reproducible 2019-07-22 23:20:01 +02:00
Marco Castelluccio b5d67d156a Add depot_tools path at the end of PATH 2019-07-22 23:20:01 +02:00
Marco 77ec8b529d
Add a WIP script to find bug-introducing commits (#748) 
* Install depot_tools in the commit retrieval image

* Add a WIP script to find bug-introducing commits

* Add a task which runs the bug-introducing commits finder script
 2019-07-22 14:41:34 +02:00
dependabot-preview[bot] 660935c0db Bump taskcluster from 7.0.1 to 14.3.1 (#763) 
Bump [taskcluster](https://github.com/taskcluster/taskcluster) from 7.0.1 to 14.3.1.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/commits/v14.3.1)
 2019-07-22 12:28:28 +02:00
Marco Castelluccio 830d88b1eb Disable the cache when installing bugbug 2019-07-16 20:48:48 +02:00
Marco Castelluccio e858728229 Remove version-control-tools Mercurial directory, as we don't need to perform any mercurial operation on it 2019-07-16 20:48:48 +02:00
Marco Castelluccio 8de0987369 Remove secrets:get:* scopes from hook, as they are implied by the roles 2019-07-15 22:31:30 +02:00
Marco Castelluccio 868e65fe32 Add scope to trigger bugbug-annotate hook to the 'run-again' task 2019-07-15 22:05:43 +02:00
Marco Castelluccio 9b0e9e8c90 Retrigger when not done, not when done 2019-07-15 22:03:39 +02:00
Marco Castelluccio 7fbfc41325 Consider tasks which don't have a 'done' artifact as fully done 2019-07-15 22:03:39 +02:00
Marco Castelluccio 085d157af4 Fix 'done' artifact path 2019-07-15 22:01:52 +02:00
Marco Castelluccio 7abab83654 Add taskclusterProxy feature for the 'run-again' task 2019-07-15 21:41:50 +02:00
Marco Castelluccio 66367584cd Revert "Enable feature importance calculation for the defect/enhancement/task model" 
This reverts commit d9cdcdc238.

It's running out of memory on releng-svc-compute workers (c5.4xlarge), so we need to temporarily disable it.
 2019-07-15 15:49:28 +02:00
Marco f877420959
Retrigger microannotate hook if the generation process is not fully done (#700) 
* Generate an artifact specifying if the microannotate generation is fully done

* Retrigger microannotate hook if the generation process is not fully done

Fixes #652

* Update to microannotate 0.0.2
 2019-07-15 14:01:56 +02:00
Anurag Aggarwal 656d6e844b Remove bugs_retrieval image and use the base image instead in its place (#691) 
* Fixes #633
 2019-07-12 14:17:41 +02:00
Marco Castelluccio d9cdcdc238 Enable feature importance calculation for the defect/enhancement/task model 2019-07-11 20:44:07 +02:00
Marco d426d5e66e
Revert "Revert "Remove pip from the commit retrieval image (#676)" (#686)" (#687) 
This reverts commit e84c248e19.
 2019-07-11 02:02:04 +02:00
Marco e84c248e19
Revert "Remove pip from the commit retrieval image (#676)" (#686) 
This reverts commit e7ed31940c.
 2019-07-10 16:52:04 +02:00
Marco Castelluccio 9a53baf7ec Upload importances.json files as an artifact 2019-07-10 16:39:48 +02:00
Marco Castelluccio 17b027c767 Enable feature importance calculation at training time for the regressor model 2019-07-10 16:25:38 +02:00
Davide Monfrecola e7ed31940c Remove pip from the commit retrieval image (#676) 
Fixes #647
 2019-07-09 18:32:57 +02:00
Marco Castelluccio 261bff6ab0 Rename public/probs,json artifact to public/probs.json 2019-07-09 14:41:03 +02:00
Boris Feld e7add98563 Update task-boot to 0.1.9 (#675) 2019-07-05 15:36:16 +02:00
Marco Castelluccio d08e062c68 Improve triggerSchema of the hooks and test it 2019-07-03 17:26:01 +02:00
Marco Castelluccio aac6326ba5 Index classify-patch task in the Taskcluster index by diff ID 
Fixes #668
 2019-07-03 15:46:35 +02:00
Marco Castelluccio 28cb2b291e Insert the Phabricator diff ID in the command directly rather than in the env 2019-07-03 15:46:21 +02:00
Marco Castelluccio 3315532904 Use mozilla/bugbug-commit-retrieval image for the classify-patch hook 
Since we need to use Mercurial
 2019-07-03 10:40:02 +02:00
Marco Castelluccio 9de3aa70f2 Add TC_SECRET_ID to the env of the classify-patch hook 2019-07-03 10:39:37 +02:00
Marco Castelluccio 7e6cf9cf2e Set version of other bugbug images too 2019-07-02 21:04:23 +02:00
Marco Castelluccio cb5f54f89f Use bash to resolve env variable 2019-07-02 21:04:23 +02:00
Marco Castelluccio 71ebbae38a Handle cases where the hook definition already contains something in the env 
Also refactor the file to make it more easily testable
 2019-07-02 20:52:57 +02:00
Marco Castelluccio 8e23bb7f8a Add a hook to classify a Phabricator diff 2019-07-02 19:39:59 +02:00
Marco Castelluccio 6ce18762de 'payload.command' should be an array 2019-07-02 13:26:46 +02:00
Marco Castelluccio d12a25f644 Upload feature visualization image as an artifact of the training tasks 2019-07-01 13:10:39 +02:00
Boris Feld 7459f79317 Use the base image for training models (#656) 
Fixes #350
 2019-06-29 00:01:51 +02:00
Boris Feld d24993d0ac Remove dependency on rollbacktest in docker build. (#653) 
Fixes #651
 2019-06-28 15:32:39 +02:00
Boris Feld 2977a8af89 Start tracking the decision task of the data pipeline (#649) 
This way we can automate the stop of a running data pipeline during the
rollback process.
 2019-06-28 15:32:04 +02:00
Boris Feld 54e41d1497 Use taskboot 0.1.8 (#645) 
The new taskboot release solves the double build on non-tag commits and
allows the heroku deploy to be fully atomic.
 2019-06-28 11:11:48 +02:00
Boris Feld 2b48e153cb Use tagged version in bugbug hooks (#640) 
Fixes #634
 2019-06-27 15:47:57 +02:00
Marco Castelluccio eb8f847d43 Install 'git' package in the commit_retrieval image 
Even though it's only required for the annotate pipeline.
 2019-06-27 01:25:58 +02:00
Marco Castelluccio f65bf19ab8 Disable pip cache when installing Mercurial 2019-06-27 01:25:22 +02:00
Marco Castelluccio afac5cbdb6 Remove apt lists after installing Python 2 2019-06-27 01:24:59 +02:00
Marco Castelluccio ad67d76992 Use bugbug-commit-retrieval image for the microannotate-generate task, as need Mercurial to be installed 2019-06-27 01:14:32 +02:00
Marco Castelluccio 4a2759e9b0 Add TC_SECRET_ID env variable to microannotate-generate task 2019-06-27 01:13:51 +02:00
Marco Castelluccio 8fd3be99ce Command must be split in two lines 2019-06-26 22:28:40 +02:00
Marco Castelluccio 252e29398d command should be an array 2019-06-26 21:01:31 +02:00
Marco Castelluccio 4b56be37a9 Add missing secrets scope to annotate hook 2019-06-26 19:45:44 +02:00
Marco Castelluccio b01eeafe44 Add annotate-pipeline.yml file to the spawn_pipeline Docker image 2019-06-26 19:45:22 +02:00
Marco Castelluccio ea7a009450 Fix schedule value 2019-06-26 19:40:19 +02:00
Marco Castelluccio 56f224b9dc Generate microannotate repository for mozilla-central 2019-06-26 18:57:36 +02:00
x249wang ab28e8ace2 Use zstandard instead of xz (#524) 
Fixes #461.
 2019-06-24 13:16:44 +02:00
Boris Feld 9834053a36 Start tracking training metrics as Taskcluster artifacts (#604) 
Fixes #342
 2019-06-22 14:18:08 -07:00
Boris Feld 27f9104fb5 Make sure the Docker build task uses the tagged code (#610) 
If not, new master code might get released and conflict with the code in the
bugbug images.

 Fixes #609
 2019-06-21 08:20:08 -07:00
Boris Feld 417f2aae69 Use a single spawn image for both hooks (#594) 
This removes the need to keep two different Docker images for spawning the
data pipeline and the check pipeline.

Fixes #365
 2019-06-14 18:54:21 +02:00
Boris Feld c06db28442 Bump taskboot to version 1.0.7 (#583) 
Now that https://github.com/mozilla/task-boot/issues/39 is fixed, let's update
task-boot version to use it.

Also add missing tags and cache option when building Docker images in
data-pipeline.yml
 2019-06-12 20:11:34 +02:00
Marco Castelluccio 89b37b96ae Upload version file too in the bugs retrieval task 2019-06-09 00:13:20 +02:00
Marco Castelluccio 353d21d01b Clone repository quietly 2019-06-08 11:19:01 +02:00
Marco Castelluccio 4a991ac6ef Fix download of bugs DB in the rollback test 2019-06-08 11:17:15 +02:00
Marco Castelluccio 76b82d0427 Load yaml safely 
This is mostly to avoid warnings, as the yaml files we load are fully controlled by us.
 2019-06-07 23:34:14 +02:00
Marco Castelluccio 9de91456f6 Update to taskboot 0.1.6 2019-06-07 22:03:00 +02:00
Boris Feld a8faa48d8a Support classifying batches of bugs with a background worker (#321) 2019-06-07 21:22:14 +02:00
Marco Castelluccio 82d9c0ece0 Update to taskboot 0.1.5 2019-06-07 16:47:28 +02:00
Boris Feld 2e05e57be2 Build docker images data pipeline tag (#566) 
* Build the HTTP Docker image with the right tag

* Ensure the builded docker image has the right parent image
 2019-06-07 16:46:05 +02:00
Boris Feld 2988700028 Use tagged index urls for pushing artifacts (#561) 
* Use tagged index urls for pushing artifacts

Also replace previous code that updated Docker image tag to use JSON-e
templating instead.
 2019-06-07 12:52:29 +02:00
Boris Feld 7906380e6f Bump version of taskboot to use latest version of img tool (#562) 
It is necessary to support mulit-tag Docker image building
 2019-06-07 12:21:09 +02:00
Boris Feld e0accae208 Move string formatting to f-string in spawn_data_pipeline (#559) 2019-06-07 11:04:33 +02:00
pyup.io bot c590278bff Update pyyaml from 5.1 to 5.1.1 (#560) 2019-06-07 10:56:26 +02:00
Boris Feld 5a31c99ac9 Add support for specific Docker tag in spawn_data_pipeline.py (#553) 
* Revert "Revert "Add support for specific Docker tag in spawn_data_pipeline.py (#489)" (#499)"

This reverts commit 249ed40eb6.

* Ignore task with a tagged docker image

* Restrict Docker tag update to bugbug related images
 2019-06-06 19:14:27 +02:00
Boris Feld 32f56a3962 Add a script to update the hook definition with the TAG during release (#507) 
Fixes #501, fixed relanding of #491.
 2019-06-06 18:11:59 +02:00
Marco Castelluccio f5951ad63a Support retrieving some label files at runtime, and do it for the regressor labels 2019-06-05 00:37:26 +02:00
Marco Castelluccio 7790f5e3d5 Use raw CSV file, not GitHub's HTML page 2019-06-04 13:08:24 +02:00
Marco Castelluccio d57177f1e4 Fix destination path of the regressor.csv label file 2019-06-04 13:07:59 +02:00
Marco Castelluccio 44e26ff0e8 Add a training task for the Regressor model 2019-06-03 22:15:18 +02:00
Marco Castelluccio 2804436357 Download regressor labels from marco-c/mozilla-central-regressors repository in the train_regressor Docker image 2019-06-03 22:14:47 +02:00
Marco Castelluccio 72ddfea2e3 Add a Docker image for the task to train the Regressor model 2019-06-03 21:46:35 +02:00