Граф коммитов

240 Коммитов

Автор SHA1 Сообщение Дата
Marco Castelluccio 1d0d1216a3 Use larger instance for the commit retrieval task 2019-12-11 14:19:54 +01:00
Marco Castelluccio a9e7adcb7b Add a Taskcluster hook to generate the past bugs by function data
Second part of #1133
2019-12-11 11:20:48 +01:00
dependabot-preview[bot] f902405dde Bump taskcluster from 24.0.2 to 24.1.0 (#1165)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 24.0.2 to 24.1.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v24.0.2...v24.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-11 10:51:22 +01:00
dependabot-preview[bot] b92e3ec318 Bump taskcluster from 24.0.1 to 24.0.2 (#1164)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 24.0.1 to 24.0.2.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v24.0.1...v24.0.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-10 16:43:15 +01:00
Marco Castelluccio b7a17d323c
Collect information about functions while analyzing commits (#1161)
Pre-requisite for #1133 and part of #372
2019-12-10 13:22:55 +01:00
dependabot-preview[bot] 2f5a26ff0c Bump taskcluster from 24.0.0 to 24.0.1 (#1152)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 24.0.0 to 24.0.1.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v24.0.0...v24.0.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-05 00:17:51 +01:00
Marco Castelluccio a5c0bb1f43 Add a task to train the TestFailure model
First part of #1127
2019-12-03 23:09:11 +01:00
Marco Castelluccio b5e812d96b Use a bigger instance for the task to train the test selection model 2019-12-03 23:06:09 +01:00
dependabot-preview[bot] 4256040b11 Bump pyyaml from 5.1.2 to 5.2 (#1150)
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.1.2 to 5.2.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/5.2/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/compare/5.1.2...5.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-03 00:57:10 +01:00
dependabot-preview[bot] b9df64f6cc Bump taskcluster from 23.0.0 to 24.0.0 (#1149)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 23.0.0 to 24.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v23.0.0...v24.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-03 00:56:43 +01:00
Marco Castelluccio f1652c64c2 Add phabricator-diff-id to test-select hook 2019-11-26 11:57:23 +01:00
Marco Castelluccio a94c9a5425 Calculate the failure risk associated with a patch using the Backout model when selecting tests
This way users of the model can decide if they want to use it
gated on the risk or not.

Fixes #1118
2019-11-21 23:04:53 +01:00
Marco Castelluccio dbb49ea7d5 Add a route to the test select hook so listeners can know when the task ends 2019-11-20 18:46:18 +01:00
Marco Castelluccio 343d301188 Create a new hook to select tests to run for a given Phabricator revision 2019-11-19 15:43:06 +01:00
Marco Castelluccio db318babcd Support using other commit-based models in the commit_classifier scripts
And support models using test scheduling history data too.
2019-11-19 15:43:06 +01:00
dependabot-preview[bot] 71354b90d8 Bump taskcluster from 22.1.1 to 23.0.0 (#1107)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 22.1.1 to 23.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v22.1.1...v23.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-18 20:08:48 +01:00
Marco Castelluccio 50e86b38f0 Use LMDB as backend for shelve
LMDB is considerably faster than GDBM and NDBM.

Fixes #1035
2019-11-18 15:26:21 +01:00
Marco Castelluccio f6f9358eba Use a larger worker type for the test scheduling history generator 2019-11-12 18:46:20 +01:00
Marco Castelluccio da317d0c0f Use new compute-small and compute-large worker types according to task needs 2019-11-12 18:24:45 +01:00
Marco Castelluccio 38dbc22e4b Fix notify routes 2019-11-11 21:48:58 +01:00
dependabot-preview[bot] b61e8aca7b Bump taskcluster from 22.1.0 to 22.1.1 (#1096)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 22.1.0 to 22.1.1.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v22.1.0...v22.1.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-10 18:13:35 +01:00
dependabot-preview[bot] 7a2cb2f3ba Bump taskcluster from 22.0.0 to 22.1.0 (#1089)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 22.0.0 to 22.1.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v22.0.0...v22.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-09 01:04:08 +01:00
Brian Stack f54149cd90 Update .taskcluster.yml for community cluster (#1076) 2019-11-08 22:13:10 +01:00
Marco Castelluccio 145a69e295 Use db module to handle the ADR cache
Also switch from xz compression to zst
2019-11-07 14:29:25 +01:00
Marco Castelluccio 146b8dfbe5 Use versioned image for the integrationt test that runs as part of the data pipeline 2019-11-07 01:40:24 +01:00
Marco Castelluccio 015497076c No need to install dependencies in the integration test that runs as part of the data pipeline
As we are using the latest commit-retrieval image, which already
has all dependencies installed.
2019-11-07 01:39:56 +01:00
Marco Castelluccio a0c7731c19 Always use --disable-pip-version-check and --no-cache-dir pip options 2019-11-07 01:34:34 +01:00
Marco Castelluccio 8805e9aa9d Install python-pip for the integration test 2019-11-07 01:32:40 +01:00
dependabot-preview[bot] 0941d52cd2 Bump taskcluster from 21.3.0 to 22.0.0 (#1073)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 21.3.0 to 22.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v21.3.0...v22.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-05 00:54:20 +01:00
Marco Castelluccio 65bf1b4604 Only run integration test after data retrieval and training tasks are done 2019-11-02 17:49:36 +01:00
Marco Castelluccio 4b48bccab5 Make apt-get be quiet in the integration test 2019-11-02 17:08:18 +01:00
dependabot-preview[bot] f28f90a42d Bump taskcluster from 21.2.0 to 21.3.0 (#1066)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 21.2.0 to 21.3.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v21.2.0...v21.3.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-31 17:57:50 +01:00
Marco Castelluccio 9176d1084e Stop generating a shap force plot in the commit classifier task
As we are now building the plot ourselves in the risk analysis addon,
using the values in the JSON artifact of the commit classifier task.
2019-10-29 17:29:12 +01:00
dependabot-preview[bot] c16e771f3f Bump taskcluster from 21.0.0 to 21.2.0 (#1041)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 21.0.0 to 21.2.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v21.0.0...v21.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-25 09:53:58 +02:00
Boris Feld 807ecaca85 Misc fixes to enable integration tests at release time (#987)
Fixes #985 and fixes #329
2019-10-24 20:09:32 +02:00
Marco Castelluccio a8866bb562 GDBM doesn't add '.db' at the end of the path
I had tested locally with NDBM, which adds it
2019-10-23 12:01:46 +01:00
Marco Castelluccio 4a642f215f Add the past failures support DB to the artifacts list of the test scheduling history retrieval task 2019-10-22 17:46:15 +01:00
Marco Castelluccio f01badfb11 Add the version file of the test scheduling history DB to the artifacts list of the retrieval task 2019-10-22 17:46:15 +01:00
Marco Castelluccio 898d911013 Fix path in Taskcluster worker to the test scheduling history DB 2019-10-22 17:46:15 +01:00
Philemon Johnson 2047243f2e When using pip in .taskcluster.yml and in Docker files, add options --disable-pip-version-check, --no-cache-dir and --quiet (#1032) 2019-10-21 17:42:39 +01:00
Marco Castelluccio 0cfacecb57 Fix push_data.json.zst artifact path 2019-10-20 14:04:20 +01:00
Marco Castelluccio 940e97cdcf Be quiet when installing bugbug package in the test scheduling history push data retrieval task 2019-10-19 21:22:42 +01:00
Marco Castelluccio 86a6d0a6b9 Fix dependency name
Regressed by dc3c3b83da
2019-10-18 14:20:57 +01:00
Marco Castelluccio 5713425500 Use relman-svc compute for the ADR task
Since the tasks were split with dc3c3b83da,
the ADR task is not bounded by performance yet.
2019-10-18 13:38:13 +01:00
Marco Castelluccio dc3c3b83da Split test scheduling history retriever task into two 2019-10-18 13:33:53 +01:00
dependabot-preview[bot] 13973a6cc0 Bump taskcluster from 20.0.0 to 21.0.0 (#1026)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 20.0.0 to 21.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v20.0.0...v21.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-18 11:55:23 +02:00
dependabot-preview[bot] 90c676a4ce Bump taskcluster from 19.0.0 to 20.0.0 (#1020)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 19.0.0 to 20.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v19.0.0...v20.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-16 14:47:04 +02:00
Marco Castelluccio 3d36786b58 Install libffi-dev, required for cffi 2019-10-15 14:20:09 +02:00
Marco Castelluccio 7f8e08c20d Add a task to train the test selection model 2019-10-12 17:31:28 +01:00
Marco Castelluccio 2cfd8fc01a Try using relman-svc-compute for the test scheduling history retrieval task 2019-10-10 18:52:08 +01:00