Граф коммитов

1597 Коммитов

Автор SHA1 Сообщение Дата
Marco Castelluccio 9bd667b377 Move some code out of the test scheduling history retriever script and into the utils or test_scheduling modules 2019-11-19 00:32:21 +01:00
dependabot-preview[bot] 71354b90d8 Bump taskcluster from 22.1.1 to 23.0.0 (#1107)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 22.1.1 to 23.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v22.1.1...v23.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-18 20:08:48 +01:00
dependabot-preview[bot] 97b440c957 Bump apispec-webframeworks from 0.5.0 to 0.5.1 (#1106)
Bumps [apispec-webframeworks](https://github.com/marshmallow-code/apispec-webframeworks) from 0.5.0 to 0.5.1.
- [Release notes](https://github.com/marshmallow-code/apispec-webframeworks/releases)
- [Changelog](https://github.com/marshmallow-code/apispec-webframeworks/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec-webframeworks/compare/0.5.0...0.5.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-18 16:56:53 +01:00
Marco Castelluccio a973874d27 Version 0.0.151 2019-11-18 15:37:40 +01:00
Marco Castelluccio dddc0157f5 Write compressed tar files directly, instead of creating tarfiles first and then compressing them 2019-11-18 15:26:21 +01:00
Marco Castelluccio 50e86b38f0 Use LMDB as backend for shelve
LMDB is considerably faster than GDBM and NDBM.

Fixes #1035
2019-11-18 15:26:21 +01:00
Marco Castelluccio f4dce1fd50 Sync past test failures DB every 250 pushes, to avoid using too much memory 2019-11-18 15:26:21 +01:00
Marco Castelluccio ea4fb85e99 Don't generate data for all tasks for each push, but only the most interesting tasks
That is, tasks that actually run in the push itself, and tasks that could be
regressions from the push.
2019-11-18 15:26:21 +01:00
Marco Castelluccio 863f165659 Filter out meaningless tasks from the list of all tasks too 2019-11-18 15:26:21 +01:00
Marco Castelluccio b808f2ed1d Ignore empty extensions for detecting file types 2019-11-18 15:26:21 +01:00
Marco Castelluccio cfdd1f0ce2 For test scheduling purposes, skip pushes with more than 20 files modified for now 2019-11-18 15:26:21 +01:00
dependabot-preview[bot] 160276c2f8 Bump jsonschema from 3.1.1 to 3.2.0 (#1105)
Bumps [jsonschema](https://github.com/Julian/jsonschema) from 3.1.1 to 3.2.0.
- [Release notes](https://github.com/Julian/jsonschema/releases)
- [Changelog](https://github.com/Julian/jsonschema/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/Julian/jsonschema/compare/v3.1.1...v3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-18 14:39:32 +01:00
dependabot-preview[bot] d3356e1dd4 Bump tabulate from 0.8.5 to 0.8.6 (#1104)
Bumps [tabulate](https://github.com/astanin/python-tabulate) from 0.8.5 to 0.8.6.
- [Release notes](https://github.com/astanin/python-tabulate/releases)
- [Changelog](https://github.com/astanin/python-tabulate/blob/master/CHANGELOG)
- [Commits](https://github.com/astanin/python-tabulate/compare/v0.8.5...v0.8.6)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-18 11:04:41 +01:00
dependabot-preview[bot] 9d46245d29 Bump pytest from 5.2.3 to 5.2.4 (#1103)
Bumps [pytest](https://github.com/pytest-dev/pytest) from 5.2.3 to 5.2.4.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/5.2.3...5.2.4)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-16 10:50:43 +01:00
Marco Castelluccio a0d1bb347a Version 0.0.150 2019-11-15 01:19:05 +01:00
Marco Castelluccio 5af04525c3 Use all possible tasks when generating test scheduling data
Indeed, any task that didn't run on a given push and is not in the list
of possible or likely regressions, can be considered as a task that
wouldn't have failed on that push.
2019-11-15 00:19:02 +01:00
Marco Castelluccio 08dca299bc Bump version of the ADR cache DB and the test scheduling history DB
The changes from 13b5ff5adb
are modifying the data considerably.
2019-11-15 00:17:34 +01:00
Marco Castelluccio 0afc8eda03 Only consider tasks that run at least once in the last 28 pushes
Other tasks have likely been removed over time.
2019-11-14 23:05:20 +01:00
dependabot-preview[bot] dac47e89ae Bump pytest from 5.2.2 to 5.2.3 (#1102)
Bumps [pytest](https://github.com/pytest-dev/pytest) from 5.2.2 to 5.2.3.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/5.2.2...5.2.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-14 22:41:43 +01:00
Marco Castelluccio 3a8933fe26 Stop at 3 days ago when getting push data, as ActiveData sometimes lags behind 2019-11-14 21:55:40 +01:00
dependabot-preview[bot] 822c5e96ca Bump libmozdata from 0.1.61 to 0.1.62 (#1101)
Bumps [libmozdata](https://github.com/mozilla/libmozdata) from 0.1.61 to 0.1.62.
- [Release notes](https://github.com/mozilla/libmozdata/releases)
- [Commits](https://github.com/mozilla/libmozdata/compare/v0.1.61...v0.1.62)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-14 19:01:53 +01:00
Marco Castelluccio 88ea7c2594 Update taskcluster_yml_validator version in pre-commit configuration 2019-11-14 18:50:11 +01:00
Marco Castelluccio 2a18c2ebdc Be quiet when cloning/pulling from git repositories 2019-11-13 15:27:12 +01:00
Marco Castelluccio 110ba6278a Test scheduling data no longer contains a single rev, but a list of revs
Regression from dcbe49e967.
2019-11-13 10:30:18 +01:00
Marco Castelluccio 307fa11ecc Version 0.0.149 2019-11-13 00:46:40 +01:00
Marco Castelluccio 85e28ae198 Fill the 'done' file for the regressor finder script after the regressors for both tokenized and normal versions of the repos are found 2019-11-12 23:54:41 +01:00
Marco Castelluccio ab22e7148c Actually use the bug-fixing commits queue 2019-11-12 22:39:12 +01:00
Marco Castelluccio 858bd07bc6 Version 0.0.148 2019-11-12 20:15:43 +01:00
Marco Castelluccio f6f9358eba Use a larger worker type for the test scheduling history generator 2019-11-12 18:46:20 +01:00
Marco Castelluccio da317d0c0f Use new compute-small and compute-large worker types according to task needs 2019-11-12 18:24:45 +01:00
dependabot-preview[bot] 803a468bd7 Bump libmozdata from 0.1.60 to 0.1.61 (#1100)
Bumps [libmozdata](https://github.com/mozilla/libmozdata) from 0.1.60 to 0.1.61.
- [Release notes](https://github.com/mozilla/libmozdata/releases)
- [Commits](https://github.com/mozilla/libmozdata/commits/v0.1.61)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-12 18:23:48 +01:00
Marco Castelluccio 2f4d29fb08 Handle more corner cases in bug rollbacking 2019-11-12 16:29:04 +01:00
Marco Castelluccio 2bafc56308 Remove rollback workaround needed because of bug 1587982 2019-11-12 16:29:04 +01:00
dependabot-preview[bot] 9b37941e4d Bump orjson from 2.1.2 to 2.1.3 (#1099)
Bumps [orjson](https://github.com/ijl/orjson) from 2.1.2 to 2.1.3.
- [Release notes](https://github.com/ijl/orjson/releases)
- [Changelog](https://github.com/ijl/orjson/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ijl/orjson/compare/2.1.2...2.1.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-12 16:05:16 +01:00
Marco Castelluccio 0aa0aee005 Version 0.0.147 2019-11-12 10:58:54 +01:00
Marco Castelluccio da439431d6 Use utils.download_check_etag instead of urlretrieve in the check script
This way we can fallback to the old Taskcluster index in the check script as well.
2019-11-12 10:31:50 +01:00
Marco Castelluccio 2f347cb853 Use fallback URL to the old Taskcluster index when retrieving the version file too 2019-11-12 10:30:44 +01:00
Marco Castelluccio 12b71f9711 Version 0.0.146 2019-11-11 21:48:58 +01:00
Marco Castelluccio 38dbc22e4b Fix notify routes 2019-11-11 21:48:58 +01:00
dependabot-preview[bot] 249c02c096 Bump numpy from 1.17.3 to 1.17.4 (#1097)
Bumps [numpy](https://github.com/numpy/numpy) from 1.17.3 to 1.17.4.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/master/doc/HOWTO_RELEASE.rst.txt)
- [Commits](https://github.com/numpy/numpy/compare/v1.17.3...v1.17.4)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-11 10:37:49 +01:00
Marco Castelluccio 9c0499c824 Version 0.0.145 2019-11-10 20:28:42 +01:00
Marco Castelluccio 423e69aafa Add tests for utils.get_last_modified 2019-11-10 20:28:21 +01:00
Marco Castelluccio dc66faa4a0 Add Taskcluster index fallback URL in utils.get_last_modified too 2019-11-10 20:22:34 +01:00
Marco Castelluccio bcca240251 Remove unused pytest fixtures 2019-11-10 20:22:12 +01:00
Marco Castelluccio b5b53a29d5 Version 0.0.144 2019-11-10 20:05:11 +01:00
Marco Castelluccio d06f768c85 Bump Bugzilla DB version to refresh bugs
As there were recently some changes in DOM components
2019-11-10 20:02:38 +01:00
Marco Castelluccio dcbe49e967 Consider all commits in a given push when calculating past failure stats
Also store all revisions in the test scheduling data, so we can use them
in the test selection model too.

First part of #1017
2019-11-10 20:01:20 +01:00
Arjun Krishna f487893f7f Output prediction class name in bug_classifier script (#1094)
Fixes #1070
2019-11-10 18:17:39 +01:00
dependabot-preview[bot] b61e8aca7b Bump taskcluster from 22.1.0 to 22.1.1 (#1096)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 22.1.0 to 22.1.1.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v22.1.0...v22.1.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-10 18:13:35 +01:00
dependabot-preview[bot] 78f8c3e54c Bump scipy from 1.3.1 to 1.3.2 (#1095)
Bumps [scipy](https://github.com/scipy/scipy) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](https://github.com/scipy/scipy/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-10 18:12:58 +01:00