64aea2e7e5
Use a number of threads exactly equal to the number of CPUs available in the system
2020-05-08 15:20:49 +02:00
0a976d8d6a
Ignore some rollbacking errors
2020-05-08 13:56:10 +02:00
53b180142a
Add a pre-commit hook to check all VCS links are permalinks
2020-05-08 13:25:21 +02:00
1691cb8f63
Version 0.0.283
2020-05-07 23:36:39 +02:00
1edc21f8b7
Temporarily force regeneration of the latest 1000 pushes
2020-05-07 23:36:21 +02:00
09174d8a78
Revert "Temporarily force regeneration of the latest 1000 pushes"
...
This reverts commit 69343fc6b6
2020-05-07 16:14:40 +02:00
166c77e6d6
Version 0.0.282
2020-05-07 16:14:04 +02:00
69343fc6b6
Temporarily force regeneration of the latest 1000 pushes
2020-05-07 16:13:44 +02:00
5743d5ab6c
Revert "Use a bigger instance for gathering test scheduling history for the time being"
...
This reverts commit 58ec9010e4418b20339d
2020-05-07 16:13:44 +02:00
31c84b66a4
Bump mozci from 1.4.6 to 1.4.7 ( #1551 )
...
Bumps [mozci]() from 1.4.6 to 1.4.7.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-07 15:45:40 +02:00
c8e3b316ad
Bump boto3 from 1.13.3 to 1.13.4 ( #1550 )
...
Bumps [boto3](https://github.com/boto/boto3 ) from 1.13.3 to 1.13.4.
- [Release notes](https://github.com/boto/boto3/releases )
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst )
- [Commits](https://github.com/boto/boto3/compare/1.13.3...1.13.4 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-07 15:45:30 +02:00
413966ff71
Version 0.0.281
2020-05-07 02:37:26 +02:00
ff6374df21
Use cd instead of pushd/popd
2020-05-07 02:24:52 +02:00
e14bceff30
Use a specific version of git-cinnabar
...
So the build is reproducible, and so when we want to update git-cinnabar the image
will be rebuilt.
2020-05-07 01:20:26 +02:00
58ec9010e4
Use a bigger instance for gathering test scheduling history for the time being
2020-05-06 18:43:25 +02:00
e4ef1176ca
Bump boto3 from 1.13.2 to 1.13.3 ( #1546 )
...
Bumps [boto3](https://github.com/boto/boto3 ) from 1.13.2 to 1.13.3.
- [Release notes](https://github.com/boto/boto3/releases )
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst )
- [Commits](https://github.com/boto/boto3/compare/1.13.2...1.13.3 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-06 16:50:04 +02:00
b817ab372a
Bump mozci from 1.4.5 to 1.4.6 ( #1547 )
...
Bumps [mozci]() from 1.4.5 to 1.4.6.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-06 16:49:55 +02:00
9ec84f2649
Add a helper function to download a similarity model ( #1524 )
2020-05-06 15:03:21 +02:00
5e6e5c9367
Version 0.0.280
2020-05-06 13:16:50 +02:00
130d096232
Bump version of the bug-introducing commits DB
2020-05-06 13:16:31 +02:00
7a05f05acf
For finding regressors from bug-fixing commits, skip modifications that didn't change source files
2020-05-06 13:15:43 +02:00
8347cd4405
Make push_data_label and push_data_group normal DBs instead of a JSON containing a very large list
...
This should reduce memory usage while generating push data results, as we don't have to hold
all of them in memory and then dump a large JSON result.
Reading the resulting file should also be faster.
2020-05-06 12:49:11 +02:00
5773baba14
Don't regenerate pushlog DB after cloning a repository
...
Only regenerate it when the repository already exists (the regeneration was introduced
by 2d249793e2Fixes #1544
2020-05-05 18:06:41 +02:00
c1e4d9a5e1
Don't clean the repo after cloning
...
Fixes #1543
2020-05-05 17:11:55 +02:00
cd92e910eb
Don't update repository after cloning it
...
Fixes #1542
2020-05-05 16:46:46 +02:00
7cb75434b8
Bump numpy from 1.18.3 to 1.18.4 ( #1534 )
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.18.3 to 1.18.4.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/master/doc/HOWTO_RELEASE.rst.txt )
- [Commits](https://github.com/numpy/numpy/compare/v1.18.3...v1.18.4 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Marco Castelluccio <mcastelluccio@mozilla.com>
2020-05-05 13:07:19 +02:00
a3576ede4f
Bump tenacity from 6.1.0 to 6.2.0 ( #1538 )
...
Bumps [tenacity](https://github.com/jd/tenacity ) from 6.1.0 to 6.2.0.
- [Release notes](https://github.com/jd/tenacity/releases )
- [Commits](https://github.com/jd/tenacity/compare/6.1.0...6.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-05 13:07:04 +02:00
dec9668f0e
Bump marshmallow from 3.5.1 to 3.5.2 ( #1537 )
...
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow ) from 3.5.1 to 3.5.2.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases )
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst )
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.5.1...3.5.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-05 12:35:25 +02:00
0dfe755681
Bump boto3 from 1.12.49 to 1.13.2 ( #1535 )
...
Bumps [boto3](https://github.com/boto/boto3 ) from 1.12.49 to 1.13.2.
- [Release notes](https://github.com/boto/boto3/releases )
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst )
- [Commits](https://github.com/boto/boto3/compare/1.12.49...1.13.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-05 12:35:17 +02:00
2299a2666d
Bump orjson from 2.6.6 to 3.0.0 ( #1539 )
...
Bumps [orjson](https://github.com/ijl/orjson ) from 2.6.6 to 3.0.0.
- [Release notes](https://github.com/ijl/orjson/releases )
- [Changelog](https://github.com/ijl/orjson/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ijl/orjson/compare/2.6.6...3.0.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-05 12:35:04 +02:00
7c00a8daa5
Bump taskcluster from 29.2.0 to 29.3.0 ( #1540 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 29.2.0 to 29.3.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v29.2.0...v29.3.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-05 12:34:55 +02:00
21a4eb5b28
Bump tqdm from 4.45.0 to 4.46.0 ( #1533 )
...
Bumps [tqdm](https://github.com/tqdm/tqdm ) from 4.45.0 to 4.46.0.
- [Release notes](https://github.com/tqdm/tqdm/releases )
- [Commits](https://github.com/tqdm/tqdm/compare/v4.45.0...v4.46.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-05 12:34:39 +02:00
629dcc9534
Bump gensim from 3.8.2 to 3.8.3 ( #1541 )
...
Bumps [gensim](https://github.com/RaRe-Technologies/gensim ) from 3.8.2 to 3.8.3.
- [Release notes](https://github.com/RaRe-Technologies/gensim/releases )
- [Changelog](https://github.com/RaRe-Technologies/gensim/blob/3.8.3/CHANGELOG.md )
- [Commits](https://github.com/RaRe-Technologies/gensim/compare/3.8.2...3.8.3 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-05 12:34:30 +02:00
1a169d6cd1
Version 0.0.279
2020-05-04 20:55:28 +02:00
60471f8daf
Return a list of tasks known by the test selection model ( #1531 )
...
The list of known tasks is generated during the HTTP service's boot.
This way, since the HTTP service is restarted ~daily, we will schedule newly added
tasks for all pushes in approximately a whole day since their introduction (useful
to gather enough data about them for the next training run, and to help sheriffs
identify if they are intermittently failing).
Fixes #1528
2020-05-04 16:34:47 +02:00
083381ac02
Add missing repository directory argument to vcs_map.mercurial_to_git call
2020-05-04 14:56:08 +02:00
b83f1fbcbc
Version 0.0.278
2020-05-03 17:31:18 +02:00
6af14220c8
Avoid adding backed-out commits twice in the list of commits to ignore for finding regressors
2020-05-03 17:28:55 +02:00
3784a0980b
Bump version of the DB of commits to ignore for finding regressors
2020-05-03 17:28:55 +02:00
46626f5099
Don't add commit hashes which don't correspond to any commit in the repository to the list of commits to ignore for finding regressors
2020-05-03 17:28:51 +02:00
88e53a4346
Version 0.0.277
2020-05-03 16:23:33 +02:00
c733433b98
Increase confidence thresholds for the reduced tasks results
...
The last few changes to the model made the higher confidence thresholds
catch enough regressions by scheduling fewer tasks.
2020-05-03 15:55:20 +02:00
9e7b8489f5
Use better prioritization of tasks in the reduction step
...
Fixes #1529
2020-05-03 15:14:28 +02:00
4c417e0aae
For the label-level model, train without pushes with an abnormal number of failures
...
Fixes #1527
2020-05-03 15:13:55 +02:00
725530169d
Don't use some features which are not helping the model
2020-05-03 15:13:55 +02:00
99be36aa3d
Stop evaluating the model with 0.7 and 0.8 reduction levels too
...
Fixes #1525
2020-05-03 15:13:55 +02:00
4608f3c31b
Evaluate the model with 0.85, 0.9, 0.95 confidence thresholds too
...
Part of #1525
2020-05-03 15:13:55 +02:00
e8e760d892
Stop evaluating the model with a 0.3 confidence threshold too
...
Part of #1525
2020-05-03 15:13:55 +02:00
41162a9b96
Stop evaluating the model with a 200 cap too
...
Part of #1525
2020-05-03 15:13:55 +02:00
8f677de8fd
Bump the version of the test scheduling history DBs, since we have regenerated a few results with a newer version of mozci
2020-05-03 15:13:55 +02:00
Marco Castelluccio
dependabot-preview[bot]
Ayush Shridhar