Граф коммитов

2756 Коммитов

Автор SHA1 Сообщение Дата
Marco Castelluccio b45b064cdf Try to get experiences directly instead of first checking if they exist 2020-05-15 17:52:35 +02:00
Marco Castelluccio aed5f38410 Use tuples when possible in the repository and test_scheduling modules 2020-05-15 17:52:35 +02:00
Marco Castelluccio 0deeb72a51 Try to get touched together stats for a couple of files directly instead of first checking if they exist 2020-05-15 17:52:35 +02:00
Marco Castelluccio ed9b2113f9 When selecting tests, skip non-test tasks directly instead of first needlessly generating data for them 2020-05-15 17:52:35 +02:00
Marco Castelluccio 69f9574e75 Increase HTTP service jobs timeout from 5 minutes to 7 minutes 2020-05-15 17:52:35 +02:00
dependabot-preview[bot] 78b3bd8a2f
Bump boto3 from 1.13.7 to 1.13.10 (#1571)
Bumps [boto3](https://github.com/boto/boto3) from 1.13.7 to 1.13.10.
- [Release notes](https://github.com/boto/boto3/releases)
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst)
- [Commits](https://github.com/boto/boto3/compare/1.13.7...1.13.10)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-15 17:51:23 +02:00
dependabot-preview[bot] 5239ec62ea
Bump python from 3.8.2-slim to 3.8.3-slim in /infra (#1574)
Bumps python from 3.8.2-slim to 3.8.3-slim.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-15 17:45:24 +02:00
dependabot-preview[bot] ec9e1d6a1c
Bump elasticsearch from 7.6.0 to 7.7.0 (#1573)
Bumps [elasticsearch](https://github.com/elastic/elasticsearch-py) from 7.6.0 to 7.7.0.
- [Release notes](https://github.com/elastic/elasticsearch-py/releases)
- [Changelog](https://github.com/elastic/elasticsearch-py/blob/master/Changelog.rst)
- [Commits](https://github.com/elastic/elasticsearch-py/compare/7.6.0...7.7.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-15 17:45:11 +02:00
dependabot-preview[bot] 6aeda70ab8
Bump taskcluster from 29.4.1 to 29.6.0 (#1572)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 29.4.1 to 29.6.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v29.4.1...v29.6.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-15 17:45:02 +02:00
dependabot-preview[bot] 4e090b12cc
Bump scikit-learn from 0.22.2 to 0.23.0 (#1570)
Bumps [scikit-learn](https://github.com/scikit-learn/scikit-learn) from 0.22.2 to 0.23.0.
- [Release notes](https://github.com/scikit-learn/scikit-learn/releases)
- [Commits](https://github.com/scikit-learn/scikit-learn/compare/0.22.2...0.23.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-15 17:44:50 +02:00
dependabot-preview[bot] 657408ee73
Bump rq from 1.3.0 to 1.4.0 (#1566)
Bumps [rq](https://github.com/nvie/rq) from 1.3.0 to 1.4.0.
- [Release notes](https://github.com/nvie/rq/releases)
- [Changelog](https://github.com/rq/rq/blob/master/CHANGES.md)
- [Commits](https://github.com/nvie/rq/compare/v1.3.0...v1.4.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-15 17:44:39 +02:00
dependabot-preview[bot] dc8138bea6
Bump joblib from 0.14.1 to 0.15.0 (#1569)
Bumps [joblib](https://github.com/joblib/joblib) from 0.14.1 to 0.15.0.
- [Release notes](https://github.com/joblib/joblib/releases)
- [Changelog](https://github.com/joblib/joblib/blob/master/CHANGES.rst)
- [Commits](https://github.com/joblib/joblib/compare/0.14.1...0.15.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-15 17:44:19 +02:00
dependabot-preview[bot] aa4e95e61c
Bump mozci from 1.4.7 to 1.4.8 (#1567)
Bumps [mozci]() from 1.4.7 to 1.4.8.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-15 17:44:08 +02:00
dependabot-preview[bot] cc7527babe
Bump adr from 0.18.5 to 0.18.7 (#1568)
Bumps [adr](https://github.com/mozilla/adr) from 0.18.5 to 0.18.7.
- [Release notes](https://github.com/mozilla/adr/releases)
- [Commits](https://github.com/mozilla/adr/compare/0.18.5...0.18.7)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-15 17:43:58 +02:00
Marco Castelluccio c8ad32b2d6 Version 0.0.293 2020-05-12 15:44:28 +02:00
Marco Castelluccio 036c796c40 Don't trigger test selection jobs for reviewbot pushes 2020-05-12 13:39:28 +02:00
Marco Castelluccio 3b791107ae Small refactoring to simplify the test scheduling history retriever code 2020-05-12 12:23:54 +02:00
Marco Castelluccio 0224f85452 Regenerate up to 1000 old push results at a time and re-enable regeneration of results with bad WPT groups 2020-05-12 12:21:02 +02:00
Marco Castelluccio 8124b34961 Detect the port on which the HTTP service is listening using the PORT environment variable
Fixes #1559
2020-05-12 12:17:03 +02:00
dependabot-preview[bot] 1857b6cb0b
Bump pre-commit from 2.3.0 to 2.4.0 (#1554)
Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 2.3.0 to 2.4.0.
- [Release notes](https://github.com/pre-commit/pre-commit/releases)
- [Changelog](https://github.com/pre-commit/pre-commit/blob/master/CHANGELOG.md)
- [Commits](https://github.com/pre-commit/pre-commit/compare/v2.3.0...v2.4.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-12 11:41:43 +02:00
dependabot-preview[bot] 830606b7ff
Bump marshmallow from 3.5.2 to 3.6.0 (#1553)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.5.2 to 3.6.0.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.5.2...3.6.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-12 11:40:08 +02:00
dependabot-preview[bot] dc0fbbd607
Bump boto3 from 1.13.4 to 1.13.7 (#1556)
Bumps [boto3](https://github.com/boto/boto3) from 1.13.4 to 1.13.7.
- [Release notes](https://github.com/boto/boto3/releases)
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst)
- [Commits](https://github.com/boto/boto3/compare/1.13.4...1.13.7)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-12 11:39:55 +02:00
dependabot-preview[bot] 5f1dcd832b
Bump tensorflow from 2.1.0 to 2.2.0 (#1555)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.1.0 to 2.2.0.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.1.0...v2.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-12 11:39:45 +02:00
dependabot-preview[bot] 4c827c8e4b
Bump taskcluster from 29.3.0 to 29.4.1 (#1557)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 29.3.0 to 29.4.1.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v29.3.0...v29.4.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-12 11:39:36 +02:00
dependabot-preview[bot] eff87b6f23
Bump pytest from 5.4.1 to 5.4.2 (#1558)
Bumps [pytest](https://github.com/pytest-dev/pytest) from 5.4.1 to 5.4.2.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/5.4.1...5.4.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-12 11:39:27 +02:00
Marco Castelluccio 36f3f120be Version 0.0.292 2020-05-12 02:14:23 +02:00
Marco Castelluccio a854572cbb Use a bigger instance for retrieving test scheduling history
Unfortunately there is a memory leak in mozci that makes us need more memory.
See https://github.com/mozilla/mozci.
2020-05-12 02:13:46 +02:00
Marco Castelluccio b91ed119ea Remove pushes from list when they are analyzed 2020-05-12 02:13:13 +02:00
Marco Castelluccio 7ddaf952a0 Version 0.0.291 2020-05-11 22:31:39 +02:00
Marco Castelluccio 2d5fe77cc0 Actually call retrieve_from_cache function...
Fixes a regression from 1ca475d46c
2020-05-11 22:31:10 +02:00
Marco Castelluccio a1ca487989 Version 0.0.290 2020-05-11 21:42:37 +02:00
Marco Castelluccio 1ca475d46c Ensure the thread pool doesn't generate too many results before they can be consumed 2020-05-11 21:42:25 +02:00
Marco Castelluccio e677e1c82b Revert "Add a ThreadPoolBoundedExecutor class which enforces a limit in the number of results of a ThreadPoolExecutor"
This reverts commit 6c2905af27.
2020-05-11 20:42:13 +02:00
Marco Castelluccio abcb747b9e Revert "Use a ThreadPoolBoundedExecutor for retrieving test scheduling history"
This reverts commit c0ef8b1a2b.
2020-05-11 20:39:03 +02:00
Marco Castelluccio e4dcce904e Version 0.0.289 2020-05-11 19:36:38 +02:00
Marco Castelluccio a07b31564d Temporarily disable regeneration of results with old format of WPT group 2020-05-11 19:25:03 +02:00
Marco Castelluccio 7de4d23261 Use tuples instead of lists when possible 2020-05-11 17:43:39 +02:00
Marco Castelluccio c0ef8b1a2b Use a ThreadPoolBoundedExecutor for retrieving test scheduling history
To avoid running out of memory.
2020-05-11 17:40:14 +02:00
Marco Castelluccio 6c2905af27 Add a ThreadPoolBoundedExecutor class which enforces a limit in the number of results of a ThreadPoolExecutor 2020-05-11 17:38:22 +02:00
Marco Castelluccio 988fe9e2bb Version 0.0.288 2020-05-11 12:40:35 +02:00
Marco Castelluccio 7a4ab086c7 Use a bigger instance for the test group scheduling history retrieval task 2020-05-11 12:02:53 +02:00
Marco Castelluccio 79d8ac42e2 Regenerate results which were generated when we were not cleaning up WPT groups 2020-05-11 11:53:41 +02:00
Marco Castelluccio 78e5b5a961 Actually retrieve pushes from cache in parallel.
By making the futures variable a tuple instead of an iterator
2020-05-10 19:56:36 +02:00
Marco Castelluccio 769e5fc3b7 Version 0.0.287 2020-05-10 15:47:03 +02:00
Marco Castelluccio d8a855e13d Bump version of the commits DB
Since we now consider Objective-C/C++ separately from C/C++.
2020-05-10 15:36:40 +02:00
Marco Castelluccio 1c7afcb6f3 Go back to using more threads for finding regressors 2020-05-10 15:34:26 +02:00
Marco Castelluccio 2e05ce60e3 Make sure the mercurial_to_git and git_to_mercurial iterators are fully consumed
Otherwise we'll leave git-cinnabar processes hanging, leaking a lot of memory.
This is why the regressor finder task has been running out of memory.
2020-05-10 15:33:22 +02:00
Marco Castelluccio 5915884484 Add type annotations to repository.transform 2020-05-10 13:35:21 +02:00
Marco Castelluccio 516c219776 Consider Objective-C/C++ files completely separately than C/C++ files 2020-05-10 13:30:38 +02:00
Marco Castelluccio e805d1265d Use a small instance type again for the test scheduling history retrieval task 2020-05-10 12:32:59 +02:00