Граф коммитов

2801 Коммитов

Автор SHA1 Сообщение Дата
dependabot-preview[bot] c2cb83c147
Bump boto3 from 1.14.2 to 1.14.5 (#1647)
Bumps [boto3](https://github.com/boto/boto3) from 1.14.2 to 1.14.5.
- [Release notes](https://github.com/boto/boto3/releases)
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst)
- [Commits](https://github.com/boto/boto3/compare/1.14.2...1.14.5)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-17 23:40:31 +02:00
Marco Castelluccio 6e7df81e5e Version 0.0.315 2020-06-17 19:10:16 +02:00
Marco Castelluccio 87bdaf7c47 Test fewer combinations of minimum, cap, reduction levels during the evaluation of the TestSelect model 2020-06-17 18:20:15 +02:00
Marco Castelluccio 993db7dc96 Version 0.0.314 2020-06-17 11:24:26 +02:00
Marco Castelluccio 4241ed3979 Don't fail abruptly if we fail to solve the selection optimization problem in time 2020-06-17 11:17:42 +02:00
Marco Castelluccio 7e448e3349 Version 0.0.313 2020-06-17 01:52:27 +02:00
Marco Castelluccio b44fe70686 Avoid concurrent writes to the equivalence sets file during the evaluation of the TestSelect model 2020-06-17 01:49:45 +02:00
Marco Castelluccio d6b5f86182 Version 0.0.312 2020-06-16 15:59:19 +02:00
Marco Castelluccio b7549acbc3 Update expectations in tests for the generate_data function from the test_scheduling module
Fixes a regression from 064ef2df37
2020-06-16 15:32:46 +02:00
Marco Castelluccio a07272d5c0 'touched_together_directories' must be a number, not a tuple
Typo...

Fixes a regression from 064ef2df37
2020-06-16 15:31:41 +02:00
Marco Castelluccio cf89c02aec Update tests for test_scheduling.generate_data
Also add type annotations in the test_scheduling tests.

Fixes a regression from 064ef2df37
2020-06-16 14:32:45 +02:00
Marco Castelluccio 1ab4a0a19d Change types of the 'tasks' argument of the 'reduce' method and the 'groups' argument of the select_configs method
They can't just be Iterable as we need to iterate over them multiple times.
2020-06-16 14:18:46 +02:00
Marco Castelluccio 064ef2df37 Don't try to generate touched together data at the label granularity 2020-06-16 13:40:44 +02:00
Marco Castelluccio e1dd913fd0 Version 0.0.311 2020-06-15 23:38:12 +02:00
Marco Castelluccio 27aa35bd48 Revert "Perform test selection during the TestSelect model evaluation in parallel with multiple processes"
This reverts commit 34de11cb67.

We can't run the evaluation right after training otherwise, because
of https://github.com/dmlc/xgboost/issues/4246.
Performing test selection in parallel doesn't buy us that much anyway
as XGBoost already works in parallel (only the generation of the
elements to pass to XGBoost would be parallel).
2020-06-15 23:22:27 +02:00
Marco Castelluccio fa113905eb Ensure we close the previous mock DBs before creating new ones 2020-06-15 20:31:31 +02:00
Marco Castelluccio ef409d7a17 Don't fail when loading failing together DBs for different granularities in the same run
Fixes a regression from 42665a75e8
2020-06-15 19:02:37 +02:00
Marco Castelluccio 13d85a97ed Generate a mock touched together DB file for HTTP service tests 2020-06-15 19:00:31 +02:00
Marco Castelluccio 972b64b9bb Use autouse pytest feature instead of defining usefixtures in pytest.ini file 2020-06-15 18:59:53 +02:00
Marco Castelluccio 60f790b48b Generate equivalence sets for configs across groups only once 2020-06-15 17:16:10 +02:00
Marco Castelluccio ee0fefd0a9 Hardcode reductions in the for loop 2020-06-15 16:56:26 +02:00
Marco Castelluccio ac8bb7b0d8 Perform reduction and config selection during the TestSelect model evaluation in parallel with multiple processes 2020-06-15 16:54:02 +02:00
Marco Castelluccio 34de11cb67 Perform test selection during the TestSelect model evaluation in parallel with multiple processes 2020-06-15 16:02:45 +02:00
Marco Castelluccio 0bfa7dbdb2 Apply minimum after reduction 2020-06-15 15:44:23 +02:00
Marco Castelluccio d9d2b89f77 Add type annotations to LMDBDict 2020-06-15 15:44:23 +02:00
Marco Castelluccio 01f245b841 Allow opening touched together DB in read-only mode 2020-06-15 15:44:23 +02:00
Marco Castelluccio 88fdafe613 Generate a commit map containing only the commits that we are interested in 2020-06-15 15:44:23 +02:00
Marco Castelluccio 627192f35f Remove elements from the commit map instead of just reading them
As each push contains a different set of commits, after we have used a given
commit from the commit map, we'll never use it again.
2020-06-15 15:44:23 +02:00
Marco Castelluccio ad848e99f4 Release pushes list during evaluation
We no longer use it since this point, and it uses quite a bit of memory
2020-06-15 15:44:23 +02:00
Marco Castelluccio 42665a75e8 Allow opening failing together probabilities DB in read-only mode 2020-06-15 15:44:23 +02:00
Marco Castelluccio d1fa725009 Allow opening past failures DB in read-only mode 2020-06-15 15:44:23 +02:00
dependabot-preview[bot] d7c4f808bb
Bump pytest-cov from 2.9.0 to 2.10.0 (#1646)
Bumps [pytest-cov](https://github.com/pytest-dev/pytest-cov) from 2.9.0 to 2.10.0.
- [Release notes](https://github.com/pytest-dev/pytest-cov/releases)
- [Changelog](https://github.com/pytest-dev/pytest-cov/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest-cov/compare/v2.9.0...v2.10.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-15 11:33:11 +02:00
dependabot-preview[bot] e570cb3371
Bump responses from 0.10.14 to 0.10.15 (#1645)
Bumps [responses](https://github.com/getsentry/responses) from 0.10.14 to 0.10.15.
- [Release notes](https://github.com/getsentry/responses/releases)
- [Changelog](https://github.com/getsentry/responses/blob/master/CHANGES)
- [Commits](https://github.com/getsentry/responses/compare/0.10.14...0.10.15)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-15 11:33:03 +02:00
dependabot-preview[bot] afca24a7a6
Bump boto3 from 1.14.1 to 1.14.2 (#1644)
Bumps [boto3](https://github.com/boto/boto3) from 1.14.1 to 1.14.2.
- [Release notes](https://github.com/boto/boto3/releases)
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst)
- [Commits](https://github.com/boto/boto3/compare/1.14.1...1.14.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-15 11:32:54 +02:00
dependabot-preview[bot] 21d5a3c7a6
Bump zstandard from 0.13.0 to 0.14.0 (#1643)
Bumps [zstandard](https://github.com/indygreg/python-zstandard) from 0.13.0 to 0.14.0.
- [Release notes](https://github.com/indygreg/python-zstandard/releases)
- [Changelog](https://github.com/indygreg/python-zstandard/blob/main/NEWS.rst)
- [Commits](https://github.com/indygreg/python-zstandard/compare/0.13.0...0.14.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-15 11:32:45 +02:00
Arun Kumar 1799f7f2c3
Make spawn_pipeline not depend on the order of tasks in the yaml file (#1631)
Fixes #1282
2020-06-12 11:01:41 +02:00
Marco Castelluccio e03e674e42 Download failing together config/group DB from the right task 2020-06-12 02:57:19 +02:00
Marco Castelluccio 2d9f33778a Upload the version of the test config/group scheduling history DB (even though we don't generate it)
It is required so that we can download its support files.
2020-06-12 02:56:24 +02:00
Marco Castelluccio fd808f575e Version 0.0.310 2020-06-11 23:50:25 +02:00
Marco Castelluccio d61aa52e3f Download failing together config/group DB when booting the HTTP service 2020-06-11 23:50:14 +02:00
Marco Castelluccio 712b3dfcdd Bump MOZCI_VERSION to 4
Since mozci 1.6.0 introduces some important changes to regression detection.
2020-06-11 23:46:57 +02:00
dependabot-preview[bot] a826ed1901
Bump boto3 from 1.13.25 to 1.14.1 (#1638)
Bumps [boto3](https://github.com/boto/boto3) from 1.13.25 to 1.14.1.
- [Release notes](https://github.com/boto/boto3/releases)
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst)
- [Commits](https://github.com/boto/boto3/compare/1.13.25...1.14.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-11 23:44:44 +02:00
dependabot-preview[bot] f95f412208
Bump mozci from 1.5.1 to 1.6.0 (#1639)
Bumps [mozci]() from 1.5.1 to 1.6.0.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-11 23:43:41 +02:00
dependabot-preview[bot] 9eab2ecf1c
Bump hypothesis from 5.16.0 to 5.16.1 (#1637)
Bumps [hypothesis](https://github.com/HypothesisWorks/hypothesis) from 5.16.0 to 5.16.1.
- [Release notes](https://github.com/HypothesisWorks/hypothesis/releases)
- [Commits](https://github.com/HypothesisWorks/hypothesis/compare/hypothesis-python-5.16.0...hypothesis-python-5.16.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-11 23:43:28 +02:00
dependabot-preview[bot] 5598a90815
Bump imbalanced-learn from 0.6.2 to 0.7.0 (#1636)
Bumps [imbalanced-learn](https://github.com/scikit-learn-contrib/imbalanced-learn) from 0.6.2 to 0.7.0.
- [Release notes](https://github.com/scikit-learn-contrib/imbalanced-learn/releases)
- [Commits](https://github.com/scikit-learn-contrib/imbalanced-learn/compare/0.6.2...0.7.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-11 23:42:55 +02:00
dependabot-preview[bot] 86f53357ab
Bump adr from 0.18.9 to 0.18.10 (#1635)
Bumps [adr](https://github.com/mozilla/adr) from 0.18.9 to 0.18.10.
- [Release notes](https://github.com/mozilla/adr/releases)
- [Commits](https://github.com/mozilla/adr/compare/0.18.9...0.18.10)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-11 23:42:46 +02:00
dependabot-preview[bot] 960b28a554
Bump taskcluster from 30.1.0 to 30.1.1 (#1634)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 30.1.0 to 30.1.1.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v30.1.0...v30.1.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-11 23:42:36 +02:00
dependabot-preview[bot] c320878307
Bump pre-commit from 2.5.0 to 2.5.1 (#1633)
Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/pre-commit/pre-commit/releases)
- [Changelog](https://github.com/pre-commit/pre-commit/blob/master/CHANGELOG.md)
- [Commits](https://github.com/pre-commit/pre-commit/compare/v2.5.0...v2.5.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-11 23:42:26 +02:00
Marco Castelluccio 9dc06e928c Make the number of pushes to regenerate configurable with an environment variable 2020-06-11 22:58:14 +02:00
Marco Castelluccio 5f4fe8c164 Use a larger instance for the test config_group scheduling history push data retrieval task 2020-06-11 15:23:36 +02:00