Граф коммитов

2661 Коммитов

Автор SHA1 Сообщение Дата
dependabot-preview[bot] 9a62543cf5
Bump orjson from 3.0.0 to 3.0.1 (#1590)
Bumps [orjson](https://github.com/ijl/orjson) from 3.0.0 to 3.0.1.
- [Release notes](https://github.com/ijl/orjson/releases)
- [Changelog](https://github.com/ijl/orjson/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ijl/orjson/compare/3.0.0...3.0.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-22 22:27:05 +02:00
Marco Castelluccio 87d92287db Try again when we fail to load the target-tasks.json artifact from the latest decision task 2020-05-22 02:18:32 +02:00
Marco Castelluccio 8ade50c112 Evaluate enforcing a minimum number of selected tasks 2020-05-20 19:06:10 +02:00
Marco Castelluccio 92e3dcea9f Version 0.0.302 2020-05-20 13:26:28 +02:00
Marco Castelluccio bddef5209a Gather two months of config/group data 2020-05-20 13:14:01 +02:00
Marco Castelluccio ba14c7b159 Use a tuple to hold pushes 2020-05-20 13:12:52 +02:00
Marco Castelluccio 218c9e886d Restore "Retrieve pushes just once and then analyze them at various granularity levels"
This reverts commit f4e52d8ad9.
2020-05-20 13:12:52 +02:00
Ayush Shridhar 8b6e7d266f
End to end duplicate model script (#1509) 2020-05-20 13:04:49 +02:00
Marco Castelluccio 49c7ee369f Version 0.0.301 2020-05-19 20:25:13 +02:00
Marco Castelluccio f4857ca0f5 Check bad old WPT results only for 'group' granularity 2020-05-19 20:02:06 +02:00
Marco Castelluccio 1b8c80287f Release futures once we have used them 2020-05-19 19:52:07 +02:00
Marco Castelluccio 5866f4e2d3 Terminate all cache gathering threads when there is an exception
Avoid a deadlock.
2020-05-19 19:51:10 +02:00
Marco Castelluccio 3489db53ef Version 0.0.300 2020-05-19 17:04:50 +02:00
Marco Castelluccio 57dd5cf8ac Generate config/group data first 2020-05-19 16:47:16 +02:00
Marco Castelluccio 1ea449b882 Evaluate testselect reductions using a failing together probability DB generated only on training pushes
Otherwise, we'd leak training information into the test set.
2020-05-19 16:46:23 +02:00
Marco Castelluccio 6a9eb5c0a1 Move some functions from the test scheduling history retriever script to the test_scheduling module
This makes it easier to use them as part of the evaluation of the testselect models.
The goal is to avoid leaking any information from the test set (when we do the reduction, we can't
use the data about 'future' failures).
2020-05-19 16:46:23 +02:00
dependabot-preview[bot] a5d0f8b656
Bump boto3 from 1.13.11 to 1.13.12 (#1586)
Bumps [boto3](https://github.com/boto/boto3) from 1.13.11 to 1.13.12.
- [Release notes](https://github.com/boto/boto3/releases)
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst)
- [Commits](https://github.com/boto/boto3/compare/1.13.11...1.13.12)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-19 11:51:20 +02:00
Marco Castelluccio a5a7038631 Add type annotations to the function to generate the test scheduling history DB 2020-05-19 01:12:24 +02:00
Marco Castelluccio 454ce3166e Add type annotations to the function to generate failing together probabilities 2020-05-19 01:10:44 +02:00
Marco Castelluccio fbe493aa9b Make the function to generate failing together probabilities a method of the Retriever class
Instead of defining it inside the function to generate the test scheduling history DB.
2020-05-19 01:08:01 +02:00
Marco Castelluccio ac04176954 Version 0.0.299 2020-05-19 00:40:27 +02:00
Marco Castelluccio 8666dc24ae Revert "Temporarily disable config/group push data generation"
This reverts commit c14f2d0a06.
2020-05-19 00:04:34 +02:00
Marco Castelluccio ca9e471009 Add a new feature specifying the suite the manifest belongs to
It could be useful to improve results, considering that some suites have different characteristics.
See #1584
2020-05-18 17:50:42 +02:00
Martin Monperrus 35d741b01a
doc: Document the regressor model (#1582) 2020-05-18 14:58:11 +02:00
Marco Castelluccio 2ae01d0173 Version 0.0.298 2020-05-18 14:03:19 +02:00
Marco Castelluccio d374c02ee4 Use a bigger instance for the test label scheduling history generator 2020-05-18 14:03:01 +02:00
Marco Castelluccio 07259a884e Version 0.0.297 2020-05-18 10:10:52 +02:00
Marco Castelluccio c14f2d0a06 Temporarily disable config/group push data generation
We need quick results for the next run.
2020-05-18 10:10:52 +02:00
Marco Castelluccio f4e52d8ad9 Revert "Retrieve pushes just once and then analyze them at various granularity levels"
This reverts commit 55e6efd9dd.

Uses too much memory.
2020-05-18 10:08:49 +02:00
Marco Castelluccio 8790c5e6a6 Revert "Try using a smaller instance type for the test scheduling history retriever task"
This reverts commit 6c6546bd9d.

It didn't work.
2020-05-18 10:02:32 +02:00
Marco Castelluccio 7c611e2745 Version 0.0.296 2020-05-17 14:42:48 +02:00
Marco Castelluccio 25a032cb5d Start collecting only 1 month of data for the config/group granularity
Collecting more would take a very long time, and I want to see some initial results.
2020-05-17 14:42:48 +02:00
dependabot-preview[bot] a0f2e608bb
Bump adr from 0.18.7 to 0.18.8 (#1580)
Bumps [adr](https://github.com/mozilla/adr) from 0.18.7 to 0.18.8.
- [Release notes](https://github.com/mozilla/adr/releases)
- [Commits](https://github.com/mozilla/adr/compare/0.18.7...0.18.8)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-17 14:37:22 +02:00
dependabot-preview[bot] fd95be6041
Bump rq from 1.4.0 to 1.4.1 (#1577)
Bumps [rq](https://github.com/nvie/rq) from 1.4.0 to 1.4.1.
- [Release notes](https://github.com/nvie/rq/releases)
- [Changelog](https://github.com/rq/rq/blob/master/CHANGES.md)
- [Commits](https://github.com/nvie/rq/compare/v1.4.0...v1.4.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-17 14:35:56 +02:00
dependabot-preview[bot] e843375099
Bump joblib from 0.15.0 to 0.15.1 (#1581)
Bumps [joblib](https://github.com/joblib/joblib) from 0.15.0 to 0.15.1.
- [Release notes](https://github.com/joblib/joblib/releases)
- [Changelog](https://github.com/joblib/joblib/blob/master/CHANGES.rst)
- [Commits](https://github.com/joblib/joblib/compare/0.15.0...0.15.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-17 14:35:48 +02:00
dependabot-preview[bot] f1304f1b19
Bump boto3 from 1.13.10 to 1.13.11 (#1578)
Bumps [boto3](https://github.com/boto/boto3) from 1.13.10 to 1.13.11.
- [Release notes](https://github.com/boto/boto3/releases)
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst)
- [Commits](https://github.com/boto/boto3/compare/1.13.10...1.13.11)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-17 14:35:37 +02:00
Marco Castelluccio 8cf119bb78 Stop caching the fact that we failed to analyze a push
It's too painful when we release a version where we fail to analyze
many pushes because of some bug in adr or mozci or because AD is down.
2020-05-17 12:32:03 +02:00
Marco Castelluccio 2f580bd958 Clarify libgit2 is not always required 2020-05-17 12:25:48 +02:00
Rex Orioko e5193fd09a
Update Python images used in CI from 3.7 to 3.8 (#1576)
Fixes #1023
2020-05-17 12:16:07 +02:00
Marco Castelluccio 209a637562 Version 0.0.295 2020-05-16 14:06:00 +02:00
Marco Castelluccio 5bf736d9a0 Always regenerate test scheduling history from scratch
Since we sometimes re-retrieve data about pushes in the middle, we need
to regenerate the whole DB.
2020-05-16 14:05:47 +02:00
Marco Castelluccio 60d31442ef Consider latest 28 pushes to make sure we hit the backstop 2020-05-16 14:05:47 +02:00
Marco Castelluccio e59f80a928 Stop training some models that we are not using in production yet 2020-05-16 14:05:47 +02:00
Marco Castelluccio 6c6546bd9d Try using a smaller instance type for the test scheduling history retriever task
There were a few memory leaks fixed in the latest version of mozci.
2020-05-16 14:05:47 +02:00
Marco Castelluccio 55e6efd9dd Retrieve pushes just once and then analyze them at various granularity levels
So we don't have to recalculate what we have memoized.
2020-05-16 14:05:47 +02:00
Marco Castelluccio 8d55a4b397 Generate test scheduling history data at the config/group level too 2020-05-16 14:05:47 +02:00
Marco Castelluccio ed064be15b version 0.0.294 2020-05-15 18:27:31 +02:00
Marco Castelluccio 656d87f537 Skip tasks not starting with 'test-', not the opposite
Fixes a regression from ed9b2113f9
2020-05-15 18:10:58 +02:00
Marco Castelluccio d45488b087 Handle manifests that import other manifests
Fixes #1563
2020-05-15 17:52:41 +02:00
Marco Castelluccio e8e630eeca Don't collect distances in a list and then return the min, just store the min 2020-05-15 17:52:35 +02:00