dependabot-preview[bot]
9a62543cf5
Bump orjson from 3.0.0 to 3.0.1 ( #1590 )
...
Bumps [orjson](https://github.com/ijl/orjson ) from 3.0.0 to 3.0.1.
- [Release notes](https://github.com/ijl/orjson/releases )
- [Changelog](https://github.com/ijl/orjson/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ijl/orjson/compare/3.0.0...3.0.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-22 22:27:05 +02:00
Marco Castelluccio
87d92287db
Try again when we fail to load the target-tasks.json artifact from the latest decision task
2020-05-22 02:18:32 +02:00
Marco Castelluccio
8ade50c112
Evaluate enforcing a minimum number of selected tasks
2020-05-20 19:06:10 +02:00
Marco Castelluccio
92e3dcea9f
Version 0.0.302
2020-05-20 13:26:28 +02:00
Marco Castelluccio
bddef5209a
Gather two months of config/group data
2020-05-20 13:14:01 +02:00
Marco Castelluccio
ba14c7b159
Use a tuple to hold pushes
2020-05-20 13:12:52 +02:00
Marco Castelluccio
218c9e886d
Restore "Retrieve pushes just once and then analyze them at various granularity levels"
...
This reverts commit f4e52d8ad9
.
2020-05-20 13:12:52 +02:00
Ayush Shridhar
8b6e7d266f
End to end duplicate model script ( #1509 )
2020-05-20 13:04:49 +02:00
Marco Castelluccio
49c7ee369f
Version 0.0.301
2020-05-19 20:25:13 +02:00
Marco Castelluccio
f4857ca0f5
Check bad old WPT results only for 'group' granularity
2020-05-19 20:02:06 +02:00
Marco Castelluccio
1b8c80287f
Release futures once we have used them
2020-05-19 19:52:07 +02:00
Marco Castelluccio
5866f4e2d3
Terminate all cache gathering threads when there is an exception
...
Avoid a deadlock.
2020-05-19 19:51:10 +02:00
Marco Castelluccio
3489db53ef
Version 0.0.300
2020-05-19 17:04:50 +02:00
Marco Castelluccio
57dd5cf8ac
Generate config/group data first
2020-05-19 16:47:16 +02:00
Marco Castelluccio
1ea449b882
Evaluate testselect reductions using a failing together probability DB generated only on training pushes
...
Otherwise, we'd leak training information into the test set.
2020-05-19 16:46:23 +02:00
Marco Castelluccio
6a9eb5c0a1
Move some functions from the test scheduling history retriever script to the test_scheduling module
...
This makes it easier to use them as part of the evaluation of the testselect models.
The goal is to avoid leaking any information from the test set (when we do the reduction, we can't
use the data about 'future' failures).
2020-05-19 16:46:23 +02:00
dependabot-preview[bot]
a5d0f8b656
Bump boto3 from 1.13.11 to 1.13.12 ( #1586 )
...
Bumps [boto3](https://github.com/boto/boto3 ) from 1.13.11 to 1.13.12.
- [Release notes](https://github.com/boto/boto3/releases )
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst )
- [Commits](https://github.com/boto/boto3/compare/1.13.11...1.13.12 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-19 11:51:20 +02:00
Marco Castelluccio
a5a7038631
Add type annotations to the function to generate the test scheduling history DB
2020-05-19 01:12:24 +02:00
Marco Castelluccio
454ce3166e
Add type annotations to the function to generate failing together probabilities
2020-05-19 01:10:44 +02:00
Marco Castelluccio
fbe493aa9b
Make the function to generate failing together probabilities a method of the Retriever class
...
Instead of defining it inside the function to generate the test scheduling history DB.
2020-05-19 01:08:01 +02:00
Marco Castelluccio
ac04176954
Version 0.0.299
2020-05-19 00:40:27 +02:00
Marco Castelluccio
8666dc24ae
Revert "Temporarily disable config/group push data generation"
...
This reverts commit c14f2d0a06
.
2020-05-19 00:04:34 +02:00
Marco Castelluccio
ca9e471009
Add a new feature specifying the suite the manifest belongs to
...
It could be useful to improve results, considering that some suites have different characteristics.
See #1584
2020-05-18 17:50:42 +02:00
Martin Monperrus
35d741b01a
doc: Document the regressor model ( #1582 )
2020-05-18 14:58:11 +02:00
Marco Castelluccio
2ae01d0173
Version 0.0.298
2020-05-18 14:03:19 +02:00
Marco Castelluccio
d374c02ee4
Use a bigger instance for the test label scheduling history generator
2020-05-18 14:03:01 +02:00
Marco Castelluccio
07259a884e
Version 0.0.297
2020-05-18 10:10:52 +02:00
Marco Castelluccio
c14f2d0a06
Temporarily disable config/group push data generation
...
We need quick results for the next run.
2020-05-18 10:10:52 +02:00
Marco Castelluccio
f4e52d8ad9
Revert "Retrieve pushes just once and then analyze them at various granularity levels"
...
This reverts commit 55e6efd9dd
.
Uses too much memory.
2020-05-18 10:08:49 +02:00
Marco Castelluccio
8790c5e6a6
Revert "Try using a smaller instance type for the test scheduling history retriever task"
...
This reverts commit 6c6546bd9d
.
It didn't work.
2020-05-18 10:02:32 +02:00
Marco Castelluccio
7c611e2745
Version 0.0.296
2020-05-17 14:42:48 +02:00
Marco Castelluccio
25a032cb5d
Start collecting only 1 month of data for the config/group granularity
...
Collecting more would take a very long time, and I want to see some initial results.
2020-05-17 14:42:48 +02:00
dependabot-preview[bot]
a0f2e608bb
Bump adr from 0.18.7 to 0.18.8 ( #1580 )
...
Bumps [adr](https://github.com/mozilla/adr ) from 0.18.7 to 0.18.8.
- [Release notes](https://github.com/mozilla/adr/releases )
- [Commits](https://github.com/mozilla/adr/compare/0.18.7...0.18.8 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-17 14:37:22 +02:00
dependabot-preview[bot]
fd95be6041
Bump rq from 1.4.0 to 1.4.1 ( #1577 )
...
Bumps [rq](https://github.com/nvie/rq ) from 1.4.0 to 1.4.1.
- [Release notes](https://github.com/nvie/rq/releases )
- [Changelog](https://github.com/rq/rq/blob/master/CHANGES.md )
- [Commits](https://github.com/nvie/rq/compare/v1.4.0...v1.4.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-17 14:35:56 +02:00
dependabot-preview[bot]
e843375099
Bump joblib from 0.15.0 to 0.15.1 ( #1581 )
...
Bumps [joblib](https://github.com/joblib/joblib ) from 0.15.0 to 0.15.1.
- [Release notes](https://github.com/joblib/joblib/releases )
- [Changelog](https://github.com/joblib/joblib/blob/master/CHANGES.rst )
- [Commits](https://github.com/joblib/joblib/compare/0.15.0...0.15.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-17 14:35:48 +02:00
dependabot-preview[bot]
f1304f1b19
Bump boto3 from 1.13.10 to 1.13.11 ( #1578 )
...
Bumps [boto3](https://github.com/boto/boto3 ) from 1.13.10 to 1.13.11.
- [Release notes](https://github.com/boto/boto3/releases )
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst )
- [Commits](https://github.com/boto/boto3/compare/1.13.10...1.13.11 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-17 14:35:37 +02:00
Marco Castelluccio
8cf119bb78
Stop caching the fact that we failed to analyze a push
...
It's too painful when we release a version where we fail to analyze
many pushes because of some bug in adr or mozci or because AD is down.
2020-05-17 12:32:03 +02:00
Marco Castelluccio
2f580bd958
Clarify libgit2 is not always required
2020-05-17 12:25:48 +02:00
Rex Orioko
e5193fd09a
Update Python images used in CI from 3.7 to 3.8 ( #1576 )
...
Fixes #1023
2020-05-17 12:16:07 +02:00
Marco Castelluccio
209a637562
Version 0.0.295
2020-05-16 14:06:00 +02:00
Marco Castelluccio
5bf736d9a0
Always regenerate test scheduling history from scratch
...
Since we sometimes re-retrieve data about pushes in the middle, we need
to regenerate the whole DB.
2020-05-16 14:05:47 +02:00
Marco Castelluccio
60d31442ef
Consider latest 28 pushes to make sure we hit the backstop
2020-05-16 14:05:47 +02:00
Marco Castelluccio
e59f80a928
Stop training some models that we are not using in production yet
2020-05-16 14:05:47 +02:00
Marco Castelluccio
6c6546bd9d
Try using a smaller instance type for the test scheduling history retriever task
...
There were a few memory leaks fixed in the latest version of mozci.
2020-05-16 14:05:47 +02:00
Marco Castelluccio
55e6efd9dd
Retrieve pushes just once and then analyze them at various granularity levels
...
So we don't have to recalculate what we have memoized.
2020-05-16 14:05:47 +02:00
Marco Castelluccio
8d55a4b397
Generate test scheduling history data at the config/group level too
2020-05-16 14:05:47 +02:00
Marco Castelluccio
ed064be15b
version 0.0.294
2020-05-15 18:27:31 +02:00
Marco Castelluccio
656d87f537
Skip tasks not starting with 'test-', not the opposite
...
Fixes a regression from ed9b2113f9
2020-05-15 18:10:58 +02:00
Marco Castelluccio
d45488b087
Handle manifests that import other manifests
...
Fixes #1563
2020-05-15 17:52:41 +02:00
Marco Castelluccio
e8e630eeca
Don't collect distances in a list and then return the min, just store the min
2020-05-15 17:52:35 +02:00