Marco Castelluccio
0bda641d9b
Version 0.0.209
2020-02-19 13:31:15 +01:00
Marco Castelluccio
e302e5b2e9
Fix task ID typos
...
Regression from 7c81a5ece9
2020-02-19 13:20:26 +01:00
Marco Castelluccio
ba6c358ba7
Support generating a test scheduling history DB for group granularity instead of just label granularity
...
And introduce a new task that generates a group-level test scheduling history DB.
Part of #1125
2020-02-19 13:15:08 +01:00
Marco Castelluccio
7c81a5ece9
Split regressor finder task in four separate tasks
...
A task to find commits to ignore, a task to classify commits between
bug-fixing vs not-bug-fixing, a task to find regressors using the
normal repo, and a task to find regressors using the tokenized
repo.
This way we can also find regressors for the two kinds of repos
in parallel.
Fixes #1273
Make the past bugs by function task depend on the task to classify
commits between bug-fixing and not-bug-fixing.
Fixes #1274
2020-02-19 12:25:18 +01:00
Marco Castelluccio
a882457427
Version 0.0.208
2020-02-18 14:04:16 +01:00
Marco Castelluccio
b83eb8048a
Skip some modifications that are certainly not useful for regressor finding (and slow down blaming)
2020-02-18 13:19:05 +01:00
Marco Castelluccio
b3e59739bf
Upload bug-introducing DB every 250 iterations rather than every 500
2020-02-18 13:19:05 +01:00
Marco Castelluccio
8aa9b85d68
Log exceptions happening while finding regressors as soon as detected
2020-02-18 13:19:05 +01:00
Marco Castelluccio
6b0d778e58
Log the number of workers used to find regressors
2020-02-18 13:19:05 +01:00
dependabot-preview[bot]
b47920a3af
Bump imbalanced-learn from 0.6.1 to 0.6.2 ( #1285 )
...
Bumps [imbalanced-learn](https://github.com/scikit-learn-contrib/imbalanced-learn ) from 0.6.1 to 0.6.2.
- [Release notes](https://github.com/scikit-learn-contrib/imbalanced-learn/releases )
- [Commits](https://github.com/scikit-learn-contrib/imbalanced-learn/compare/0.6.1...0.6.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 11:11:23 +01:00
dependabot-preview[bot]
c78833b084
Bump taskcluster from 24.3.1 to 25.2.0 ( #1284 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 24.3.1 to 25.2.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v24.3.1...v25.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 10:49:37 +01:00
dependabot-preview[bot]
a04ea3a4ec
Bump orjson from 2.2.2 to 2.4.0 ( #1287 )
...
Bumps [orjson](https://github.com/ijl/orjson ) from 2.2.2 to 2.4.0.
- [Release notes](https://github.com/ijl/orjson/releases )
- [Changelog](https://github.com/ijl/orjson/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ijl/orjson/compare/2.2.2...2.4.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 10:49:28 +01:00
dependabot-preview[bot]
f8e7966b91
Bump apispec[yaml] from 3.2.0 to 3.3.0 ( #1286 )
...
Bumps [apispec[yaml]](https://github.com/marshmallow-code/apispec ) from 3.2.0 to 3.3.0.
- [Release notes](https://github.com/marshmallow-code/apispec/releases )
- [Changelog](https://github.com/marshmallow-code/apispec/blob/dev/CHANGELOG.rst )
- [Commits](https://github.com/marshmallow-code/apispec/compare/3.2.0...3.3.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 10:49:18 +01:00
dependabot-preview[bot]
13b0abc827
Bump boto3 from 1.11.15 to 1.12.1 ( #1288 )
...
Bumps [boto3](https://github.com/boto/boto3 ) from 1.11.15 to 1.12.1.
- [Release notes](https://github.com/boto/boto3/releases )
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst )
- [Commits](https://github.com/boto/boto3/compare/1.11.15...1.12.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 10:49:09 +01:00
Marco Castelluccio
e4320c4cd0
Use a smaller worker type when possible
2020-02-17 14:07:08 +01:00
Marco Castelluccio
d31e48e6b8
Version 0.0.207
2020-02-17 12:14:50 +01:00
Marco Castelluccio
8afd7f44a6
Update to latest ci-recipes
2020-02-17 12:14:32 +01:00
Marco Castelluccio
6114a57bbe
Upload bug-introducing DB every 500 iterations rather than every 1000
2020-02-17 10:58:01 +01:00
Marco Castelluccio
e923d60265
Version 0.0.206
2020-02-16 02:51:05 +01:00
Marco Castelluccio
049c3d2c5c
Update ADR cache URL to point to S3 instead of Taskcluster artifact
2020-02-16 02:50:51 +01:00
Marco Castelluccio
7e0bf44c4a
Add required s3 scopes to the task scheduling history retriever task
2020-02-16 02:50:24 +01:00
Marco Castelluccio
4f5fcacf0a
Version 0.0.205
2020-02-15 20:17:39 +01:00
Marco Castelluccio
611bbadc44
Remove useless support_files argument usage
2020-02-15 20:17:20 +01:00
Marco Castelluccio
49e57e66a3
Upload ADR cache periodically while the task runs
...
This way we don't lose the work done so far if the (very long running) task fails
for unknown reasons.
2020-02-15 20:16:26 +01:00
Marco Castelluccio
77fa140e60
Update to latest ci-recipes
2020-02-14 19:21:38 +01:00
Marco Castelluccio
322913ffb0
Version 0.0.204
2020-02-14 00:06:12 +01:00
Marco Castelluccio
d9160d2fb8
Make pydriller initialize repository when initializing the threads
...
Since pydriller is changing a git configuration, it is acquiring a file lock.
So, we need to initialize the git repositories for the different threads
right away and behind a lock.
2020-02-14 00:01:13 +01:00
Marco Castelluccio
d891d901dd
Increase max runtime and deadline for test scheduling tasks
2020-02-13 20:11:36 +01:00
Marco Castelluccio
805717be0c
Version 0.0.203
2020-02-13 18:43:41 +01:00
Marco Castelluccio
c7a9185874
Update commit date in fixtures for the BackoutModel tests
2020-02-13 18:39:27 +01:00
Marco Castelluccio
5be6d82a0b
Update to latest ci-recipes (using 'fixed by commit' data)
2020-02-13 17:59:03 +01:00
Marco Castelluccio
9f5d7bb2f7
Instead on relying on the pushdate, re-analyze a few recent commits for finding commits to ignore
2020-02-13 17:09:43 +01:00
Marco Castelluccio
5d4346911f
Remove artifacts from the regressor finder task, as they are not used anymore
...
The artifacts are now uploaded to S3
2020-02-13 13:23:34 +01:00
Marco Castelluccio
b3da6498e9
Update URL of the regressor-related DBs
2020-02-13 13:23:01 +01:00
Marco Castelluccio
1d5cd27b88
Remove artifacts from microannotate generator tasks, as they are not used anymore
2020-02-13 13:22:25 +01:00
Marco Castelluccio
b71799deac
Go back to checking the version in the microannotate generator script, now that we can run tasks for longer and we upload intermediate results to S3
2020-02-13 13:21:41 +01:00
Marco Castelluccio
e38fc1e1e9
Update URL of the microannotate DB
2020-02-13 13:20:53 +01:00
Marco Castelluccio
9915ec4574
Cancel all pending futures to find regressors when one fails
2020-02-13 13:19:15 +01:00
Marco Castelluccio
b00d9d1577
Use ThreadPoolExecutorResult to make sure we fail if cloning fails
2020-02-13 13:18:24 +01:00
Marco Castelluccio
a9ab2acf70
Add some logging when cloning and updating git repositories
2020-02-12 21:58:19 +01:00
Marco Castelluccio
eb5ecef7d3
Version 0.0.202
2020-02-12 14:47:25 +01:00
Marco Castelluccio
61e813da28
Upload path directly, without prepending 'data/'
2020-02-12 14:46:30 +01:00
Marco Castelluccio
b676d87430
Version 0.0.201
2020-02-12 13:44:39 +01:00
Marco Castelluccio
52a5a7335c
Make microanntate generator task upload the DB version to S3
...
This way, even if the task times out, we don't lose the work done so far.
N.B.: We'll need to also update the DB URLs, when the bugbug S3 bucket is made public.
2020-02-12 13:43:54 +01:00
Marco Castelluccio
caa10dc2e8
Upload regressor finder results to S3 periodically while the task is running
...
This way, even if the task times out, we don't lose the work done so far.
N.B.: We'll need to also update the DB URLs, when the bugbug S3 bucket is made public.
2020-02-12 13:42:21 +01:00
Marco Castelluccio
c989dfd7d4
Add a function in the db module to upload a DB, and all its linked files, to S3
2020-02-12 11:54:52 +01:00
Marco Castelluccio
b577510ed2
Add a utility method to upload to S3
...
Using Taskcluster's awsS3Credentials API.
2020-02-12 11:47:06 +01:00
Marco Castelluccio
e838553c15
Add missing function calls
...
Regression from 7a1d2457ef
2020-02-12 10:04:54 +01:00
Marco Castelluccio
9aeae39772
Version 0.0.200
2020-02-12 01:19:46 +01:00
Marco Castelluccio
f2b9ebb304
Make deadlines 5 days again, as the Taskcluster change has been reverted
...
See https://bugzilla.mozilla.org/show_bug.cgi?id=1604175
2020-02-12 01:19:25 +01:00