Граф коммитов

2005 Коммитов

Автор SHA1 Сообщение Дата
Marco Castelluccio 0bda641d9b Version 0.0.209 2020-02-19 13:31:15 +01:00
Marco Castelluccio e302e5b2e9 Fix task ID typos
Regression from 7c81a5ece9
2020-02-19 13:20:26 +01:00
Marco Castelluccio ba6c358ba7 Support generating a test scheduling history DB for group granularity instead of just label granularity
And introduce a new task that generates a group-level test scheduling history DB.

Part of #1125
2020-02-19 13:15:08 +01:00
Marco Castelluccio 7c81a5ece9 Split regressor finder task in four separate tasks
A task to find commits to ignore, a task to classify commits between
bug-fixing vs not-bug-fixing, a task to find regressors using the
normal repo, and a task to find regressors using the tokenized
repo.

This way we can also find regressors for the two kinds of repos
in parallel.

Fixes #1273

Make the past bugs by function task depend on the task to classify
commits between bug-fixing and not-bug-fixing.

Fixes #1274
2020-02-19 12:25:18 +01:00
Marco Castelluccio a882457427 Version 0.0.208 2020-02-18 14:04:16 +01:00
Marco Castelluccio b83eb8048a Skip some modifications that are certainly not useful for regressor finding (and slow down blaming) 2020-02-18 13:19:05 +01:00
Marco Castelluccio b3e59739bf Upload bug-introducing DB every 250 iterations rather than every 500 2020-02-18 13:19:05 +01:00
Marco Castelluccio 8aa9b85d68 Log exceptions happening while finding regressors as soon as detected 2020-02-18 13:19:05 +01:00
Marco Castelluccio 6b0d778e58 Log the number of workers used to find regressors 2020-02-18 13:19:05 +01:00
dependabot-preview[bot] b47920a3af
Bump imbalanced-learn from 0.6.1 to 0.6.2 (#1285)
Bumps [imbalanced-learn](https://github.com/scikit-learn-contrib/imbalanced-learn) from 0.6.1 to 0.6.2.
- [Release notes](https://github.com/scikit-learn-contrib/imbalanced-learn/releases)
- [Commits](https://github.com/scikit-learn-contrib/imbalanced-learn/compare/0.6.1...0.6.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 11:11:23 +01:00
dependabot-preview[bot] c78833b084
Bump taskcluster from 24.3.1 to 25.2.0 (#1284)
Bumps [taskcluster](https://github.com/taskcluster/taskcluster) from 24.3.1 to 25.2.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases)
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md)
- [Commits](https://github.com/taskcluster/taskcluster/compare/v24.3.1...v25.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 10:49:37 +01:00
dependabot-preview[bot] a04ea3a4ec
Bump orjson from 2.2.2 to 2.4.0 (#1287)
Bumps [orjson](https://github.com/ijl/orjson) from 2.2.2 to 2.4.0.
- [Release notes](https://github.com/ijl/orjson/releases)
- [Changelog](https://github.com/ijl/orjson/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ijl/orjson/compare/2.2.2...2.4.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 10:49:28 +01:00
dependabot-preview[bot] f8e7966b91
Bump apispec[yaml] from 3.2.0 to 3.3.0 (#1286)
Bumps [apispec[yaml]](https://github.com/marshmallow-code/apispec) from 3.2.0 to 3.3.0.
- [Release notes](https://github.com/marshmallow-code/apispec/releases)
- [Changelog](https://github.com/marshmallow-code/apispec/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec/compare/3.2.0...3.3.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 10:49:18 +01:00
dependabot-preview[bot] 13b0abc827
Bump boto3 from 1.11.15 to 1.12.1 (#1288)
Bumps [boto3](https://github.com/boto/boto3) from 1.11.15 to 1.12.1.
- [Release notes](https://github.com/boto/boto3/releases)
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst)
- [Commits](https://github.com/boto/boto3/compare/1.11.15...1.12.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 10:49:09 +01:00
Marco Castelluccio e4320c4cd0 Use a smaller worker type when possible 2020-02-17 14:07:08 +01:00
Marco Castelluccio d31e48e6b8 Version 0.0.207 2020-02-17 12:14:50 +01:00
Marco Castelluccio 8afd7f44a6 Update to latest ci-recipes 2020-02-17 12:14:32 +01:00
Marco Castelluccio 6114a57bbe Upload bug-introducing DB every 500 iterations rather than every 1000 2020-02-17 10:58:01 +01:00
Marco Castelluccio e923d60265 Version 0.0.206 2020-02-16 02:51:05 +01:00
Marco Castelluccio 049c3d2c5c Update ADR cache URL to point to S3 instead of Taskcluster artifact 2020-02-16 02:50:51 +01:00
Marco Castelluccio 7e0bf44c4a Add required s3 scopes to the task scheduling history retriever task 2020-02-16 02:50:24 +01:00
Marco Castelluccio 4f5fcacf0a Version 0.0.205 2020-02-15 20:17:39 +01:00
Marco Castelluccio 611bbadc44 Remove useless support_files argument usage 2020-02-15 20:17:20 +01:00
Marco Castelluccio 49e57e66a3 Upload ADR cache periodically while the task runs
This way we don't lose the work done so far if the (very long running) task fails
for unknown reasons.
2020-02-15 20:16:26 +01:00
Marco Castelluccio 77fa140e60 Update to latest ci-recipes 2020-02-14 19:21:38 +01:00
Marco Castelluccio 322913ffb0 Version 0.0.204 2020-02-14 00:06:12 +01:00
Marco Castelluccio d9160d2fb8 Make pydriller initialize repository when initializing the threads
Since pydriller is changing a git configuration, it is acquiring a file lock.
So, we need to initialize the git repositories for the different threads
right away and behind a lock.
2020-02-14 00:01:13 +01:00
Marco Castelluccio d891d901dd Increase max runtime and deadline for test scheduling tasks 2020-02-13 20:11:36 +01:00
Marco Castelluccio 805717be0c Version 0.0.203 2020-02-13 18:43:41 +01:00
Marco Castelluccio c7a9185874 Update commit date in fixtures for the BackoutModel tests 2020-02-13 18:39:27 +01:00
Marco Castelluccio 5be6d82a0b Update to latest ci-recipes (using 'fixed by commit' data) 2020-02-13 17:59:03 +01:00
Marco Castelluccio 9f5d7bb2f7 Instead on relying on the pushdate, re-analyze a few recent commits for finding commits to ignore 2020-02-13 17:09:43 +01:00
Marco Castelluccio 5d4346911f Remove artifacts from the regressor finder task, as they are not used anymore
The artifacts are now uploaded to S3
2020-02-13 13:23:34 +01:00
Marco Castelluccio b3da6498e9 Update URL of the regressor-related DBs 2020-02-13 13:23:01 +01:00
Marco Castelluccio 1d5cd27b88 Remove artifacts from microannotate generator tasks, as they are not used anymore 2020-02-13 13:22:25 +01:00
Marco Castelluccio b71799deac Go back to checking the version in the microannotate generator script, now that we can run tasks for longer and we upload intermediate results to S3 2020-02-13 13:21:41 +01:00
Marco Castelluccio e38fc1e1e9 Update URL of the microannotate DB 2020-02-13 13:20:53 +01:00
Marco Castelluccio 9915ec4574 Cancel all pending futures to find regressors when one fails 2020-02-13 13:19:15 +01:00
Marco Castelluccio b00d9d1577 Use ThreadPoolExecutorResult to make sure we fail if cloning fails 2020-02-13 13:18:24 +01:00
Marco Castelluccio a9ab2acf70 Add some logging when cloning and updating git repositories 2020-02-12 21:58:19 +01:00
Marco Castelluccio eb5ecef7d3 Version 0.0.202 2020-02-12 14:47:25 +01:00
Marco Castelluccio 61e813da28 Upload path directly, without prepending 'data/' 2020-02-12 14:46:30 +01:00
Marco Castelluccio b676d87430 Version 0.0.201 2020-02-12 13:44:39 +01:00
Marco Castelluccio 52a5a7335c Make microanntate generator task upload the DB version to S3
This way, even if the task times out, we don't lose the work done so far.
N.B.: We'll need to also update the DB URLs, when the bugbug S3 bucket is made public.
2020-02-12 13:43:54 +01:00
Marco Castelluccio caa10dc2e8 Upload regressor finder results to S3 periodically while the task is running
This way, even if the task times out, we don't lose the work done so far.
N.B.: We'll need to also update the DB URLs, when the bugbug S3 bucket is made public.
2020-02-12 13:42:21 +01:00
Marco Castelluccio c989dfd7d4 Add a function in the db module to upload a DB, and all its linked files, to S3 2020-02-12 11:54:52 +01:00
Marco Castelluccio b577510ed2 Add a utility method to upload to S3
Using Taskcluster's awsS3Credentials API.
2020-02-12 11:47:06 +01:00
Marco Castelluccio e838553c15 Add missing function calls
Regression from 7a1d2457ef
2020-02-12 10:04:54 +01:00
Marco Castelluccio 9aeae39772 Version 0.0.200 2020-02-12 01:19:46 +01:00
Marco Castelluccio f2b9ebb304 Make deadlines 5 days again, as the Taskcluster change has been reverted
See https://bugzilla.mozilla.org/show_bug.cgi?id=1604175
2020-02-12 01:19:25 +01:00