94151c2613
Add a test for calculate_experiences with save=False
2020-03-04 14:27:59 +01:00
bbaa59a935
Preload models after cloning mozilla-central to avoid running out of memory
2020-03-04 12:09:24 +01:00
2482bcfc9e
Update to taskboot 0.2.2
2020-03-04 11:54:12 +01:00
befdbd730a
Use a bigger worker type for the HTTP service deployment task as it sometimes runs out of memory
2020-03-04 11:54:12 +01:00
3ae35962b0
[http_service] Add some extra tests for the '/<model>/predict' endpoints ( #1364 )
...
Fixes #1361
2020-03-04 01:16:56 +01:00
19871cb0e0
Version 0.0.223
2020-03-03 20:20:26 +01:00
0667a6cc35
Return 404 when a model which doesn't exist is requested ( #1359 )
...
Fixes #1265
2020-03-03 20:19:52 +01:00
bb9c2fbf71
Implement the outline of a push scheduler service ( #1319 )
...
Fixes #1300
2020-03-03 20:17:58 +01:00
4fb3b4c51f
Fix dict access error and add a test with a request without an API key ( #1360 )
...
Fixes #1357
Fixes #1343
2020-03-03 18:33:27 +01:00
d6c88e1315
Set LMDB meminit option to false as we don't need memory to be zero-initialized
2020-03-03 17:22:40 +01:00
1fb819b131
Bump xgboost from 0.90 to 1.0.1 ( #1307 )
...
Bumps [xgboost](https://github.com/dmlc/xgboost ) from 0.90 to 1.0.1.
- [Release notes](https://github.com/dmlc/xgboost/releases )
- [Changelog](https://github.com/dmlc/xgboost/blob/master/NEWS.md )
- [Commits](https://github.com/dmlc/xgboost/compare/v0.90...v1.0.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 11:38:26 +01:00
c572593cd1
Increase version of the test group scheduling DB
...
Required as we increased the number of months considered for the history
2020-03-03 11:19:31 +01:00
0d4322d089
Add a few more bugs to the mock DB for tests
...
Otherwise the XGBoost upgrade to 1.0.1 won't work because shap
would fail because of too few bins.
2020-03-03 11:19:31 +01:00
cf01098da4
Bump pydriller from 1.11.1 to 1.12 ( #1349 )
...
Bumps [pydriller](https://github.com/ishepard/pydriller ) from 1.11.1 to 1.12.
- [Release notes](https://github.com/ishepard/pydriller/releases )
- [Commits](https://github.com/ishepard/pydriller/compare/1.11.1...1.12 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:38:20 +01:00
9f7eaa0d6d
Bump python from 3.8.1-slim to 3.8.2-slim in /infra ( #1355 )
...
Bumps python from 3.8.1-slim to 3.8.2-slim.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:38:11 +01:00
cc1a09a6e4
Bump boto3 from 1.12.8 to 1.12.12 ( #1350 )
...
Bumps [boto3](https://github.com/boto/boto3 ) from 1.12.8 to 1.12.12.
- [Release notes](https://github.com/boto/boto3/releases )
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst )
- [Commits](https://github.com/boto/boto3/compare/1.12.8...1.12.12 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:38:00 +01:00
db9ce0b455
Bump responses from 0.10.11 to 0.10.12 ( #1351 )
...
Bumps [responses](https://github.com/getsentry/responses ) from 0.10.11 to 0.10.12.
- [Release notes](https://github.com/getsentry/responses/releases )
- [Changelog](https://github.com/getsentry/responses/blob/master/CHANGES )
- [Commits](https://github.com/getsentry/responses/compare/0.10.11...0.10.12 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:37:51 +01:00
d4f4858d4a
Bump mozci from 1.2.6 to 1.2.7 ( #1352 )
...
Bumps [mozci]() from 1.2.6 to 1.2.7.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:37:40 +01:00
03e709cffd
Bump flask-apispec from 0.8.5 to 0.8.6 ( #1354 )
...
Bumps [flask-apispec](https://github.com/jmcarp/flask-apispec ) from 0.8.5 to 0.8.6.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases )
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst )
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.5...0.8.6 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:37:30 +01:00
25fae88eec
Bump shap[plots] from 0.34.0 to 0.35.0 ( #1353 )
...
Bumps [shap[plots]](https://github.com/slundberg/shap ) from 0.34.0 to 0.35.0.
- [Release notes](https://github.com/slundberg/shap/releases )
- [Commits](https://github.com/slundberg/shap/compare/0.34.0...0.35.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:37:11 +01:00
ac0a409086
Bump scikit-learn from 0.22.1 to 0.22.2 ( #1348 )
...
Bumps [scikit-learn](https://github.com/scikit-learn/scikit-learn ) from 0.22.1 to 0.22.2.
- [Release notes](https://github.com/scikit-learn/scikit-learn/releases )
- [Commits](https://github.com/scikit-learn/scikit-learn/compare/0.22.1...0.22.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:37:00 +01:00
e2a54a04ab
Don't schedule new jobs when they are already 'queued' ( #1347 )
...
Fixes #1340
2020-03-02 21:31:32 +01:00
c920f09297
Setup mercurial configuration system-wide ( #1346 )
...
Fixes #1341
2020-03-02 14:23:54 +01:00
b72e96b269
Allow overriding the version of bugbug used while building the HTTP service worker image ( #1345 )
...
* Prioritize the TAG environment variable over the bugbug package version
* Allow overriding the version of bugbug used while building the HTTP service worker image
2020-03-02 11:26:41 +01:00
22b27b97b0
Remove model_dir parameter from load_model as it's not used anymore
2020-03-01 21:33:54 +01:00
3eee2f8c7a
Use utils.download_model for downloading models in the HTTP service instead of reimplementing it
...
Fixes #1242
2020-03-01 21:33:18 +01:00
289fc0a755
Install http_service with pip quietly and without caching in the integration test script
2020-03-01 21:07:01 +01:00
4d6ca3f323
Preload test selection models in the HTTP service workers
2020-03-01 20:13:59 +01:00
a4bf12e333
The HTTP service deployment task no longer needs to depend on the task to generate test scheduling history
...
See also #1330
2020-03-01 20:13:17 +01:00
a286a0df8e
Download test selection models in the HTTP service
...
Making sure the HTTP service is built after the test selection models are trained.
Fixes #1330
2020-03-01 20:12:05 +01:00
ececf8a58a
Cache models in the HTTP service workers only if they are used more than once in two hours
...
Part of #1342
2020-03-01 16:18:51 +01:00
4695acfad9
Only preload models which we know are used very often
...
Part of #1342
2020-03-01 15:16:12 +01:00
e00048f574
Move model preloading call in the worker boot script
2020-03-01 15:12:44 +01:00
a8943e4769
Version 0.0.222
2020-02-29 16:06:07 +01:00
fd433a0ed3
Minor improvements for the integration test
2020-02-29 15:49:48 +01:00
28b862481e
Reduce integration test wait time to 600 seconds now that we reuse the cloned mozilla-central repository
2020-02-29 15:43:01 +01:00
7da13fe1ce
In the integration test, make the HTTP service workers reuse the already cloned repository
...
Fixes #1334
2020-02-29 15:40:04 +01:00
187a30d97d
Add an environment variable to define the path where to clone the mozilla-central repository in the HTTP service workers
2020-02-29 15:39:59 +01:00
14108175e9
Assert required DBs can be downloaded when booting the HTTP service workers
...
Fixes #1333
2020-02-29 14:23:33 +01:00
7812d5cc97
Temporarily disable tokenized bug-introducing commits finder task
...
As it is running too slowly (probably due to git's --ignore-revs-file option)
2020-02-29 11:33:19 +01:00
2af1bc2672
Make sure we take into account some test scheduling history without using it for training for group-level too
...
To properly calculate the failure statistics also for the
first failures in the first part of the history used for
training.
2020-02-29 11:27:06 +01:00
16488ecda3
Test scheduling history generator tasks depend on the commit retrieval task
2020-02-29 11:25:09 +01:00
0ed28b7ddb
Version 0.0.221
2020-02-28 22:00:48 +01:00
791c16ebe0
Misc fixes for the HTTP service and the integration tests ( #1332 )
...
* Simplify handling of HTTP service directory where to download models and correct installation of http_service package in the integration test
* Log http worker boot step and allow missing DB
* Retry for 10 minutes to allow the worker boot to finish
* Add more logging and wait more time
* Wait 30 seconds between requests as a workaround for https://github.com/mozilla/bugbug/issues/1340
Co-authored-by: Marco Castelluccio <mcastelluccio@mozilla.com>
2020-02-28 21:59:47 +01:00
58bd844553
Ignore http_service directory when building bugbug base images ( #1338 )
...
Otherwise whenever we make changes to the http_service, the base images are rebuilt.
Regression from 0eb7f91a23Fixes #1337
2020-02-28 19:21:28 +01:00
0ae747767a
Version 0.0.220
2020-02-28 12:23:02 +01:00
cfd82a8ad3
Clone mozilla-central and load the test scheduling and commits DBs when the HTTP service's workers start
...
Fixes #1299
2020-02-28 12:10:57 +01:00
9491e9da42
Use the test label scheduling DB for now for the TestFailure model and in the commit classifier
...
Regression from ba6c358ba7fe74b9b480
2020-02-28 11:56:11 +01:00
7faca6e443
Fix paths of the push_data_* files on the worker
2020-02-28 10:50:12 +01:00
0eb7f91a23
Use the new bugbug_http module, fixing tests and docker build
2020-02-28 10:49:40 +01:00
Marco Castelluccio
Andrew Halberstadt
Kaushik S Kalmady
dependabot-preview[bot]
Bastien Abadie
Bastien Abadie