Граф коммитов

256 Коммитов

Автор SHA1 Сообщение Дата
dependabot-preview[bot] 30d8a21b84
Bump marshmallow from 3.5.0 to 3.5.1 (#1381)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.5.0 to 3.5.1.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.5.0...3.5.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-06 17:49:07 +01:00
Marco Castelluccio 8c9d76f51e Use logging module everywhere in the HTTP service instead of print 2020-03-06 11:34:29 +01:00
Marco Castelluccio ded66f9e3c Calculate number of times source files and directories in a commit were touched together with manifests
Part of #1281.
2020-03-05 22:31:41 +01:00
Marco Castelluccio 2a484732fc
Clone mozilla autoland in the HTTP service worker (#1372) 2020-03-05 15:54:04 +01:00
Marco Castelluccio 9fa3a3aa06
Apply mercurial patches on local repo when scheduling tests (#1369)
Fixes #1301
2020-03-05 15:10:03 +01:00
Marco Castelluccio 6c84e11f07 Download test group scheduling DB support file too when booting the HTTP service worker 2020-03-04 23:12:50 +01:00
Marco Castelluccio 5cc110a5fe
Fix old style redis key in classify_bug (#1367)
This also refactors all calls that store keys in redis to a 'setkey'
function. The main purpose being so we can log transactions at the debug
level, making it easier to investigate failures like this in the future.

Fixes #1365
2020-03-04 21:47:56 +01:00
Marco Castelluccio bbaa59a935 Preload models after cloning mozilla-central to avoid running out of memory 2020-03-04 12:09:24 +01:00
Andrew Halberstadt 3ae35962b0
[http_service] Add some extra tests for the '/<model>/predict' endpoints (#1364)
Fixes #1361
2020-03-04 01:16:56 +01:00
Kaushik S Kalmady 0667a6cc35
Return 404 when a model which doesn't exist is requested (#1359)
Fixes #1265
2020-03-03 20:19:52 +01:00
Andrew Halberstadt bb9c2fbf71
Implement the outline of a push scheduler service (#1319)
Fixes #1300
2020-03-03 20:17:58 +01:00
Kaushik S Kalmady 4fb3b4c51f
Fix dict access error and add a test with a request without an API key (#1360)
Fixes #1357
Fixes #1343
2020-03-03 18:33:27 +01:00
dependabot-preview[bot] 03e709cffd
Bump flask-apispec from 0.8.5 to 0.8.6 (#1354)
Bumps [flask-apispec](https://github.com/jmcarp/flask-apispec) from 0.8.5 to 0.8.6.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases)
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.5...0.8.6)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:37:30 +01:00
Andrew Halberstadt e2a54a04ab
Don't schedule new jobs when they are already 'queued' (#1347)
Fixes #1340
2020-03-02 21:31:32 +01:00
Marco Castelluccio b72e96b269
Allow overriding the version of bugbug used while building the HTTP service worker image (#1345)
* Prioritize the TAG environment variable over the bugbug package version

* Allow overriding the version of bugbug used while building the HTTP service worker image
2020-03-02 11:26:41 +01:00
Marco Castelluccio 3eee2f8c7a Use utils.download_model for downloading models in the HTTP service instead of reimplementing it
Fixes #1242
2020-03-01 21:33:18 +01:00
Marco Castelluccio 4d6ca3f323 Preload test selection models in the HTTP service workers 2020-03-01 20:13:59 +01:00
Marco Castelluccio a286a0df8e Download test selection models in the HTTP service
Making sure the HTTP service is built after the test selection models are trained.

Fixes #1330
2020-03-01 20:12:05 +01:00
Marco Castelluccio ececf8a58a Cache models in the HTTP service workers only if they are used more than once in two hours
Part of #1342
2020-03-01 16:18:51 +01:00
Marco Castelluccio 4695acfad9 Only preload models which we know are used very often
Part of #1342
2020-03-01 15:16:12 +01:00
Marco Castelluccio e00048f574 Move model preloading call in the worker boot script 2020-03-01 15:12:44 +01:00
Marco Castelluccio fd433a0ed3 Minor improvements for the integration test 2020-02-29 15:49:48 +01:00
Marco Castelluccio 28b862481e Reduce integration test wait time to 600 seconds now that we reuse the cloned mozilla-central repository 2020-02-29 15:43:01 +01:00
Marco Castelluccio 187a30d97d Add an environment variable to define the path where to clone the mozilla-central repository in the HTTP service workers 2020-02-29 15:39:59 +01:00
Marco Castelluccio 14108175e9 Assert required DBs can be downloaded when booting the HTTP service workers
Fixes #1333
2020-02-29 14:23:33 +01:00
Bastien Abadie 791c16ebe0
Misc fixes for the HTTP service and the integration tests (#1332)
* Simplify handling of HTTP service directory where to download models and correct installation of http_service package in the integration test

* Log http worker boot step and allow missing DB

* Retry for 10 minutes to allow the worker boot to finish

* Add more logging and wait more time

* Wait 30 seconds between requests as a workaround for https://github.com/mozilla/bugbug/issues/1340

Co-authored-by: Marco Castelluccio <mcastelluccio@mozilla.com>
2020-02-28 21:59:47 +01:00
Bastien Abadie cfd82a8ad3 Clone mozilla-central and load the test scheduling and commits DBs when the HTTP service's workers start
Fixes #1299
2020-02-28 12:10:57 +01:00
Bastien Abadie 0eb7f91a23 Use the new bugbug_http module, fixing tests and docker build 2020-02-28 10:49:40 +01:00
Bastien Abadie 194c1845d6 Move http_service files in a 'bugbug_http' Python module 2020-02-28 10:49:34 +01:00
dependabot-preview[bot] 73c0679943
Bump marshmallow from 3.4.0 to 3.5.0 (#1308)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.4.0 to 3.5.0.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.4.0...3.5.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-25 10:31:45 +01:00
dependabot-preview[bot] f8e7966b91
Bump apispec[yaml] from 3.2.0 to 3.3.0 (#1286)
Bumps [apispec[yaml]](https://github.com/marshmallow-code/apispec) from 3.2.0 to 3.3.0.
- [Release notes](https://github.com/marshmallow-code/apispec/releases)
- [Changelog](https://github.com/marshmallow-code/apispec/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec/compare/3.2.0...3.3.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-18 10:49:18 +01:00
dependabot-preview[bot] d83d62d82a
Bump apispec[yaml] from 3.1.0 to 3.2.0 (#1270)
Bumps [apispec[yaml]](https://github.com/marshmallow-code/apispec) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/marshmallow-code/apispec/releases)
- [Changelog](https://github.com/marshmallow-code/apispec/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec/compare/3.1.0...3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-05 23:47:12 +01:00
dependabot-preview[bot] a045202ed8
Bump marshmallow from 3.3.0 to 3.4.0 (#1264)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.3.0 to 3.4.0.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.3.0...3.4.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-04 10:32:12 +01:00
dependabot-preview[bot] 95bfe264a4
Bump rq from 1.2.0 to 1.2.2 (#1260)
Bumps [rq](https://github.com/nvie/rq) from 1.2.0 to 1.2.2.
- [Release notes](https://github.com/nvie/rq/releases)
- [Changelog](https://github.com/rq/rq/blob/master/CHANGES.md)
- [Commits](https://github.com/nvie/rq/compare/v1.2.0...v1.2.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-04 10:25:23 +01:00
dependabot-preview[bot] c9a393bd85 Bump flask-apispec from 0.8.4 to 0.8.5 (#1224)
Bumps [flask-apispec](https://github.com/jmcarp/flask-apispec) from 0.8.4 to 0.8.5.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases)
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.4...0.8.5)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-01-07 10:37:41 +01:00
dependabot-preview[bot] 4c317d232f Bump rq from 1.1.0 to 1.2.0 (#1226)
Bumps [rq](https://github.com/nvie/rq) from 1.1.0 to 1.2.0.
- [Release notes](https://github.com/nvie/rq/releases)
- [Changelog](https://github.com/rq/rq/blob/master/CHANGES.md)
- [Commits](https://github.com/nvie/rq/compare/v1.1.0...v1.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-01-07 10:36:55 +01:00
Ayush Shridhar 1752c8ed25 add spambug to http service (#1213)
Co-authored-by: Marco Castelluccio <mcastelluccio@mozilla.com>
2020-01-03 16:30:45 +01:00
Marco Castelluccio 245fb848a5 Add a pre-commit hook which runs the mypy static type checker 2019-12-08 13:24:00 +01:00
dependabot-preview[bot] bf8e03673d Bump marshmallow from 3.2.2 to 3.3.0 (#1155)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.2.2 to 3.3.0.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.2.2...3.3.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-06 10:32:30 +01:00
dependabot-preview[bot] f675a99485 Bump flask-apispec from 0.8.3 to 0.8.4 (#1153)
Bumps [flask-apispec](https://github.com/jmcarp/flask-apispec) from 0.8.3 to 0.8.4.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases)
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.3...0.8.4)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-05 09:53:16 +01:00
dependabot-preview[bot] 8ee0c27cf4 Bump rq-dashboard from 0.6.0 to 0.6.1 (#1147)
Bumps [rq-dashboard](https://github.com/Parallels/rq-dashboard) from 0.6.0 to 0.6.1.
- [Release notes](https://github.com/Parallels/rq-dashboard/releases)
- [Commits](https://github.com/Parallels/rq-dashboard/compare/0.6.0...0.6.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-30 01:09:43 +01:00
dependabot-preview[bot] 32facc15f4 Bump gunicorn from 20.0.3 to 20.0.4 (#1146)
Bumps [gunicorn](https://github.com/benoitc/gunicorn) from 20.0.3 to 20.0.4.
- [Release notes](https://github.com/benoitc/gunicorn/releases)
- [Commits](https://github.com/benoitc/gunicorn/compare/20.0.3...20.0.4)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-27 00:16:51 +01:00
dependabot-preview[bot] 548820cf7e Bump gunicorn from 20.0.2 to 20.0.3 (#1143)
Bumps [gunicorn](https://github.com/benoitc/gunicorn) from 20.0.2 to 20.0.3.
- [Release notes](https://github.com/benoitc/gunicorn/releases)
- [Commits](https://github.com/benoitc/gunicorn/compare/20.0.2...20.0.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-25 23:34:14 +01:00
dependabot-preview[bot] 0af0edd8e5 Bump gunicorn from 20.0.1 to 20.0.2 (#1138)
Bumps [gunicorn](https://github.com/benoitc/gunicorn) from 20.0.1 to 20.0.2.
- [Release notes](https://github.com/benoitc/gunicorn/releases)
- [Commits](https://github.com/benoitc/gunicorn/compare/20.0.1...20.0.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-23 12:10:45 +01:00
dependabot-preview[bot] 1116a44dcc Bump gunicorn from 20.0.0 to 20.0.1 (#1137)
Bumps [gunicorn](https://github.com/benoitc/gunicorn) from 20.0.0 to 20.0.1.
- [Release notes](https://github.com/benoitc/gunicorn/releases)
- [Commits](https://github.com/benoitc/gunicorn/compare/20.0.0...20.0.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-23 11:36:30 +01:00
dependabot-preview[bot] c6cefd384d Bump apispec-webframeworks from 0.5.1 to 0.5.2 (#1120)
Bumps [apispec-webframeworks](https://github.com/marshmallow-code/apispec-webframeworks) from 0.5.1 to 0.5.2.
- [Release notes](https://github.com/marshmallow-code/apispec-webframeworks/releases)
- [Changelog](https://github.com/marshmallow-code/apispec-webframeworks/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec-webframeworks/compare/0.5.1...0.5.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-21 18:21:55 +01:00
dependabot-preview[bot] 97b440c957 Bump apispec-webframeworks from 0.5.0 to 0.5.1 (#1106)
Bumps [apispec-webframeworks](https://github.com/marshmallow-code/apispec-webframeworks) from 0.5.0 to 0.5.1.
- [Release notes](https://github.com/marshmallow-code/apispec-webframeworks/releases)
- [Changelog](https://github.com/marshmallow-code/apispec-webframeworks/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec-webframeworks/compare/0.5.0...0.5.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-18 16:56:53 +01:00
dependabot-preview[bot] 2124f60a9a Bump gunicorn from 19.9.0 to 20.0.0 (#1091)
Bumps [gunicorn](https://github.com/benoitc/gunicorn) from 19.9.0 to 20.0.0.
- [Release notes](https://github.com/benoitc/gunicorn/releases)
- [Commits](https://github.com/benoitc/gunicorn/compare/19.9.0...20.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-09 11:09:20 +01:00
Brian Stack f54149cd90 Update .taskcluster.yml for community cluster (#1076) 2019-11-08 22:13:10 +01:00
dependabot-preview[bot] 4b45f3292b Bump rq-dashboard from 0.5.3 to 0.6.0 (#1078)
Bumps [rq-dashboard](https://github.com/Parallels/rq-dashboard) from 0.5.3 to 0.6.0.
- [Release notes](https://github.com/Parallels/rq-dashboard/releases)
- [Commits](https://github.com/Parallels/rq-dashboard/compare/0.5.3...0.6.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-05 18:48:20 +01:00
dependabot-preview[bot] b249365ff0 Bump apispec from 3.0.0 to 3.1.0 (#1074)
Bumps [apispec](https://github.com/marshmallow-code/apispec) from 3.0.0 to 3.1.0.
- [Release notes](https://github.com/marshmallow-code/apispec/releases)
- [Changelog](https://github.com/marshmallow-code/apispec/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec/compare/3.0.0...3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-05 00:54:06 +01:00
dependabot-preview[bot] 8588ef5c92 Bump marshmallow from 3.2.1 to 3.2.2 (#1075)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.2.1 to 3.2.2.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.2.1...3.2.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-05 00:51:44 +01:00
Marco Castelluccio 409c06a593 Don't use internal label encoder, but the model interface to it 2019-11-04 12:19:51 +01:00
dependabot-preview[bot] 57c8507c06 Bump cerberus from 1.3.1 to 1.3.2 (#1054)
Bumps [cerberus](https://github.com/pyeve/cerberus) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/pyeve/cerberus/releases)
- [Changelog](https://github.com/pyeve/cerberus/blob/1.3.2/CHANGES.rst)
- [Commits](https://github.com/pyeve/cerberus/compare/1.3.1...1.3.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-29 20:56:16 +01:00
Boris Feld 807ecaca85 Misc fixes to enable integration tests at release time (#987)
Fixes #985 and fixes #329
2019-10-24 20:09:32 +02:00
Philemon Johnson 2047243f2e When using pip in .taskcluster.yml and in Docker files, add options --disable-pip-version-check, --no-cache-dir and --quiet (#1032) 2019-10-21 17:42:39 +01:00
dependabot-preview[bot] 7f47f3f8d6 Bump marshmallow from 3.2.0 to 3.2.1 (#994)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.2.0 to 3.2.1.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.2.0...3.2.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-01 10:54:52 +02:00
dependabot-preview[bot] 50ccf3172c Bump apispec from 2.0.2 to 3.0.0 (#959)
Bumps [apispec](https://github.com/marshmallow-code/apispec) from 2.0.2 to 3.0.0.
- [Release notes](https://github.com/marshmallow-code/apispec/releases)
- [Changelog](https://github.com/marshmallow-code/apispec/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec/compare/2.0.2...3.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-20 09:53:53 +02:00
dependabot-preview[bot] 34640f220c Bump apispec-webframeworks from 0.4.0 to 0.5.0 (#967)
Bumps [apispec-webframeworks](https://github.com/marshmallow-code/apispec-webframeworks) from 0.4.0 to 0.5.0.
- [Release notes](https://github.com/marshmallow-code/apispec-webframeworks/releases)
- [Changelog](https://github.com/marshmallow-code/apispec-webframeworks/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec-webframeworks/compare/0.4.0...0.5.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-19 20:31:25 +02:00
dependabot-preview[bot] 521728b124 Bump marshmallow from 3.1.1 to 3.2.0 (#960)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.1.1 to 3.2.0.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.1.1...3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-17 19:58:03 +02:00
dependabot-preview[bot] ee040bf83d Bump flask-apispec from 0.8.2 to 0.8.3 (#961)
Bumps [flask-apispec](https://github.com/jmcarp/flask-apispec) from 0.8.2 to 0.8.3.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases)
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.2...0.8.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-17 19:57:56 +02:00
dependabot-preview[bot] bea2e0ea78 Bump flask-apispec from 0.8.1 to 0.8.2 (#958)
Bumps [flask-apispec](https://github.com/jmcarp/flask-apispec) from 0.8.1 to 0.8.2.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases)
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.1...0.8.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-17 10:12:25 +02:00
dependabot-preview[bot] 40f7b26988 Bump marshmallow from 3.1.0 to 3.1.1 (#957)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.1.0 to 3.1.1.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.1.0...3.1.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-16 19:44:42 +02:00
Boris Feld 93363aa568 Fix integration tests assertions (#952)
Fixes #948
2019-09-16 10:41:00 +02:00
dependabot-preview[bot] 348c33faaa Bump marshmallow from 3.0.5 to 3.1.0 (#955)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.5 to 3.1.0.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.5...3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-16 10:40:09 +02:00
Boris Feld 4cd77443b4 Fix the bug change time check for a single bug (#954)
The batch endpoint was already handling this case properly
2019-09-13 22:17:08 +02:00
Boris Feld c30295f870 Add WIP integration test (#823) 2019-09-13 15:18:46 +02:00
dependabot-preview[bot] 8b4b8356a3 Bump marshmallow from 3.0.4 to 3.0.5 (#947)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.4 to 3.0.5.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.4...3.0.5)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-13 10:11:44 +02:00
dependabot-preview[bot] ddf2ec19b9 Bump marshmallow from 3.0.3 to 3.0.4 (#944)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.3 to 3.0.4.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.3...3.0.4)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-12 09:43:16 +02:00
Adrian-Tamas 625889c9e4 Rearrange requirements alphabetically (#943)
And add a pre-commit hook to enforce it
2019-09-11 12:41:06 +02:00
dependabot-preview[bot] 39c1f35331 Bump marshmallow from 3.0.2 to 3.0.3 (#929)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.2 to 3.0.3.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.2...3.0.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-05 10:40:29 +02:00
dependabot-preview[bot] 9a0456f006 Bump marshmallow from 3.0.1 to 3.0.2 (#925)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.1 to 3.0.2.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.1...3.0.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-04 16:43:34 +02:00
dependabot-preview[bot] 198a4827d2 Bump rq-dashboard from 0.5.2 to 0.5.3 (#910)
Bump [rq-dashboard](https://github.com/eoranged/rq-dashboard) from 0.5.2 to 0.5.3.
- [Release notes](https://github.com/eoranged/rq-dashboard/releases)
- [Commits](https://github.com/eoranged/rq-dashboard/compare/0.5.2...0.5.3)
2019-09-01 21:26:48 +02:00
dependabot-preview[bot] 86f3a73f3b Bump marshmallow from 2.19.5 to 3.0.1 (#899)
Bump [marshmallow](https://github.com/marshmallow-code/marshmallow) from 2.19.5 to 3.0.1.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/2.19.5...3.0.1)
2019-09-01 21:06:02 +02:00
Lana Honcharuk 7a7d1186bd Move zstandard compression and decompression into utils module (#850) 2019-08-04 15:29:06 +02:00
Boris Feld 893740bda0 Also check for job timeout when checking if a job is running (#819)
It seems some RQ job can be stuck and block classification of single bug ids.
If a job timeout is crossed and the job is not running, clean it so it can be
requeued. Also bump the job timeout to 30 minutes.
2019-08-01 15:51:25 +02:00
Boris Feld 154014608c Validate batch endpoint inputs (#794) 2019-08-01 15:33:20 +02:00
Boris Feld b184105453 Clean cached predictions when a bug gets updated (#786)
Fixes #765
2019-07-26 16:47:54 +02:00
Marco Castelluccio c95519f315 Pin flask-cors version to 3.0.8 2019-07-22 13:55:37 +02:00
dependabot-preview[bot] d2fe730873 Bump flask-apispec from 0.8.0 to 0.8.1 (#743)
Bump [flask-apispec](https://github.com/jmcarp/flask-apispec) from 0.8.0 to 0.8.1.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases)
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.0...0.8.1)
2019-07-22 12:18:00 +02:00
dependabot-preview[bot] a187757e76 Bump apispec from 2.0.0 to 2.0.2 (#740)
Bump [apispec](https://github.com/marshmallow-code/apispec) from 2.0.0 to 2.0.2.
- [Release notes](https://github.com/marshmallow-code/apispec/releases)
- [Changelog](https://github.com/marshmallow-code/apispec/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec/compare/2.0.0...2.0.2)
2019-07-22 12:11:03 +02:00
dependabot-preview[bot] 07eec882b0 Bump flask from 1.0.3 to 1.1.1 (#745)
Bump [flask](https://github.com/pallets/flask) from 1.0.3 to 1.1.1.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/master/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/1.0.3...1.1.1)
2019-07-22 12:01:31 +02:00
dependabot-preview[bot] 3ecd380d00 Bump rq-dashboard from 0.5.1 to 0.5.2 (#746)
Bump [rq-dashboard](https://github.com/eoranged/rq-dashboard) from 0.5.1 to 0.5.2.
- [Release notes](https://github.com/eoranged/rq-dashboard/releases)
- [Commits](https://github.com/eoranged/rq-dashboard/compare/0.5.1...0.5.2)
2019-07-22 12:00:51 +02:00
dependabot-preview[bot] 9f97f444d2 Bump rq from 1.0 to 1.1.0 (#750)
Bump [rq](https://github.com/nvie/rq) from 1.0 to 1.1.0.
- [Release notes](https://github.com/nvie/rq/releases)
- [Changelog](https://github.com/rq/rq/blob/master/CHANGES.md)
- [Commits](https://github.com/nvie/rq/compare/v1.0...v1.1.0)
2019-07-22 11:56:08 +02:00
Boris Feld d00c175d66 Add OpenApi definition and docs (#617)
Fixes #608.
2019-07-18 11:42:27 +02:00
Boris Feld 2997d222b0 Rename the suggestion field into class (#670)
Following this review comment:
https://github.com/mozilla/relman-auto-nag/pull/733/files#r299047812
2019-07-04 12:49:33 +02:00
x249wang ab28e8ace2 Use zstandard instead of xz (#524)
Fixes #461.
2019-06-24 13:16:44 +02:00
Boris Feld caa4df32b4 Pre-load bugbug models in the RQ worker (#603)
* Pre-load bugbug models in the RQ worker

Implement our own background worker script in order to be able to load the
bugbug models before the RQ worker is forking. This way we load them once at
startup and each job will be able to reuse it.

* Update BG worker to use the new worker

Fixes #557
2019-06-21 08:24:15 -07:00
Boris Feld cc9c5e8c5d
Add the possibility for models to declare static extra data (#592)
This data will be saved and returned to the HTTP service customers.

There are other ways of exposing it, like having a dedicated endpoint for it
but it raises some questions about the web workers loading models and the
immediate goal is to remove the bugbug dependency from relman-auto-nag
project.
2019-06-14 16:46:41 +02:00
pyup.io bot d18234da39 Update rq to 1.0 (#568) 2019-06-13 22:02:44 +02:00
Boris Feld 7a7ae6475b Enable the stepstoreproduce model in the HTTP service (#587) 2019-06-13 18:00:01 +02:00
Boris Feld b7ef8d0e02 Use singular names for individual bug row result (#586) 2019-06-13 17:37:04 +02:00
Boris Feld bd568e1560 Fix http_service classification code (#585)
Commit 735fccc renamed bugzilla._download to bugzilla.get, update http_service
code to use the new API.
2019-06-13 11:07:48 +02:00
pyup.io bot d387d88300 Update rq-dashboard from 0.4.0 to 0.5.1 (#569) 2019-06-07 21:40:29 +02:00
Boris Feld a8faa48d8a Support classifying batches of bugs with a background worker (#321) 2019-06-07 21:22:14 +02:00
Boris Feld 2e05e57be2 Build docker images data pipeline tag (#566)
* Build the HTTP Docker image with the right tag

* Ensure the builded docker image has the right parent image
2019-06-07 16:46:05 +02:00
Boris Feld 8fc9598519 Ensure we download models from INDEX URL containing bugbug version (#565) 2019-06-07 16:16:19 +02:00
Boris Feld 6ee9fb57f0 Fix Docker build by downloading the models inside the image. Fix #504 (#516)
The data pipeline failed before because it tried downloading the model from
outside the Docker image and didn't had bugbug installed.

The clean way of solving this would be to build a base http service image on
release and build another one where we simply download the models but let's
fix it this way for now.
2019-05-29 20:43:58 +02:00
Boris Feld 1bae5834ab Implement deployment to Heroku (#458) 2019-05-23 20:39:02 +02:00
pyup.io bot a750b422fe Update flask from 1.0.2 to 1.0.3 (#459) 2019-05-18 01:46:16 +02:00
Boris Feld 297963e4ce Skip checking models while building the http service image, and only push it as part of the pipeline (#331)
* Add a way to skip checking models while building the http service image

* Don't push the http service on release

It isn't built with the real models on release

* Use taskboot 0.1.1
2019-05-02 23:18:51 +02:00
Boris Feld 369b44ea02 Update the index URLs in bugbug (#328)
* Update the index URLs in bugbug

* Split the http service Docker image in two

This way we can both:
- Build the first half (code + dependencies) in the usual CI.
- Build the second half at the end of the data pipeline with updated models.

Taskboot build-compose doesn't support building all services except a
specific one and it might be cumbersome to add this feature so move the second
half of the Docker image to a separate docker-compose file.
2019-05-02 17:00:32 +02:00
Boris Feld 053954d70b Run pre-commit in the lint task (#297) 2019-04-19 18:01:24 +02:00
Bastien Abadie b5153abc89 Docker full build using compose (#274) 2019-04-15 17:36:30 +02:00
Bastien Abadie 0ee0cd60bf Split models download and check scripts (#279) 2019-04-12 15:26:06 +02:00
Boris Feld 706b316a9c Add basic HTTP service (#262)
* Add basic HTTP service

It doesn't support batch requests or authentication yet

* Add very basic authentication

* Update dockerignore in http-service
2019-04-10 17:57:07 +02:00