Граф коммитов

50 Коммитов

Автор SHA1 Сообщение Дата
dependabot-preview[bot] 7f47f3f8d6 Bump marshmallow from 3.2.0 to 3.2.1 (#994)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.2.0 to 3.2.1.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.2.0...3.2.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-01 10:54:52 +02:00
dependabot-preview[bot] 50ccf3172c Bump apispec from 2.0.2 to 3.0.0 (#959)
Bumps [apispec](https://github.com/marshmallow-code/apispec) from 2.0.2 to 3.0.0.
- [Release notes](https://github.com/marshmallow-code/apispec/releases)
- [Changelog](https://github.com/marshmallow-code/apispec/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec/compare/2.0.2...3.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-20 09:53:53 +02:00
dependabot-preview[bot] 34640f220c Bump apispec-webframeworks from 0.4.0 to 0.5.0 (#967)
Bumps [apispec-webframeworks](https://github.com/marshmallow-code/apispec-webframeworks) from 0.4.0 to 0.5.0.
- [Release notes](https://github.com/marshmallow-code/apispec-webframeworks/releases)
- [Changelog](https://github.com/marshmallow-code/apispec-webframeworks/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec-webframeworks/compare/0.4.0...0.5.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-19 20:31:25 +02:00
dependabot-preview[bot] 521728b124 Bump marshmallow from 3.1.1 to 3.2.0 (#960)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.1.1 to 3.2.0.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.1.1...3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-17 19:58:03 +02:00
dependabot-preview[bot] ee040bf83d Bump flask-apispec from 0.8.2 to 0.8.3 (#961)
Bumps [flask-apispec](https://github.com/jmcarp/flask-apispec) from 0.8.2 to 0.8.3.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases)
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.2...0.8.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-17 19:57:56 +02:00
dependabot-preview[bot] bea2e0ea78 Bump flask-apispec from 0.8.1 to 0.8.2 (#958)
Bumps [flask-apispec](https://github.com/jmcarp/flask-apispec) from 0.8.1 to 0.8.2.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases)
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.1...0.8.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-17 10:12:25 +02:00
dependabot-preview[bot] 40f7b26988 Bump marshmallow from 3.1.0 to 3.1.1 (#957)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.1.0 to 3.1.1.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.1.0...3.1.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-16 19:44:42 +02:00
Boris Feld 93363aa568 Fix integration tests assertions (#952)
Fixes #948
2019-09-16 10:41:00 +02:00
dependabot-preview[bot] 348c33faaa Bump marshmallow from 3.0.5 to 3.1.0 (#955)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.5 to 3.1.0.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.5...3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-16 10:40:09 +02:00
Boris Feld 4cd77443b4 Fix the bug change time check for a single bug (#954)
The batch endpoint was already handling this case properly
2019-09-13 22:17:08 +02:00
Boris Feld c30295f870 Add WIP integration test (#823) 2019-09-13 15:18:46 +02:00
dependabot-preview[bot] 8b4b8356a3 Bump marshmallow from 3.0.4 to 3.0.5 (#947)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.4 to 3.0.5.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.4...3.0.5)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-13 10:11:44 +02:00
dependabot-preview[bot] ddf2ec19b9 Bump marshmallow from 3.0.3 to 3.0.4 (#944)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.3 to 3.0.4.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.3...3.0.4)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-12 09:43:16 +02:00
Adrian-Tamas 625889c9e4 Rearrange requirements alphabetically (#943)
And add a pre-commit hook to enforce it
2019-09-11 12:41:06 +02:00
dependabot-preview[bot] 39c1f35331 Bump marshmallow from 3.0.2 to 3.0.3 (#929)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.2 to 3.0.3.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.2...3.0.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-05 10:40:29 +02:00
dependabot-preview[bot] 9a0456f006 Bump marshmallow from 3.0.1 to 3.0.2 (#925)
Bumps [marshmallow](https://github.com/marshmallow-code/marshmallow) from 3.0.1 to 3.0.2.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/3.0.1...3.0.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-04 16:43:34 +02:00
dependabot-preview[bot] 198a4827d2 Bump rq-dashboard from 0.5.2 to 0.5.3 (#910)
Bump [rq-dashboard](https://github.com/eoranged/rq-dashboard) from 0.5.2 to 0.5.3.
- [Release notes](https://github.com/eoranged/rq-dashboard/releases)
- [Commits](https://github.com/eoranged/rq-dashboard/compare/0.5.2...0.5.3)
2019-09-01 21:26:48 +02:00
dependabot-preview[bot] 86f3a73f3b Bump marshmallow from 2.19.5 to 3.0.1 (#899)
Bump [marshmallow](https://github.com/marshmallow-code/marshmallow) from 2.19.5 to 3.0.1.
- [Release notes](https://github.com/marshmallow-code/marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/marshmallow/compare/2.19.5...3.0.1)
2019-09-01 21:06:02 +02:00
Lana Honcharuk 7a7d1186bd Move zstandard compression and decompression into utils module (#850) 2019-08-04 15:29:06 +02:00
Boris Feld 893740bda0 Also check for job timeout when checking if a job is running (#819)
It seems some RQ job can be stuck and block classification of single bug ids.
If a job timeout is crossed and the job is not running, clean it so it can be
requeued. Also bump the job timeout to 30 minutes.
2019-08-01 15:51:25 +02:00
Boris Feld 154014608c Validate batch endpoint inputs (#794) 2019-08-01 15:33:20 +02:00
Boris Feld b184105453 Clean cached predictions when a bug gets updated (#786)
Fixes #765
2019-07-26 16:47:54 +02:00
Marco Castelluccio c95519f315 Pin flask-cors version to 3.0.8 2019-07-22 13:55:37 +02:00
dependabot-preview[bot] d2fe730873 Bump flask-apispec from 0.8.0 to 0.8.1 (#743)
Bump [flask-apispec](https://github.com/jmcarp/flask-apispec) from 0.8.0 to 0.8.1.
- [Release notes](https://github.com/jmcarp/flask-apispec/releases)
- [Changelog](https://github.com/jmcarp/flask-apispec/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jmcarp/flask-apispec/compare/0.8.0...0.8.1)
2019-07-22 12:18:00 +02:00
dependabot-preview[bot] a187757e76 Bump apispec from 2.0.0 to 2.0.2 (#740)
Bump [apispec](https://github.com/marshmallow-code/apispec) from 2.0.0 to 2.0.2.
- [Release notes](https://github.com/marshmallow-code/apispec/releases)
- [Changelog](https://github.com/marshmallow-code/apispec/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/apispec/compare/2.0.0...2.0.2)
2019-07-22 12:11:03 +02:00
dependabot-preview[bot] 07eec882b0 Bump flask from 1.0.3 to 1.1.1 (#745)
Bump [flask](https://github.com/pallets/flask) from 1.0.3 to 1.1.1.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/master/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/1.0.3...1.1.1)
2019-07-22 12:01:31 +02:00
dependabot-preview[bot] 3ecd380d00 Bump rq-dashboard from 0.5.1 to 0.5.2 (#746)
Bump [rq-dashboard](https://github.com/eoranged/rq-dashboard) from 0.5.1 to 0.5.2.
- [Release notes](https://github.com/eoranged/rq-dashboard/releases)
- [Commits](https://github.com/eoranged/rq-dashboard/compare/0.5.1...0.5.2)
2019-07-22 12:00:51 +02:00
dependabot-preview[bot] 9f97f444d2 Bump rq from 1.0 to 1.1.0 (#750)
Bump [rq](https://github.com/nvie/rq) from 1.0 to 1.1.0.
- [Release notes](https://github.com/nvie/rq/releases)
- [Changelog](https://github.com/rq/rq/blob/master/CHANGES.md)
- [Commits](https://github.com/nvie/rq/compare/v1.0...v1.1.0)
2019-07-22 11:56:08 +02:00
Boris Feld d00c175d66 Add OpenApi definition and docs (#617)
Fixes #608.
2019-07-18 11:42:27 +02:00
Boris Feld 2997d222b0 Rename the suggestion field into class (#670)
Following this review comment:
https://github.com/mozilla/relman-auto-nag/pull/733/files#r299047812
2019-07-04 12:49:33 +02:00
x249wang ab28e8ace2 Use zstandard instead of xz (#524)
Fixes #461.
2019-06-24 13:16:44 +02:00
Boris Feld caa4df32b4 Pre-load bugbug models in the RQ worker (#603)
* Pre-load bugbug models in the RQ worker

Implement our own background worker script in order to be able to load the
bugbug models before the RQ worker is forking. This way we load them once at
startup and each job will be able to reuse it.

* Update BG worker to use the new worker

Fixes #557
2019-06-21 08:24:15 -07:00
Boris Feld cc9c5e8c5d
Add the possibility for models to declare static extra data (#592)
This data will be saved and returned to the HTTP service customers.

There are other ways of exposing it, like having a dedicated endpoint for it
but it raises some questions about the web workers loading models and the
immediate goal is to remove the bugbug dependency from relman-auto-nag
project.
2019-06-14 16:46:41 +02:00
pyup.io bot d18234da39 Update rq to 1.0 (#568) 2019-06-13 22:02:44 +02:00
Boris Feld 7a7ae6475b Enable the stepstoreproduce model in the HTTP service (#587) 2019-06-13 18:00:01 +02:00
Boris Feld b7ef8d0e02 Use singular names for individual bug row result (#586) 2019-06-13 17:37:04 +02:00
Boris Feld bd568e1560 Fix http_service classification code (#585)
Commit 735fccc renamed bugzilla._download to bugzilla.get, update http_service
code to use the new API.
2019-06-13 11:07:48 +02:00
pyup.io bot d387d88300 Update rq-dashboard from 0.4.0 to 0.5.1 (#569) 2019-06-07 21:40:29 +02:00
Boris Feld a8faa48d8a Support classifying batches of bugs with a background worker (#321) 2019-06-07 21:22:14 +02:00
Boris Feld 2e05e57be2 Build docker images data pipeline tag (#566)
* Build the HTTP Docker image with the right tag

* Ensure the builded docker image has the right parent image
2019-06-07 16:46:05 +02:00
Boris Feld 8fc9598519 Ensure we download models from INDEX URL containing bugbug version (#565) 2019-06-07 16:16:19 +02:00
Boris Feld 6ee9fb57f0 Fix Docker build by downloading the models inside the image. Fix #504 (#516)
The data pipeline failed before because it tried downloading the model from
outside the Docker image and didn't had bugbug installed.

The clean way of solving this would be to build a base http service image on
release and build another one where we simply download the models but let's
fix it this way for now.
2019-05-29 20:43:58 +02:00
Boris Feld 1bae5834ab Implement deployment to Heroku (#458) 2019-05-23 20:39:02 +02:00
pyup.io bot a750b422fe Update flask from 1.0.2 to 1.0.3 (#459) 2019-05-18 01:46:16 +02:00
Boris Feld 297963e4ce Skip checking models while building the http service image, and only push it as part of the pipeline (#331)
* Add a way to skip checking models while building the http service image

* Don't push the http service on release

It isn't built with the real models on release

* Use taskboot 0.1.1
2019-05-02 23:18:51 +02:00
Boris Feld 369b44ea02 Update the index URLs in bugbug (#328)
* Update the index URLs in bugbug

* Split the http service Docker image in two

This way we can both:
- Build the first half (code + dependencies) in the usual CI.
- Build the second half at the end of the data pipeline with updated models.

Taskboot build-compose doesn't support building all services except a
specific one and it might be cumbersome to add this feature so move the second
half of the Docker image to a separate docker-compose file.
2019-05-02 17:00:32 +02:00
Boris Feld 053954d70b Run pre-commit in the lint task (#297) 2019-04-19 18:01:24 +02:00
Bastien Abadie b5153abc89 Docker full build using compose (#274) 2019-04-15 17:36:30 +02:00
Bastien Abadie 0ee0cd60bf Split models download and check scripts (#279) 2019-04-12 15:26:06 +02:00
Boris Feld 706b316a9c Add basic HTTP service (#262)
* Add basic HTTP service

It doesn't support batch requests or authentication yet

* Add very basic authentication

* Update dockerignore in http-service
2019-04-10 17:57:07 +02:00