Граф коммитов

13 Коммитов

Автор SHA1 Сообщение Дата
Armen Zambrano 2c4ee86e65
Bug 1622336 - Trigger schedules API as soon as a push happens (#1548)
This change adds a Pulse listener for hg pushes as a background process
to `bugbug-http-service`.

This listener works if `PULSE_USER` and `PULSE_PASSWORD` are set before starting
up the Docker containers.

The listener only pays attention to autoland and try pushes. When these happen
we do a GET request from the bugbug deployment. This will get the schedules service
ready for when the Gecko decision task will query it.
2020-05-08 17:05:16 +02:00
Bastien Abadie 0eb7f91a23 Use the new bugbug_http module, fixing tests and docker build 2020-02-28 10:49:40 +01:00
Philemon Johnson 2047243f2e When using pip in .taskcluster.yml and in Docker files, add options --disable-pip-version-check, --no-cache-dir and --quiet (#1032) 2019-10-21 17:42:39 +01:00
Boris Feld caa4df32b4 Pre-load bugbug models in the RQ worker (#603)
* Pre-load bugbug models in the RQ worker

Implement our own background worker script in order to be able to load the
bugbug models before the RQ worker is forking. This way we load them once at
startup and each job will be able to reuse it.

* Update BG worker to use the new worker

Fixes #557
2019-06-21 08:24:15 -07:00
Boris Feld a8faa48d8a Support classifying batches of bugs with a background worker (#321) 2019-06-07 21:22:14 +02:00
Boris Feld 2e05e57be2 Build docker images data pipeline tag (#566)
* Build the HTTP Docker image with the right tag

* Ensure the builded docker image has the right parent image
2019-06-07 16:46:05 +02:00
Boris Feld 6ee9fb57f0 Fix Docker build by downloading the models inside the image. Fix #504 (#516)
The data pipeline failed before because it tried downloading the model from
outside the Docker image and didn't had bugbug installed.

The clean way of solving this would be to build a base http service image on
release and build another one where we simply download the models but let's
fix it this way for now.
2019-05-29 20:43:58 +02:00
Boris Feld 1bae5834ab Implement deployment to Heroku (#458) 2019-05-23 20:39:02 +02:00
Boris Feld 297963e4ce Skip checking models while building the http service image, and only push it as part of the pipeline (#331)
* Add a way to skip checking models while building the http service image

* Don't push the http service on release

It isn't built with the real models on release

* Use taskboot 0.1.1
2019-05-02 23:18:51 +02:00
Boris Feld 369b44ea02 Update the index URLs in bugbug (#328)
* Update the index URLs in bugbug

* Split the http service Docker image in two

This way we can both:
- Build the first half (code + dependencies) in the usual CI.
- Build the second half at the end of the data pipeline with updated models.

Taskboot build-compose doesn't support building all services except a
specific one and it might be cumbersome to add this feature so move the second
half of the Docker image to a separate docker-compose file.
2019-05-02 17:00:32 +02:00
Bastien Abadie b5153abc89 Docker full build using compose (#274) 2019-04-15 17:36:30 +02:00
Bastien Abadie 0ee0cd60bf Split models download and check scripts (#279) 2019-04-12 15:26:06 +02:00
Boris Feld 706b316a9c Add basic HTTP service (#262)
* Add basic HTTP service

It doesn't support batch requests or authentication yet

* Add very basic authentication

* Update dockerignore in http-service
2019-04-10 17:57:07 +02:00