Граф коммитов

17 Коммитов

Автор SHA1 Сообщение Дата
Marco Castelluccio 63b491c3ea Redownload inconsistent 'Invalid Bugs' bugs too 2020-04-12 02:16:33 +02:00
Marco Castelluccio 54f9d3ae8c Temporary workaround for the integration test 2019-11-21 23:45:58 +01:00
Marco Castelluccio d1016a3516 Simplify handling DB downloads
By hiding version handling in the db module.
2019-11-19 19:31:13 +01:00
Marco Castelluccio 714e5196f0 Also limit the number of regressed by bugs to retrieve 2019-11-02 17:15:20 +01:00
Marco Castelluccio 41b1b5caae Don't overwrite all_ids 2019-11-02 17:13:40 +01:00
Boris Feld 807ecaca85 Misc fixes to enable integration tests at release time (#987)
Fixes #985 and fixes #329
2019-10-24 20:09:32 +02:00
Boris Feld c30295f870 Add WIP integration test (#823) 2019-09-13 15:18:46 +02:00
Shishir Jha 6e1479bc30 Add a main function to all console_scripts so they are more easily runnable (#936)
Fixes #831
2019-09-09 22:55:39 +02:00
Lana Honcharuk 7a7d1186bd Move zstandard compression and decompression into utils module (#850) 2019-08-04 15:29:06 +02:00
Marco Castelluccio 73633e2e00 Make DB version handling saner to use
Fixing a problem where the retriever tasks would always write a version file
containing the version of the old DB.
2019-07-26 23:37:46 +02:00
Marco Castelluccio d0786502d3 Download bugs which caused regressions fixed by commits too
Required for #772
2019-07-25 01:07:08 +02:00
Marco Castelluccio a614d34735 Move download of bugs linked to commits in the bug-retriever script
Also, make the bug-retriever task depend on the commit-retriever one, making the
download of bugs linked to commits actually work :)
2019-07-25 01:05:25 +02:00
x249wang ab28e8ace2 Use zstandard instead of xz (#524)
Fixes #461.
2019-06-24 13:16:44 +02:00
AK.py f6289a4468 Don't try to find inconsistencies in all bugs multiple times (#595) 2019-06-18 13:37:01 -07:00
Marco Castelluccio 735fccc4a9 In the retrieval task, download only new or changed bugs
To support it, refactor bugzilla methods:
- adding methods to get IDs given a query and given a time period;
- renaming the internal _download method to get, since it's used externally;
- changing delete to be more flexible and allowing to use a lambda to choose which bugs to delete.

Fixes #440.
2019-06-09 00:32:23 +02:00
Boris Feld 4b55b7f4f3 Add support to get secrets from taskcluster (#294) 2019-04-19 16:49:07 +02:00
Boris Feld b651744b18 Import retriever services and add Docker image definition (#251)
* Import Retriever class from release-services repository

This basically import the `retriever.py` file from the `release-services`
repository at hash 77cdddd. I removed imports and reference to cli-common
helpers that will likely needs to be reimplemented, like the raven support.

The next commit will defines some Dockerfiles that will use the imported file.

* Add docker image definition

Build three Docker image, one is for bugbug itself. It is just installing
bugbug and its dependencies.

One is for retrieving information from the mozilla-central Mercurial
repository, it depends on the first one and install the right Mercurial
version.

The last one is for retrieving information from the Bugzilla instance, it
depends in the first one and needs a valid Bugzilla token.

* Separate the two tasks into separate script files

They share almost no code at all so they don't need to be in the same file

* Apply Black on the scripts to makes Flake8 happy
2019-04-09 16:30:09 +02:00