Граф коммитов

19 Коммитов

Автор SHA1 Сообщение Дата
Marco Castelluccio 3d88eb8299 Add a script to generate a DB of past bugs fixed in functions
First part of #1133
2019-12-11 11:20:48 +01:00
Marco Castelluccio 2492ed58b4 Add a task to retrieve test scheduling history 2019-09-11 21:16:19 +02:00
Ayush Shridhar 6181dd11af Convert the similarity trainer script to be a console_script (#931) 2019-09-05 11:57:33 +02:00
Ayush Shridhar 59ed555325 Add a task to train a similarity model (the BM25 one) (#874) 2019-09-04 14:38:33 +02:00
Boris Feld 8b4cfd2dc4 Check metrics evolution (#836)
Fixes #360 and fixes #641.
2019-08-05 10:22:55 +02:00
cklyyung cf31198d3e Move bug classification code from run.py into a separate script (#829) 2019-08-03 02:20:09 +02:00
Marco 77ec8b529d
Add a WIP script to find bug-introducing commits (#748)
* Install depot_tools in the commit retrieval image

* Add a WIP script to find bug-introducing commits

* Add a task which runs the bug-introducing commits finder script
2019-07-22 14:41:34 +02:00
Marco Castelluccio 1746ba8f7e Make commit_classifier a console_script 2019-07-02 19:39:59 +02:00
Marco Castelluccio 56f224b9dc Generate microannotate repository for mozilla-central 2019-06-26 18:57:36 +02:00
Boris Feld 0b43d289ac Fix default Python version declaration in pre-commit config (#584)
* Fix default Python version declaration in pre-commit config

The new way of of declaring default Python version was introduced in
pre-commit 1.14.0 and warning about unknown config keys was introduced in
pre-commit 1.17.0.
2019-06-13 13:15:53 +02:00
Marco Castelluccio 23f85ea6fe Simplify setup.py now that we are no longer using dependency links 2019-06-08 21:11:16 +02:00
Boris Feld f4b2b938be
Add basic check method and check script (#341)
* Add basic check method and check script

* Ensure the check of component will correctly use super result

* Add required infra to schedule model checks

* Add scheduling bits for the model checks

* Remove the filtering on classification

* Extract counting bugs to a new function in bugzilla.py

* Also checks conflated components

* Fix new hook id

* Call bugzilla with the count_only param to speed up the check

* Fix the new hook scope to match the hook id

* Fix component model check after previous refactoring

* Fix component model check method

* Use a bugzilla report for even faster component model check

* Clarify get_product_component_count docstring

We are already filtering out full component with 0 bugs

* Update conflated components mapping check

A conflated component could also be part of the conflated components mapping

* Distinguish between non-existing full components and empty full components

* Remove the filter on resolution and unnecessary url params

* Update component check method

Keep checks as separate as possible for clarity, we could merge them or makes
them faster later

* Generate dynamically the CSV report url

* Fix Docker image name the hook

* Implement component check number 5

Get the meaningful components for the last 6 months

* Handle reviews comments

* Remove extraneous print

* Removes TODO

* Use a different threshold ration when checking for new meaningful components

As we are only checking new bugs for 6 months, adjust the threshold ration to
be less sensitive to occasional burst ob bugs for q given component.

* Reduce the threshold ratio

As we check on a disjoint time window, reduce the chance of false positives

* Handle review nits

* Fix last nits
2019-05-10 12:20:23 +02:00
Boris Feld 90a8d0f007 Move Keras as an optional dependency (#319)
Fixes #317
2019-04-26 18:50:02 +02:00
Boris Feld 8755ea94e5 Make Spacy and Gensim dependencies optional (#310) 2019-04-26 16:16:18 +02:00
Boris Feld 6af6e8b927 Import Trainer class from release-services repository (#254)
* Import Trainer class from release-services repository

This basically import the `trainer.py` file from the `release-services`
repository at hash 77cdddd. I removed imports and reference to cli-common
helpers that will likely need to be reimplemented, like the raven support.

Also defines 4 docker images, one per model to train.

* Remove unused imports
2019-04-09 17:49:56 +02:00
Boris Feld b651744b18 Import retriever services and add Docker image definition (#251)
* Import Retriever class from release-services repository

This basically import the `retriever.py` file from the `release-services`
repository at hash 77cdddd. I removed imports and reference to cli-common
helpers that will likely needs to be reimplemented, like the raven support.

The next commit will defines some Dockerfiles that will use the imported file.

* Add docker image definition

Build three Docker image, one is for bugbug itself. It is just installing
bugbug and its dependencies.

One is for retrieving information from the mozilla-central Mercurial
repository, it depends on the first one and install the right Mercurial
version.

The last one is for retrieving information from the Bugzilla instance, it
depends in the first one and needs a valid Bugzilla token.

* Separate the two tasks into separate script files

They share almost no code at all so they don't need to be in the same file

* Apply Black on the scripts to makes Flake8 happy
2019-04-09 16:30:09 +02:00
Boris Feld bad6a50d8b Pre commit setup (#252)
* Add pre-commit configuration

Add auto-formatting configuration using the https://pre-commit.com/ project.
Having auto-formatting setup and automatically enforced helps speeding up
development and review process.

* Apply the auto-formatting on all files in the repository

* Removes flake8-quotes as it conflicts with Black formatting

* Disable some Flake8 rules

Disable Flake8 rules that are handled by Black. The list comes from
https://github.com/ambv/black/issues/429#issuecomment-472687803.
2019-04-09 15:57:29 +02:00
Marco Castelluccio 6efa79fbea Load URL requirements too 2018-12-14 00:01:27 +01:00
Marco 00b53f350c Add setup.py and test building bugbug package (#1)
Former-commit-id: 0bea3bc5f1a3dff3dd3813f9ed7de6958ca99f7f
2018-11-19 22:53:17 +01:00