Граф коммитов

106 Коммитов

Автор SHA1 Сообщение Дата
Marco Castelluccio d1016a3516 Simplify handling DB downloads
By hiding version handling in the db module.
2019-11-19 19:31:13 +01:00
Marco Castelluccio 0666cddd96 Make download_check_etag return whether a new file was downloaded or not 2019-11-19 19:04:19 +01:00
Marco Castelluccio 5926566721 Remove no longer needed fallback on old Taskcluster index 2019-11-19 16:23:22 +01:00
Marco Castelluccio 343d301188 Create a new hook to select tests to run for a given Phabricator revision 2019-11-19 15:43:06 +01:00
Marco Castelluccio 2f347cb853 Use fallback URL to the old Taskcluster index when retrieving the version file too 2019-11-12 10:30:44 +01:00
Marco Castelluccio 423e69aafa Add tests for utils.get_last_modified 2019-11-10 20:28:21 +01:00
Marco Castelluccio bcca240251 Remove unused pytest fixtures 2019-11-10 20:22:12 +01:00
Marco Castelluccio 039881e0a9 Add a few tests for utils.download_check_etag
The main objective was to make sure that the fallback introduced
by f54149cd90 is working correctly.
2019-11-08 23:49:36 +01:00
Marco Castelluccio a65fa07f8c Add mocks for fallback Taskcluster URLs
Follow-up to f54149cd90
2019-11-08 23:48:27 +01:00
Brian Stack f54149cd90 Update .taskcluster.yml for community cluster (#1076) 2019-11-08 22:13:10 +01:00
Ayush Shridhar edb46f8a96 WIP version of a spam bugs classifier (#1033)
Initial work for #1013.
2019-10-24 11:45:44 +02:00
Caitlin White ef1cdc8394 Add basic test for defect_enhancement_task model (#1019)
Fixes #438
2019-10-18 11:56:23 +02:00
Marco Castelluccio 517519d7d6 Add a test for the removal of a non-existent DB 2019-10-16 16:20:53 +02:00
Marco Castelluccio c9f8613d79 During training, don't build a list with all trainable elements, but use a generator
It could use too much memory if there are too many elements.
2019-10-12 00:58:39 +01:00
Dunja Lalic a95f54c269 Add tests for couple feature extractors (#972)
Fixes #730
2019-09-25 16:57:19 +02:00
Horacio Gonzalez 367f993144 Move exp_queue from repository.py to utils.py (#974)
Fixes #971
2019-09-25 15:52:37 +02:00
Boris Feld c30295f870 Add WIP integration test (#823) 2019-09-13 15:18:46 +02:00
Adrian-Tamas 431ce085ac Add pytest-responses and remove responses.activate (#942)
Fixes #723
2019-09-10 15:02:50 +02:00
cklyyung 81c17ecbaf Add extra functionality from run.py to the trainer script (#856)
Fixes #339
2019-08-06 01:19:59 +02:00
calixteman c6367f0809 Swap experience calculation and transform (#820)
This way we can stop parsing the modified files when getting the log.

Fixes #422.
2019-08-01 17:06:50 +02:00
Marco Castelluccio 4e39a619ed Consider remote DB as old if the remote version file returns any HTTP error 2019-07-27 02:05:11 +02:00
Marco Castelluccio 3747171716 Consider remote DB old if there is no version file yet 2019-07-27 02:05:11 +02:00
Marco Castelluccio 785aeca537 Support getting revisions before a given revision 2019-07-27 02:05:11 +02:00
Marco Castelluccio 73633e2e00 Make DB version handling saner to use
Fixing a problem where the retriever tasks would always write a version file
containing the version of the old DB.
2019-07-26 23:37:46 +02:00
Marco Castelluccio d54472f027 Don't raise an exception when a DB is not yet available
For example, the first time a task is created.
2019-07-23 02:14:22 +02:00
Anurag Aggarwal fbd411157c Add basic test case for the Uplift model (#696)
Fixes #437
2019-07-15 23:29:28 +02:00
Marco Castelluccio 09741b82df Remove tests for the old 'title' feature 2019-07-11 20:55:19 +02:00
Harshit chittora d5154c837d Use some bug features in the Backout model (#615)
Fixes #577.
2019-07-11 15:42:02 +02:00
Marco Castelluccio d08e062c68 Improve triggerSchema of the hooks and test it 2019-07-03 17:26:01 +02:00
Marco Castelluccio a94fe63d76 Test generated hooks are json-e renderable 2019-07-02 21:04:23 +02:00
Yun Seob Lee 259088cce8 Add basic test for the Assignee model (#621) 2019-07-02 20:52:08 +02:00
Marco Castelluccio 8961e22059 When the pushdate is not available because the commit is local only, use 'now' as the pushdate 2019-07-02 12:21:35 +02:00
x249wang 30d19efb5b Remove fallback on downloading xz files (#644) 2019-07-01 11:58:20 +02:00
Yun Seob Lee f836f25291 Add basic test for DevDocNeeded model (#661)
Fixes #435
2019-07-01 11:46:52 +02:00
Marco Castelluccio b969a4576c Fallback on xz URL for Last-Modified if the zst URL is not available 2019-06-26 21:46:40 +02:00
Marco Castelluccio a05096541d Don't try to extract files that are not compressed
Or we will fail downloading the DB version.
Also add a test for download_version and is_old_version.
2019-06-26 19:59:30 +02:00
Marco Castelluccio bcf405c747 Ensure pipeline yaml files are valid YAML and can be rendered with JSON-e
Part of #613
2019-06-26 18:35:46 +02:00
cklyyung 4124e0a990 Add tests for repository.download_component_mapping (#623) 2019-06-25 14:23:09 +02:00
x249wang ab28e8ace2 Use zstandard instead of xz (#524)
Fixes #461.
2019-06-24 13:16:44 +02:00
Yun Seob Lee af569c9c8e Add basic test for the Regression model (#618) 2019-06-22 12:44:31 -07:00
Yun Seob Lee 511a53a1de Add basic test for the backout model (#606) 2019-06-21 09:28:36 -07:00
cklyyung c9017df9ee Add basic test for defect model (#607) 2019-06-21 08:20:56 -07:00
Marco Castelluccio bc066eb3e6 Stop using subprocess in test_run.py, but import run.py and test its functions 2019-06-10 11:06:01 +02:00
Marco Castelluccio 23d76d3610 Collect coverage during the run.py test 2019-06-08 21:42:20 +02:00
Sladyn 860bb69c10 Add a basic test for the StepsToReproduce model (#503) 2019-06-07 11:11:39 +02:00
Marco ee935d6e5b
Download previous commits DB and experiences, and only mine data for new commits landed since then (#546)
* Download previous commits DB and experiences, and only mine data for new commits landed since then

Fixes #537

* Simplify db methods

* Add an option to return mined commits
2019-06-06 18:55:17 +02:00
Marco Castelluccio 47eb2da7ec Don't overwrite the first_pushdate value
Follow up to bea28a17f6
2019-06-05 01:07:12 +02:00
Marco Castelluccio bea28a17f6 Get first pushdate from hg log on following runs of the repository mining script
Otherwise we'd use the pushdate of the first new commit as the first pushdate.
2019-06-04 12:52:08 +02:00
Marco Castelluccio 36d7d4449e Store first_commit_time dict too in the experiences file
Otherwise on following runs of calculate_experiences we'd have wrong seniority.
2019-06-04 12:51:29 +02:00
Marco d8b84ca798
Support retrieving commits in steps (#536)
* Support retrieving commits in steps

* Store component mapping ETag to actually avoid downloading it again when not needed

* Store a version file alongside the DBs

* Export the commits DB version file and the experiences values as artifacts of the commit-retriever task
2019-06-03 19:29:08 +02:00