Marco Castelluccio
d1016a3516
Simplify handling DB downloads
...
By hiding version handling in the db module.
2019-11-19 19:31:13 +01:00
Marco Castelluccio
0666cddd96
Make download_check_etag return whether a new file was downloaded or not
2019-11-19 19:04:19 +01:00
Marco Castelluccio
5926566721
Remove no longer needed fallback on old Taskcluster index
2019-11-19 16:23:22 +01:00
Marco Castelluccio
343d301188
Create a new hook to select tests to run for a given Phabricator revision
2019-11-19 15:43:06 +01:00
Marco Castelluccio
2f347cb853
Use fallback URL to the old Taskcluster index when retrieving the version file too
2019-11-12 10:30:44 +01:00
Marco Castelluccio
423e69aafa
Add tests for utils.get_last_modified
2019-11-10 20:28:21 +01:00
Marco Castelluccio
bcca240251
Remove unused pytest fixtures
2019-11-10 20:22:12 +01:00
Marco Castelluccio
039881e0a9
Add a few tests for utils.download_check_etag
...
The main objective was to make sure that the fallback introduced
by f54149cd90
is working correctly.
2019-11-08 23:49:36 +01:00
Marco Castelluccio
a65fa07f8c
Add mocks for fallback Taskcluster URLs
...
Follow-up to f54149cd90
2019-11-08 23:48:27 +01:00
Brian Stack
f54149cd90
Update .taskcluster.yml for community cluster ( #1076 )
2019-11-08 22:13:10 +01:00
Ayush Shridhar
edb46f8a96
WIP version of a spam bugs classifier ( #1033 )
...
Initial work for #1013 .
2019-10-24 11:45:44 +02:00
Caitlin White
ef1cdc8394
Add basic test for defect_enhancement_task model ( #1019 )
...
Fixes #438
2019-10-18 11:56:23 +02:00
Marco Castelluccio
517519d7d6
Add a test for the removal of a non-existent DB
2019-10-16 16:20:53 +02:00
Marco Castelluccio
c9f8613d79
During training, don't build a list with all trainable elements, but use a generator
...
It could use too much memory if there are too many elements.
2019-10-12 00:58:39 +01:00
Dunja Lalic
a95f54c269
Add tests for couple feature extractors ( #972 )
...
Fixes #730
2019-09-25 16:57:19 +02:00
Horacio Gonzalez
367f993144
Move exp_queue from repository.py to utils.py ( #974 )
...
Fixes #971
2019-09-25 15:52:37 +02:00
Boris Feld
c30295f870
Add WIP integration test ( #823 )
2019-09-13 15:18:46 +02:00
Adrian-Tamas
431ce085ac
Add pytest-responses and remove responses.activate ( #942 )
...
Fixes #723
2019-09-10 15:02:50 +02:00
cklyyung
81c17ecbaf
Add extra functionality from run.py to the trainer script ( #856 )
...
Fixes #339
2019-08-06 01:19:59 +02:00
calixteman
c6367f0809
Swap experience calculation and transform ( #820 )
...
This way we can stop parsing the modified files when getting the log.
Fixes #422 .
2019-08-01 17:06:50 +02:00
Marco Castelluccio
4e39a619ed
Consider remote DB as old if the remote version file returns any HTTP error
2019-07-27 02:05:11 +02:00
Marco Castelluccio
3747171716
Consider remote DB old if there is no version file yet
2019-07-27 02:05:11 +02:00
Marco Castelluccio
785aeca537
Support getting revisions before a given revision
2019-07-27 02:05:11 +02:00
Marco Castelluccio
73633e2e00
Make DB version handling saner to use
...
Fixing a problem where the retriever tasks would always write a version file
containing the version of the old DB.
2019-07-26 23:37:46 +02:00
Marco Castelluccio
d54472f027
Don't raise an exception when a DB is not yet available
...
For example, the first time a task is created.
2019-07-23 02:14:22 +02:00
Anurag Aggarwal
fbd411157c
Add basic test case for the Uplift model ( #696 )
...
Fixes #437
2019-07-15 23:29:28 +02:00
Marco Castelluccio
09741b82df
Remove tests for the old 'title' feature
2019-07-11 20:55:19 +02:00
Harshit chittora
d5154c837d
Use some bug features in the Backout model ( #615 )
...
Fixes #577 .
2019-07-11 15:42:02 +02:00
Marco Castelluccio
d08e062c68
Improve triggerSchema of the hooks and test it
2019-07-03 17:26:01 +02:00
Marco Castelluccio
a94fe63d76
Test generated hooks are json-e renderable
2019-07-02 21:04:23 +02:00
Yun Seob Lee
259088cce8
Add basic test for the Assignee model ( #621 )
2019-07-02 20:52:08 +02:00
Marco Castelluccio
8961e22059
When the pushdate is not available because the commit is local only, use 'now' as the pushdate
2019-07-02 12:21:35 +02:00
x249wang
30d19efb5b
Remove fallback on downloading xz files ( #644 )
2019-07-01 11:58:20 +02:00
Yun Seob Lee
f836f25291
Add basic test for DevDocNeeded model ( #661 )
...
Fixes #435
2019-07-01 11:46:52 +02:00
Marco Castelluccio
b969a4576c
Fallback on xz URL for Last-Modified if the zst URL is not available
2019-06-26 21:46:40 +02:00
Marco Castelluccio
a05096541d
Don't try to extract files that are not compressed
...
Or we will fail downloading the DB version.
Also add a test for download_version and is_old_version.
2019-06-26 19:59:30 +02:00
Marco Castelluccio
bcf405c747
Ensure pipeline yaml files are valid YAML and can be rendered with JSON-e
...
Part of #613
2019-06-26 18:35:46 +02:00
cklyyung
4124e0a990
Add tests for repository.download_component_mapping ( #623 )
2019-06-25 14:23:09 +02:00
x249wang
ab28e8ace2
Use zstandard instead of xz ( #524 )
...
Fixes #461 .
2019-06-24 13:16:44 +02:00
Yun Seob Lee
af569c9c8e
Add basic test for the Regression model ( #618 )
2019-06-22 12:44:31 -07:00
Yun Seob Lee
511a53a1de
Add basic test for the backout model ( #606 )
2019-06-21 09:28:36 -07:00
cklyyung
c9017df9ee
Add basic test for defect model ( #607 )
2019-06-21 08:20:56 -07:00
Marco Castelluccio
bc066eb3e6
Stop using subprocess in test_run.py, but import run.py and test its functions
2019-06-10 11:06:01 +02:00
Marco Castelluccio
23d76d3610
Collect coverage during the run.py test
2019-06-08 21:42:20 +02:00
Sladyn
860bb69c10
Add a basic test for the StepsToReproduce model ( #503 )
2019-06-07 11:11:39 +02:00
Marco
ee935d6e5b
Download previous commits DB and experiences, and only mine data for new commits landed since then ( #546 )
...
* Download previous commits DB and experiences, and only mine data for new commits landed since then
Fixes #537
* Simplify db methods
* Add an option to return mined commits
2019-06-06 18:55:17 +02:00
Marco Castelluccio
47eb2da7ec
Don't overwrite the first_pushdate value
...
Follow up to bea28a17f6
2019-06-05 01:07:12 +02:00
Marco Castelluccio
bea28a17f6
Get first pushdate from hg log on following runs of the repository mining script
...
Otherwise we'd use the pushdate of the first new commit as the first pushdate.
2019-06-04 12:52:08 +02:00
Marco Castelluccio
36d7d4449e
Store first_commit_time dict too in the experiences file
...
Otherwise on following runs of calculate_experiences we'd have wrong seniority.
2019-06-04 12:51:29 +02:00
Marco
d8b84ca798
Support retrieving commits in steps ( #536 )
...
* Support retrieving commits in steps
* Store component mapping ETag to actually avoid downloading it again when not needed
* Store a version file alongside the DBs
* Export the commits DB version file and the experiences values as artifacts of the commit-retriever task
2019-06-03 19:29:08 +02:00