microsoft
/
ghcrawler
зеркало из https://github.com/microsoft/ghcrawler.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
458 коммитов 15 Ветки 0 Теги 1,7 MiB
Граф коммитов

80 Коммитов

Автор SHA1 Сообщение Дата
Gene Hazan 0ac110780f
Add rootRequest in metadata (#172) 2019-09-30 13:20:25 -07:00
Matt Gaunt bc4260f9d4 Adding support for google cloud storage as a storage provider 2018-06-13 14:02:09 -07:00
Gene Hazan cf61ceed03 Queue issue requests for pull request events 2017-11-22 09:58:57 -08:00
Gene Hazan 8ee2964496 Filter out traffic requests 2017-08-14 14:49:41 -07:00
Gene Hazan c830f0751d Code review changes 2017-06-08 09:23:17 -07:00
Gene Hazan 2c87136362 Code review changes 2017-06-07 14:14:26 -07:00
Gene Hazan 2d15805828 Add PR commit & commit comments types. Process synchronize PullRequestEvent. 2017-06-02 14:29:31 -07:00
Gene Hazan b194c5d2e6 Update PushEvent's commits href 2017-05-03 21:47:27 -07:00
Gene Hazan 342a08a07a Code review 2017-05-03 15:41:09 -07:00
Gene Hazan bfee4144ed Add handling of PushEvent commits. 2017-05-03 13:56:52 -07:00
Gene Hazan 340de3feda Update test 2017-04-17 11:25:24 -07:00
Gene Hazan 451ffd044c Delay if attemptCount is present 2017-04-17 10:40:29 -07:00
Jeff McAffer c9b166bdaf Merge pull request #82 from Microsoft/jm/eventFinder 
remove obsolete eventFinder
 2017-04-11 20:02:08 -07:00
Jeff McAffer 8858197a0b uniquify the request event_trigger request url 2017-04-11 10:27:08 -07:00
Jeff McAffer ce03280b48 remove obsolete eventFinder 2017-04-11 10:08:51 -07:00
Gene Hazan 5b3e76ed9e Remove console.log from test 2017-04-07 17:02:00 -07:00
Gene Hazan 214ca4bd2e Added tests. Corrected url for events invisible in the timeline. Corrected MembershipEvent. 2017-04-07 16:56:02 -07:00
Gene Hazan de09c0314e Merge remote-tracking branch 'origin/develop' into jm/fixTest 2017-04-07 13:21:04 -07:00
Gene Hazan 2851389fa6 Gh/deleted entities (#74) 
* Initial changes for deleted entities support. Correct repo test.

* Add tests

* Do not queue certain events in case of deletion

* Add placeholders for handling relation changes

* Relation handling for team and member events

* Initial code review

* update deletion handling and repo test

* Correct indentation

* Process repository only if TeamEvent contains repository payload

* Correct TeamEvent & deletion tests

* Try queueing repo for MemberEvent's added action which does not contain repository in the payload

* Decrease qlimit for one time job.

* Add history. Capture removed MemberEvent.

* Added storage count script. Added token arg.

* Final corrections

* Correct tests

* Add test

* More tweaks

* Mark review_comment deleted - could be via PullRequestReviewCommentEvent

* Add OrgBlockEvent

* Code cleanup

* Remove duplicate functions

* Crawl a repo when it is first created.

* Update MemberEvent handling

* Crawl team when it is first created

* Update fetch policy for relations.

* Correct linting warnings

* Correct merge

* Correct merge

* Move deleteAt marking out to crawler

* Correct context copying

* tweak processing outcome for delete

* Carry history through
 2017-04-07 11:34:16 -07:00
Jeff McAffer bc73b4bc16 Fix remaining tests 2017-04-06 16:51:00 -07:00
Jeff McAffer defd4f0da2 fix a mess of test errors 2017-04-06 15:53:11 -07:00
William Bartholomew 8a5626064a Add missing copyright headers and remove test file 2017-03-17 13:46:50 -07:00
William Bartholomew 42a7429546 First pass at MongoDB APIs to support deadletter 2017-03-14 16:16:09 -07:00
William Bartholomew ad884805d5 Use modules directly 2017-03-10 09:28:54 -08:00
William Bartholomew b6c3aa03ba Fix paths 2017-03-09 16:44:45 -08:00
William Bartholomew 7792bda60f Reorg unit tests 2017-03-09 16:29:43 -08:00
William Bartholomew 7393e7c7fe Merge ospo-ghcrawler into ghcrawler 2017-03-09 16:22:33 -08:00
Jeff McAffer 854ce52044 handle legacy PR comment events 2017-03-09 14:48:52 -08:00
Jeff McAffer 8c83604d18 pr commit back to relation with shared commits 2017-02-06 22:57:50 -08:00
Jeff McAffer 844c896222 update pull request tests 2017-02-06 13:11:14 -08:00
Jeff McAffer 625dca4736 fix missing stargazers 2017-01-31 21:04:48 -08:00
Jeff McAffer 9346f6ca65 update tests and fix couple bugs 2017-01-31 20:52:06 -08:00
Jeff McAffer 8a3e07fd68 revamp traversal so to use maps 2017-01-20 17:49:25 -08:00
Jeff McAffer c37381246c update tests and commit processing 2017-01-13 10:23:25 -08:00
Jeff McAffer bb80ed725b tweaks to new policy and tests 2017-01-10 23:20:53 -08:00
Jeff McAffer 5cde7a3708 first cut refactor for new transitivity model 2017-01-09 21:24:02 -08:00
Jeff McAffer 0d0160a9f9 ondemand promises property on request 2017-01-02 11:42:52 -08:00
Jeff McAffer 6966e8e41c update for _emitter change 2016-12-29 16:53:09 -08:00
Jeff McAffer 1717718490 open source cleanup: copyrights, stale files, ... 2016-12-29 14:58:25 -08:00
Jeff McAffer 2c0b1f6617 fix up tests 2016-12-27 09:26:38 -08:00
Jeff McAffer 184328c52b improve error handling 2016-12-26 08:47:57 -08:00
Jeff McAffer 0c0d776b0f update payload mechanism 2016-12-21 14:55:51 -08:00
Jeff McAffer 67b5ff59a2 fix tests 2016-12-20 23:44:35 -08:00
Jeff McAffer 27455a7c2c change originQueue to be a named "retryQueue" 2016-12-19 13:04:46 -08:00
Jeff McAffer 0f0acd68a3 change org and team members urn 2016-12-19 10:02:41 -08:00
Jeff McAffer 3024ce00b2 add scads more events, entities and tests 2016-12-18 11:12:26 -08:00
Jeff McAffer 6ac1618901 update tests 2016-12-16 17:05:50 -08:00
Jeff McAffer b74f65bbb7 integrate event processing into crawler itself 2016-12-16 10:26:19 -08:00
Jeff McAffer b202263f50 processing tests and small fixes 2016-12-14 22:54:10 -08:00
Jeff McAffer 7d0b6abd28 add pull request support 2016-12-13 23:39:33 -08:00