microsoft
/
mwt-ds
зеркало из https://github.com/microsoft/mwt-ds.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
4 871 коммит 74 Ветки 0 Теги 110 MiB
Граф коммитов

28 Коммитов

Автор SHA1 Сообщение Дата
Jacob Alber 1cdf062154 Silence ServerProtocolViolation errors 
In the last change, we added more tracing to ServerProtocolViolation WebExceptions in the Crawler. Unfortunately, the ones we are seeing aren't triggering this code because they do not get far enough to get a Response object. I don't expect that we will be able to get useful information from this telemetry, so add this to the set of dependency failures we silently ignore, after adding a trace.
 2017-10-11 10:07:33 -04:00
Jacob Alber 139a42521a Switch to using Dictionary initializer, and add check for SupportsHeaders 2017-10-06 13:20:08 -04:00
Jacob Alber 6bf6201cad Add tracing for ServerProtocolViolation errors 2017-10-06 11:37:05 -04:00
Jacob Alber bf9fccafdd Add 404 and 503 to targeted exclusions from hard failure at Download stage of Crawl 2017-10-06 11:05:32 -04:00
Jacob Alber a8874661f7 Fix style: Use built-in keyword for string static method calls 2017-10-04 10:21:13 -04:00
Jacob Alber 9d1ea67f17 Fix ArgumentNullException when VideoIndexer knows about a video, but cannot get data about it 
Also avoid queueing indexing when the video URL is not a valid URL.
 2017-10-03 17:26:39 -04:00
Markus Cozowicz e25a055fbf fixed warnings 2017-09-18 15:08:41 -04:00
Markus Cozowicz f95b515d94 fixed JSON feature pass through 2017-09-14 12:44:18 -04:00
Markus Cozowicz dbb9b809a9 fix feature serialization 2017-09-14 07:29:53 -04:00
Markus Cozowicz ccc82d72de added keywords as features 2017-09-13 23:03:30 -04:00
Markus Cozowicz e13b97d62a support empty content-type 2017-09-12 21:22:54 -04:00
Markus Cozowicz de5bdb60f5 improve logging; prepare locking for VI 2017-09-11 12:04:42 -04:00
Markus Cozowicz 1b571a17d3 avoid dup indexing 2017-08-11 15:24:35 -04:00
Markus Cozowicz 5ff298e672 include title when video indexing 2017-08-11 14:26:39 -04:00
Markus Cozowicz aedcbbaf37 fix nre 2017-08-11 13:24:46 -04:00
Markus Cozowicz d44a9e3028 fix nre 2017-08-11 12:02:37 -04:00
Markus Cozowicz 2e66df4524 fixed ooyala nre 2017-08-11 11:25:53 -04:00
Markus Cozowicz d9e3109e73 added video/audio/json support 2017-08-11 10:42:29 -04:00
Markus Cozowicz f0c24a1de9 added VideoIndexer/Ooyala integration 2017-08-10 13:06:11 -04:00
Markus Cozowicz 523f793592 fixed text analytics path 2017-07-12 15:34:22 -04:00
Markus Cozowicz 48b195dd12 fixedCogSerivce paths 2017-07-12 15:14:28 -04:00
Markus Cozowicz 1063e0dcc4 fixed User Agent crawl retry 2017-07-12 12:48:29 -04:00
Markus Cozowicz 13e37ab62e added User-Agent retry to overcome access denied. 
added RSS parameter support
 2017-07-12 11:38:32 -04:00
Markus Cozowicz 2cb2f67202 redirect nuget packages folder to solution dir 2017-05-30 09:13:10 -04:00
Markus Cozowicz b3ed41ee2e fixed build break 
added fallback to local settings if KeyVaultUrl is not provided
 2017-05-27 11:32:18 -04:00
Markus Cozowicz 079d3155e5 fixed compile error 2017-05-26 21:39:23 -04:00
Markus Cozowicz 87623708ed added crawl solution 
switch to proper APPINSIGHTS_KEY
 2017-05-26 21:38:45 -04:00
Markus Cozowicz d120c132c9 added DecisionService HTML scrape 2017-05-26 21:04:02 -04:00