mozilla
/
OpenWPM
зеркало из https://github.com/openwpm/OpenWPM.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
2 088 коммитов 18 Ветки 47 Теги 138 MiB
Граф коммитов

2088 Коммитов

Автор SHA1 Сообщение Дата
Christian ff40bba2f1 Made bot mitigation optional; simplified executor a bit 2014-05-29 13:11:01 -04:00
Christian 6125108cb3 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-29 01:40:14 -04:00
Christian 81f15471b3 Added TLD support for http traffic 2014-05-29 01:39:52 -04:00
englehardt 9650d19ecd Bugfix! browser.reset() properly resets profile variable 2014-05-28 21:36:39 -04:00
Christian 1cd8a30c2b Adds Task Manager support for deep copying single input dictionary 2014-05-28 20:50:58 -04:00
englehardt 161d456dab Adding in utilities from crawler classic 2014-05-28 20:05:23 -04:00
englehardt 1aa4b0b232 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-28 17:26:26 -04:00
Christian f38943794c Moving API to dictionary-based approach 2014-05-28 13:10:12 -04:00
Christian a66d4d1576 Merging crawl DB parameters 2014-05-27 17:11:36 -04:00
englehardt f7b084f5a0 Changing storage vector schema to make it less confusing 2014-05-27 15:55:08 -04:00
Christian 435e52cfc1 Fixed bug in run simple crawl and removed JS timeout from Ffx 2014-05-27 15:54:34 -04:00
englehardt de5264c77b removing news-specific code from master 2014-05-27 15:52:17 -04:00
englehardt 6736997241 Bugfix: Error handling for bot detection mitigation 2014-05-27 15:25:21 -04:00
englehardt afda9ceee0 removed extra code, adding note about Leuven 2014-05-27 14:31:53 -04:00
englehardt 11b33d59bf trimming garbage from merge 2014-05-27 13:51:55 -04:00
englehardt 04d6d01246 Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev 
Conflicts:
	automation/BrowserManager.py
	automation/Commands/browser_commands.py
	automation/DataAggregator/DataAggregator.py
	automation/DeployBrowsers/deploy_firefox.py
	run_simple_crawl.py
 2014-05-27 13:45:16 -04:00
Christian 33f4663bd6 Improving code style issues 2014-05-26 17:40:40 -04:00
Christian 6141778929 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-26 16:07:51 -04:00
Christian b732adac19 Removing FourthParty support, pt. 2/2 2014-05-26 16:07:39 -04:00
Pete Zimmerman 1c47a0facd Update browser_commands.py 2014-05-26 15:58:40 -04:00
Christian d9c14d3ae3 Removing FourthParty support, pt. 1/2 2014-05-26 15:32:55 -04:00
cgeubank 16534927db Deleting census from master branch 2014-05-23 13:47:09 -04:00
englehardt b91a9e5d02 Bugfix! Browser spawn timeout lowered to avoid long blocks during 
multiprocessing.
 2014-05-22 10:31:43 -04:00
englehardt b1af375706 bumped default commit loop to 1000 given the previous two fixes 2014-05-22 10:29:40 -04:00
englehardt 8a8472e28d Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-22 10:25:12 -04:00
englehardt 97172b312b Bugfix! Commits are now forced every 5 seconds to avoid locking access 
to the db for too long. Required for multiprocessing.
 2014-05-22 10:24:03 -04:00
Christian 3592179281 Added first party support to measurment scripts 2014-05-14 02:51:20 -04:00
englehardt 1481da0e15 Bugfix: DataAggregator now drains socket queue before closing. Subject 
to #8
 2014-05-12 22:17:02 -04:00
englehardt d964cda343 Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors 
Conflicts:
	run_simple_crawl.py
	run_storage_crawl.py
 2014-05-12 06:01:43 +00:00
englehardt d6ea6e04ec DNT 2014-05-12 06:00:22 +00:00
englehardt b35a3d121e Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors 
Conflicts:
	run_simple_crawl.py
 2014-05-12 05:56:14 +00:00
Christian b2a0821e63 Add graph sync + respawn link 2014-05-11 03:08:43 -04:00
Christian 6c1d1e8a92 Added respawn detection script 2014-05-08 22:52:16 -04:00
Christian 86ce53a241 Undoing merge from class project 2014-05-08 13:20:36 -04:00
englehardt cd6c1ccaa6 fourthparty placed under proxy if by accident 2014-05-07 20:56:52 +00:00
englehardt 70e22adc7c Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors 
Conflicts:
	run_simple_crawl.py
 2014-05-07 20:45:56 +00:00
wathsalav 82a72db2aa Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-06 23:46:44 -04:00
englehardt a640c831bb Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors 
Conflicts:
	run_storage_crawl.py
 2014-05-07 03:16:03 +00:00
englehardt 09e843de1f fingerprint crawls 2014-05-07 02:54:42 +00:00
englehardt cc054c77fc 3k crawl setup 2014-05-07 02:14:40 +00:00
Christian e9e9b05a31 Added degrees of separation to cookie sync analysis 2014-05-05 23:36:57 -04:00
Christian f33886e108 Added DNT and third party support to crawler 2014-05-03 21:02:16 -04:00
wathsala 5dc0157115 Adding URLFilter 2014-05-03 09:30:47 -04:00
englehardt e7cbda76ab Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors 2014-05-03 06:09:42 +00:00
englehardt 4ddc9fb94b update to no longer require webdriver 2014-05-03 06:08:55 +00:00
englehardt f808e52067 update BrowserManager to new dump API 2014-05-03 06:07:35 +00:00
englehardt 2b121321f8 remove print debug statement from flash cookie parsing 2014-05-03 06:00:26 +00:00
englehardt 8118516143 Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors 2014-05-03 05:46:30 +00:00
englehardt ffbd848748 merging 2014-05-03 05:46:11 +00:00
englehardt c610edd95f adding 100 site test crawl 2014-05-03 01:41:45 -04:00