Граф коммитов

197 Коммитов

Автор SHA1 Сообщение Дата
englehardt 5b8f779b42 Check if flash exists before trying to load. Skip if not 2014-06-06 14:42:16 -04:00
englehardt 1b358d18ee Updated threads to daemon threads to prevent hanging on crash/interrupt 2014-06-05 13:38:47 -04:00
englehardt b6fe171d47 Added native support for flash loading/saving. Bugfixes in
run_simple_crawl.py
2014-06-04 21:44:24 -04:00
Arvind Narayanan 2e025716f1 typo 2014-06-02 13:40:41 -04:00
cgeubank 98c8cfe5da Pulled out sleep constants; copied over OpenWPM description from site 2014-06-01 21:20:07 -04:00
englehardt 0810c3ba5f Updates bot detection mitigation to close issue #9 2014-06-01 17:21:04 -04:00
Christian a77d149194 Updated style and inline comments 2014-05-30 10:42:32 -04:00
Christian c43dbd0ac5 Updated style and inline comments 2014-05-29 16:57:45 -04:00
Christian 6d6ba9cb40 Moving tab-restart logic to make more portable gets 2014-05-29 15:33:34 -04:00
Christian ff40bba2f1 Made bot mitigation optional; simplified executor a bit 2014-05-29 13:11:01 -04:00
Christian 6125108cb3 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-29 01:40:14 -04:00
Christian 81f15471b3 Added TLD support for http traffic 2014-05-29 01:39:52 -04:00
englehardt 9650d19ecd Bugfix! browser.reset() properly resets profile variable 2014-05-28 21:36:39 -04:00
Christian 1cd8a30c2b Adds Task Manager support for deep copying single input dictionary 2014-05-28 20:50:58 -04:00
englehardt 161d456dab Adding in utilities from crawler classic 2014-05-28 20:05:23 -04:00
englehardt 1aa4b0b232 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-28 17:26:26 -04:00
Christian f38943794c Moving API to dictionary-based approach 2014-05-28 13:10:12 -04:00
Christian a66d4d1576 Merging crawl DB parameters 2014-05-27 17:11:36 -04:00
englehardt f7b084f5a0 Changing storage vector schema to make it less confusing 2014-05-27 15:55:08 -04:00
Christian 435e52cfc1 Fixed bug in run simple crawl and removed JS timeout from Ffx 2014-05-27 15:54:34 -04:00
englehardt de5264c77b removing news-specific code from master 2014-05-27 15:52:17 -04:00
englehardt 6736997241 Bugfix: Error handling for bot detection mitigation 2014-05-27 15:25:21 -04:00
englehardt afda9ceee0 removed extra code, adding note about Leuven 2014-05-27 14:31:53 -04:00
englehardt 11b33d59bf trimming garbage from merge 2014-05-27 13:51:55 -04:00
englehardt 04d6d01246 Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev
Conflicts:
	automation/BrowserManager.py
	automation/Commands/browser_commands.py
	automation/DataAggregator/DataAggregator.py
	automation/DeployBrowsers/deploy_firefox.py
	run_simple_crawl.py
2014-05-27 13:45:16 -04:00
Christian 33f4663bd6 Improving code style issues 2014-05-26 17:40:40 -04:00
Christian 6141778929 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-26 16:07:51 -04:00
Christian b732adac19 Removing FourthParty support, pt. 2/2 2014-05-26 16:07:39 -04:00
Pete Zimmerman 1c47a0facd Update browser_commands.py 2014-05-26 15:58:40 -04:00
Christian d9c14d3ae3 Removing FourthParty support, pt. 1/2 2014-05-26 15:32:55 -04:00
cgeubank 16534927db Deleting census from master branch 2014-05-23 13:47:09 -04:00
englehardt b91a9e5d02 Bugfix! Browser spawn timeout lowered to avoid long blocks during
multiprocessing.
2014-05-22 10:31:43 -04:00
englehardt b1af375706 bumped default commit loop to 1000 given the previous two fixes 2014-05-22 10:29:40 -04:00
englehardt 8a8472e28d Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-22 10:25:12 -04:00
englehardt 97172b312b Bugfix! Commits are now forced every 5 seconds to avoid locking access
to the db for too long. Required for multiprocessing.
2014-05-22 10:24:03 -04:00
Christian 3592179281 Added first party support to measurment scripts 2014-05-14 02:51:20 -04:00
englehardt 1481da0e15 Bugfix: DataAggregator now drains socket queue before closing. Subject
to #8
2014-05-12 22:17:02 -04:00
englehardt d964cda343 Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
	run_simple_crawl.py
	run_storage_crawl.py
2014-05-12 06:01:43 +00:00
englehardt d6ea6e04ec DNT 2014-05-12 06:00:22 +00:00
englehardt b35a3d121e Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
	run_simple_crawl.py
2014-05-12 05:56:14 +00:00
Christian b2a0821e63 Add graph sync + respawn link 2014-05-11 03:08:43 -04:00
Christian 6c1d1e8a92 Added respawn detection script 2014-05-08 22:52:16 -04:00
Christian 86ce53a241 Undoing merge from class project 2014-05-08 13:20:36 -04:00
englehardt cd6c1ccaa6 fourthparty placed under proxy if by accident 2014-05-07 20:56:52 +00:00
englehardt 70e22adc7c Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
	run_simple_crawl.py
2014-05-07 20:45:56 +00:00
wathsalav 82a72db2aa Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-06 23:46:44 -04:00
englehardt a640c831bb Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
	run_storage_crawl.py
2014-05-07 03:16:03 +00:00
englehardt 09e843de1f fingerprint crawls 2014-05-07 02:54:42 +00:00
englehardt cc054c77fc 3k crawl setup 2014-05-07 02:14:40 +00:00
Christian e9e9b05a31 Added degrees of separation to cookie sync analysis 2014-05-05 23:36:57 -04:00