Граф коммитов

1624 Коммитов

Автор SHA1 Сообщение Дата
englehardt 11b33d59bf trimming garbage from merge 2014-05-27 13:51:55 -04:00
englehardt 04d6d01246 Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev
Conflicts:
	automation/BrowserManager.py
	automation/Commands/browser_commands.py
	automation/DataAggregator/DataAggregator.py
	automation/DeployBrowsers/deploy_firefox.py
	run_simple_crawl.py
2014-05-27 13:45:16 -04:00
Christian 33f4663bd6 Improving code style issues 2014-05-26 17:40:40 -04:00
Christian 6141778929 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-26 16:07:51 -04:00
Christian b732adac19 Removing FourthParty support, pt. 2/2 2014-05-26 16:07:39 -04:00
Pete Zimmerman 1c47a0facd Update browser_commands.py 2014-05-26 15:58:40 -04:00
Christian d9c14d3ae3 Removing FourthParty support, pt. 1/2 2014-05-26 15:32:55 -04:00
cgeubank 16534927db Deleting census from master branch 2014-05-23 13:47:09 -04:00
englehardt b91a9e5d02 Bugfix! Browser spawn timeout lowered to avoid long blocks during
multiprocessing.
2014-05-22 10:31:43 -04:00
englehardt b1af375706 bumped default commit loop to 1000 given the previous two fixes 2014-05-22 10:29:40 -04:00
englehardt 8a8472e28d Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-22 10:25:12 -04:00
englehardt 97172b312b Bugfix! Commits are now forced every 5 seconds to avoid locking access
to the db for too long. Required for multiprocessing.
2014-05-22 10:24:03 -04:00
Christian 3592179281 Added first party support to measurment scripts 2014-05-14 02:51:20 -04:00
englehardt 1481da0e15 Bugfix: DataAggregator now drains socket queue before closing. Subject
to #8
2014-05-12 22:17:02 -04:00
englehardt d964cda343 Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
	run_simple_crawl.py
	run_storage_crawl.py
2014-05-12 06:01:43 +00:00
englehardt d6ea6e04ec DNT 2014-05-12 06:00:22 +00:00
englehardt b35a3d121e Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
	run_simple_crawl.py
2014-05-12 05:56:14 +00:00
Christian b2a0821e63 Add graph sync + respawn link 2014-05-11 03:08:43 -04:00
Christian 6c1d1e8a92 Added respawn detection script 2014-05-08 22:52:16 -04:00
Christian 86ce53a241 Undoing merge from class project 2014-05-08 13:20:36 -04:00
englehardt cd6c1ccaa6 fourthparty placed under proxy if by accident 2014-05-07 20:56:52 +00:00
englehardt 70e22adc7c Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
	run_simple_crawl.py
2014-05-07 20:45:56 +00:00
wathsalav 82a72db2aa Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-06 23:46:44 -04:00
englehardt a640c831bb Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
	run_storage_crawl.py
2014-05-07 03:16:03 +00:00
englehardt 09e843de1f fingerprint crawls 2014-05-07 02:54:42 +00:00
englehardt cc054c77fc 3k crawl setup 2014-05-07 02:14:40 +00:00
Christian e9e9b05a31 Added degrees of separation to cookie sync analysis 2014-05-05 23:36:57 -04:00
Christian f33886e108 Added DNT and third party support to crawler 2014-05-03 21:02:16 -04:00
wathsala 5dc0157115 Adding URLFilter 2014-05-03 09:30:47 -04:00
englehardt e7cbda76ab Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors 2014-05-03 06:09:42 +00:00
englehardt 4ddc9fb94b update to no longer require webdriver 2014-05-03 06:08:55 +00:00
englehardt f808e52067 update BrowserManager to new dump API 2014-05-03 06:07:35 +00:00
englehardt 2b121321f8 remove print debug statement from flash cookie parsing 2014-05-03 06:00:26 +00:00
englehardt 8118516143 Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors 2014-05-03 05:46:30 +00:00
englehardt ffbd848748 merging 2014-05-03 05:46:11 +00:00
englehardt c610edd95f adding 100 site test crawl 2014-05-03 01:41:45 -04:00
englehardt 6368ffd2d5 Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
	automation/Commands/browser_commands.py
2014-05-03 01:29:23 -04:00
englehardt 2e1214b6ee Bugfixes + updates 2014-05-03 05:27:01 +00:00
englehardt 23fe542e61 Added sqlite checkpointing at end + hopefully bugfix for indexedDB 2014-05-03 01:22:45 -04:00
Christian 22573b6e40 Added first set of ccs analysis scripts 2014-05-02 22:56:31 -04:00
englehardt 60fb97f3c2 Merge branch 'master' into storage_vectors
Conflicts:
	automation/Commands/browser_commands.py
	automation/DeployBrowsers/deploy_firefox.py
2014-05-02 16:00:37 -04:00
englehardt ab516d399d Added in support for reading flash and cookies between each visit 2014-05-02 15:56:11 -04:00
Christian 723c478027 Added domain flagging for request cookies 2014-05-02 02:29:12 -04:00
englehardt 667103543c Bugfix + support for closing tab after each page load 2014-05-02 00:15:07 -04:00
Christian ae4ecd4b9d Log request cookies and additional responses 2014-05-01 23:40:03 -04:00
Christian a39ef2d281 Updated ccs utils and cleaned out dummy main functions 2014-05-01 22:39:13 -04:00
Christian 6e423756e0 Added script that determines who knows which ids 2014-05-01 22:31:20 -04:00
englehardt 05ac51cebd Bugfix!! Properly set and handle selenium internal timeouts.
This fixes the subtle problem where we would randomly see some sites
report a successful load without actually unblocking. This was caused
by improper handling of an internal selenium timeout.
2014-05-01 19:56:30 -04:00
Christian 3e62ea4e95 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-01 19:28:31 -04:00
Christian 9363d7c190 Porting cookie id code to meet CCS questions 2014-05-01 19:28:12 -04:00