englehardt
11b33d59bf
trimming garbage from merge
2014-05-27 13:51:55 -04:00
englehardt
04d6d01246
Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev
...
Conflicts:
automation/BrowserManager.py
automation/Commands/browser_commands.py
automation/DataAggregator/DataAggregator.py
automation/DeployBrowsers/deploy_firefox.py
run_simple_crawl.py
2014-05-27 13:45:16 -04:00
Christian
33f4663bd6
Improving code style issues
2014-05-26 17:40:40 -04:00
Christian
6141778929
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
2014-05-26 16:07:51 -04:00
Christian
b732adac19
Removing FourthParty support, pt. 2/2
2014-05-26 16:07:39 -04:00
Pete Zimmerman
1c47a0facd
Update browser_commands.py
2014-05-26 15:58:40 -04:00
Christian
d9c14d3ae3
Removing FourthParty support, pt. 1/2
2014-05-26 15:32:55 -04:00
cgeubank
16534927db
Deleting census from master branch
2014-05-23 13:47:09 -04:00
englehardt
b91a9e5d02
Bugfix! Browser spawn timeout lowered to avoid long blocks during
...
multiprocessing.
2014-05-22 10:31:43 -04:00
englehardt
b1af375706
bumped default commit loop to 1000 given the previous two fixes
2014-05-22 10:29:40 -04:00
englehardt
8a8472e28d
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
2014-05-22 10:25:12 -04:00
englehardt
97172b312b
Bugfix! Commits are now forced every 5 seconds to avoid locking access
...
to the db for too long. Required for multiprocessing.
2014-05-22 10:24:03 -04:00
Christian
3592179281
Added first party support to measurment scripts
2014-05-14 02:51:20 -04:00
englehardt
1481da0e15
Bugfix: DataAggregator now drains socket queue before closing. Subject
...
to #8
2014-05-12 22:17:02 -04:00
englehardt
d964cda343
Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
...
Conflicts:
run_simple_crawl.py
run_storage_crawl.py
2014-05-12 06:01:43 +00:00
englehardt
d6ea6e04ec
DNT
2014-05-12 06:00:22 +00:00
englehardt
b35a3d121e
Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors
...
Conflicts:
run_simple_crawl.py
2014-05-12 05:56:14 +00:00
Christian
b2a0821e63
Add graph sync + respawn link
2014-05-11 03:08:43 -04:00
Christian
6c1d1e8a92
Added respawn detection script
2014-05-08 22:52:16 -04:00
Christian
86ce53a241
Undoing merge from class project
2014-05-08 13:20:36 -04:00
englehardt
cd6c1ccaa6
fourthparty placed under proxy if by accident
2014-05-07 20:56:52 +00:00
englehardt
70e22adc7c
Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors
...
Conflicts:
run_simple_crawl.py
2014-05-07 20:45:56 +00:00
wathsalav
82a72db2aa
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
2014-05-06 23:46:44 -04:00
englehardt
a640c831bb
Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
...
Conflicts:
run_storage_crawl.py
2014-05-07 03:16:03 +00:00
englehardt
09e843de1f
fingerprint crawls
2014-05-07 02:54:42 +00:00
englehardt
cc054c77fc
3k crawl setup
2014-05-07 02:14:40 +00:00
Christian
e9e9b05a31
Added degrees of separation to cookie sync analysis
2014-05-05 23:36:57 -04:00
Christian
f33886e108
Added DNT and third party support to crawler
2014-05-03 21:02:16 -04:00
wathsala
5dc0157115
Adding URLFilter
2014-05-03 09:30:47 -04:00
englehardt
e7cbda76ab
Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
2014-05-03 06:09:42 +00:00
englehardt
4ddc9fb94b
update to no longer require webdriver
2014-05-03 06:08:55 +00:00
englehardt
f808e52067
update BrowserManager to new dump API
2014-05-03 06:07:35 +00:00
englehardt
2b121321f8
remove print debug statement from flash cookie parsing
2014-05-03 06:00:26 +00:00
englehardt
8118516143
Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
2014-05-03 05:46:30 +00:00
englehardt
ffbd848748
merging
2014-05-03 05:46:11 +00:00
englehardt
c610edd95f
adding 100 site test crawl
2014-05-03 01:41:45 -04:00
englehardt
6368ffd2d5
Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
...
Conflicts:
automation/Commands/browser_commands.py
2014-05-03 01:29:23 -04:00
englehardt
2e1214b6ee
Bugfixes + updates
2014-05-03 05:27:01 +00:00
englehardt
23fe542e61
Added sqlite checkpointing at end + hopefully bugfix for indexedDB
2014-05-03 01:22:45 -04:00
Christian
22573b6e40
Added first set of ccs analysis scripts
2014-05-02 22:56:31 -04:00
englehardt
60fb97f3c2
Merge branch 'master' into storage_vectors
...
Conflicts:
automation/Commands/browser_commands.py
automation/DeployBrowsers/deploy_firefox.py
2014-05-02 16:00:37 -04:00
englehardt
ab516d399d
Added in support for reading flash and cookies between each visit
2014-05-02 15:56:11 -04:00
Christian
723c478027
Added domain flagging for request cookies
2014-05-02 02:29:12 -04:00
englehardt
667103543c
Bugfix + support for closing tab after each page load
2014-05-02 00:15:07 -04:00
Christian
ae4ecd4b9d
Log request cookies and additional responses
2014-05-01 23:40:03 -04:00
Christian
a39ef2d281
Updated ccs utils and cleaned out dummy main functions
2014-05-01 22:39:13 -04:00
Christian
6e423756e0
Added script that determines who knows which ids
2014-05-01 22:31:20 -04:00
englehardt
05ac51cebd
Bugfix!! Properly set and handle selenium internal timeouts.
...
This fixes the subtle problem where we would randomly see some sites
report a successful load without actually unblocking. This was caused
by improper handling of an internal selenium timeout.
2014-05-01 19:56:30 -04:00
Christian
3e62ea4e95
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
2014-05-01 19:28:31 -04:00
Christian
9363d7c190
Porting cookie id code to meet CCS questions
2014-05-01 19:28:12 -04:00