englehardt
|
5b8f779b42
|
Check if flash exists before trying to load. Skip if not
|
2014-06-06 14:42:16 -04:00 |
englehardt
|
1b358d18ee
|
Updated threads to daemon threads to prevent hanging on crash/interrupt
|
2014-06-05 13:38:47 -04:00 |
englehardt
|
b6fe171d47
|
Added native support for flash loading/saving. Bugfixes in
run_simple_crawl.py
|
2014-06-04 21:44:24 -04:00 |
Arvind Narayanan
|
2e025716f1
|
typo
|
2014-06-02 13:40:41 -04:00 |
cgeubank
|
98c8cfe5da
|
Pulled out sleep constants; copied over OpenWPM description from site
|
2014-06-01 21:20:07 -04:00 |
englehardt
|
0810c3ba5f
|
Updates bot detection mitigation to close issue #9
|
2014-06-01 17:21:04 -04:00 |
Christian
|
a77d149194
|
Updated style and inline comments
|
2014-05-30 10:42:32 -04:00 |
Christian
|
c43dbd0ac5
|
Updated style and inline comments
|
2014-05-29 16:57:45 -04:00 |
Christian
|
6d6ba9cb40
|
Moving tab-restart logic to make more portable gets
|
2014-05-29 15:33:34 -04:00 |
Christian
|
ff40bba2f1
|
Made bot mitigation optional; simplified executor a bit
|
2014-05-29 13:11:01 -04:00 |
Christian
|
6125108cb3
|
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
|
2014-05-29 01:40:14 -04:00 |
Christian
|
81f15471b3
|
Added TLD support for http traffic
|
2014-05-29 01:39:52 -04:00 |
englehardt
|
9650d19ecd
|
Bugfix! browser.reset() properly resets profile variable
|
2014-05-28 21:36:39 -04:00 |
Christian
|
1cd8a30c2b
|
Adds Task Manager support for deep copying single input dictionary
|
2014-05-28 20:50:58 -04:00 |
englehardt
|
161d456dab
|
Adding in utilities from crawler classic
|
2014-05-28 20:05:23 -04:00 |
englehardt
|
1aa4b0b232
|
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
|
2014-05-28 17:26:26 -04:00 |
Christian
|
f38943794c
|
Moving API to dictionary-based approach
|
2014-05-28 13:10:12 -04:00 |
Christian
|
a66d4d1576
|
Merging crawl DB parameters
|
2014-05-27 17:11:36 -04:00 |
englehardt
|
f7b084f5a0
|
Changing storage vector schema to make it less confusing
|
2014-05-27 15:55:08 -04:00 |
Christian
|
435e52cfc1
|
Fixed bug in run simple crawl and removed JS timeout from Ffx
|
2014-05-27 15:54:34 -04:00 |
englehardt
|
de5264c77b
|
removing news-specific code from master
|
2014-05-27 15:52:17 -04:00 |
englehardt
|
6736997241
|
Bugfix: Error handling for bot detection mitigation
|
2014-05-27 15:25:21 -04:00 |
englehardt
|
afda9ceee0
|
removed extra code, adding note about Leuven
|
2014-05-27 14:31:53 -04:00 |
englehardt
|
11b33d59bf
|
trimming garbage from merge
|
2014-05-27 13:51:55 -04:00 |
englehardt
|
04d6d01246
|
Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev
Conflicts:
automation/BrowserManager.py
automation/Commands/browser_commands.py
automation/DataAggregator/DataAggregator.py
automation/DeployBrowsers/deploy_firefox.py
run_simple_crawl.py
|
2014-05-27 13:45:16 -04:00 |
Christian
|
33f4663bd6
|
Improving code style issues
|
2014-05-26 17:40:40 -04:00 |
Christian
|
6141778929
|
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
|
2014-05-26 16:07:51 -04:00 |
Christian
|
b732adac19
|
Removing FourthParty support, pt. 2/2
|
2014-05-26 16:07:39 -04:00 |
Pete Zimmerman
|
1c47a0facd
|
Update browser_commands.py
|
2014-05-26 15:58:40 -04:00 |
Christian
|
d9c14d3ae3
|
Removing FourthParty support, pt. 1/2
|
2014-05-26 15:32:55 -04:00 |
cgeubank
|
16534927db
|
Deleting census from master branch
|
2014-05-23 13:47:09 -04:00 |
englehardt
|
b91a9e5d02
|
Bugfix! Browser spawn timeout lowered to avoid long blocks during
multiprocessing.
|
2014-05-22 10:31:43 -04:00 |
englehardt
|
b1af375706
|
bumped default commit loop to 1000 given the previous two fixes
|
2014-05-22 10:29:40 -04:00 |
englehardt
|
8a8472e28d
|
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
|
2014-05-22 10:25:12 -04:00 |
englehardt
|
97172b312b
|
Bugfix! Commits are now forced every 5 seconds to avoid locking access
to the db for too long. Required for multiprocessing.
|
2014-05-22 10:24:03 -04:00 |
Christian
|
3592179281
|
Added first party support to measurment scripts
|
2014-05-14 02:51:20 -04:00 |
englehardt
|
1481da0e15
|
Bugfix: DataAggregator now drains socket queue before closing. Subject
to #8
|
2014-05-12 22:17:02 -04:00 |
englehardt
|
d964cda343
|
Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
run_simple_crawl.py
run_storage_crawl.py
|
2014-05-12 06:01:43 +00:00 |
englehardt
|
d6ea6e04ec
|
DNT
|
2014-05-12 06:00:22 +00:00 |
englehardt
|
b35a3d121e
|
Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
run_simple_crawl.py
|
2014-05-12 05:56:14 +00:00 |
Christian
|
b2a0821e63
|
Add graph sync + respawn link
|
2014-05-11 03:08:43 -04:00 |
Christian
|
6c1d1e8a92
|
Added respawn detection script
|
2014-05-08 22:52:16 -04:00 |
Christian
|
86ce53a241
|
Undoing merge from class project
|
2014-05-08 13:20:36 -04:00 |
englehardt
|
cd6c1ccaa6
|
fourthparty placed under proxy if by accident
|
2014-05-07 20:56:52 +00:00 |
englehardt
|
70e22adc7c
|
Merge branch 'master' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
run_simple_crawl.py
|
2014-05-07 20:45:56 +00:00 |
wathsalav
|
82a72db2aa
|
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
|
2014-05-06 23:46:44 -04:00 |
englehardt
|
a640c831bb
|
Merge branch 'storage_vectors' of https://github.com/citp/OpenWPM-dev into storage_vectors
Conflicts:
run_storage_crawl.py
|
2014-05-07 03:16:03 +00:00 |
englehardt
|
09e843de1f
|
fingerprint crawls
|
2014-05-07 02:54:42 +00:00 |
englehardt
|
cc054c77fc
|
3k crawl setup
|
2014-05-07 02:14:40 +00:00 |
Christian
|
e9e9b05a31
|
Added degrees of separation to cookie sync analysis
|
2014-05-05 23:36:57 -04:00 |