englehardt
|
77d49f9719
|
version bump + minor correction
|
2015-01-05 22:32:32 -05:00 |
englehardt
|
d16a03b22f
|
Merge branch 'vtoubiana-master' Closes #2
|
2015-01-05 22:25:17 -05:00 |
englehardt
|
02774ec03f
|
expose num_links to user
|
2015-01-05 22:23:17 -05:00 |
englehardt
|
51fbd568ed
|
remove duplicate code, tweaks to scroll timing, only click visible links
|
2015-01-05 22:15:49 -05:00 |
englehardt
|
bbcae27615
|
cleanup of changes, removed unneeded code, slight refactoring
|
2015-01-04 14:26:22 -05:00 |
Janos
|
01d935fdac
|
Merged master fixed conflict.
|
2015-01-02 16:18:43 +01:00 |
Janos
|
274628fa0e
|
Add feature to browse a site
|
2015-01-02 16:09:06 +01:00 |
englehardt
|
1fe205e872
|
Merge remote-tracking branch 'origin' into release
Conflicts:
VERSION
demo.py
|
2014-12-31 12:38:49 -05:00 |
Janos
|
4540aadbb1
|
Fix compatibility issues cause by libmproxy update from 0.10 to 0.11
|
2014-12-31 12:04:05 +01:00 |
englehardt
|
5fccd99a3c
|
cleanup + replace run_simple_crawl with demo.py
|
2014-12-30 19:13:05 -05:00 |
englehardt
|
c1e05a6e4b
|
Add support for browser reset after command execution + optimizations
|
2014-12-30 19:02:13 -05:00 |
englehardt
|
2d05288331
|
fixed duplicate cookies on multiple runs
|
2014-12-30 18:58:42 -05:00 |
englehardt
|
bf85a7797d
|
referer now working in HTTP response
|
2014-12-30 18:48:09 -05:00 |
englehardt
|
1a043ee35f
|
fixes for API changes in MITMProxy v0.11
|
2014-12-30 18:42:11 -05:00 |
englehardt
|
36739921cd
|
0.2.0
|
2014-08-12 18:51:15 -04:00 |
englehardt
|
705a1fd960
|
Merge branch 'master' into release
|
2014-08-12 18:49:21 -04:00 |
englehardt
|
8d8fa345ac
|
Adding post-processing pipeline + Fix #13
|
2014-08-12 18:46:18 -04:00 |
Paul Ellenbogen
|
3cc27701a8
|
Merge branch 'paul-fix-busywait'
|
2014-07-11 13:35:54 -04:00 |
englehardt
|
3889b21fd5
|
Merge pull request #12 from citp/paul-extract-links
Add a command for extracting links from a page.
|
2014-07-11 11:23:57 -04:00 |
Paul Ellenbogen
|
3945329088
|
Clean up reading from Queue in TaskManager.
Fixes #11
|
2014-07-10 17:10:43 -04:00 |
Paul Ellenbogen
|
d0138e1042
|
Add a command for extracting links from a page.
|
2014-07-10 15:35:43 -04:00 |
englehardt
|
c1449783de
|
0.1.1 release
|
2014-07-01 12:37:17 -04:00 |
englehardt
|
4ec45c1c38
|
Merge branch 'master', remote-tracking branch 'origin' into release
|
2014-07-01 12:34:48 -04:00 |
englehardt
|
db92602978
|
Added a method to load and copy default settings
|
2014-07-01 12:32:30 -04:00 |
englehardt
|
228e063084
|
Merge branch 'release', remote-tracking branch 'origin'
|
2014-06-10 14:13:45 -04:00 |
englehardt
|
e138bd4d1e
|
0.1.0 initial public release
|
2014-06-10 13:41:03 -04:00 |
englehardt
|
95fa9a69c5
|
Initial commit
|
2014-06-10 12:59:28 -04:00 |
englehardt
|
5b8f779b42
|
Check if flash exists before trying to load. Skip if not
|
2014-06-06 14:42:16 -04:00 |
englehardt
|
1b358d18ee
|
Updated threads to daemon threads to prevent hanging on crash/interrupt
|
2014-06-05 13:38:47 -04:00 |
englehardt
|
b6fe171d47
|
Added native support for flash loading/saving. Bugfixes in
run_simple_crawl.py
|
2014-06-04 21:44:24 -04:00 |
Arvind Narayanan
|
2e025716f1
|
typo
|
2014-06-02 13:40:41 -04:00 |
cgeubank
|
98c8cfe5da
|
Pulled out sleep constants; copied over OpenWPM description from site
|
2014-06-01 21:20:07 -04:00 |
englehardt
|
0810c3ba5f
|
Updates bot detection mitigation to close issue #9
|
2014-06-01 17:21:04 -04:00 |
Christian
|
a77d149194
|
Updated style and inline comments
|
2014-05-30 10:42:32 -04:00 |
Christian
|
c43dbd0ac5
|
Updated style and inline comments
|
2014-05-29 16:57:45 -04:00 |
Christian
|
6d6ba9cb40
|
Moving tab-restart logic to make more portable gets
|
2014-05-29 15:33:34 -04:00 |
Christian
|
ff40bba2f1
|
Made bot mitigation optional; simplified executor a bit
|
2014-05-29 13:11:01 -04:00 |
Christian
|
6125108cb3
|
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
|
2014-05-29 01:40:14 -04:00 |
Christian
|
81f15471b3
|
Added TLD support for http traffic
|
2014-05-29 01:39:52 -04:00 |
englehardt
|
9650d19ecd
|
Bugfix! browser.reset() properly resets profile variable
|
2014-05-28 21:36:39 -04:00 |
Christian
|
1cd8a30c2b
|
Adds Task Manager support for deep copying single input dictionary
|
2014-05-28 20:50:58 -04:00 |
englehardt
|
161d456dab
|
Adding in utilities from crawler classic
|
2014-05-28 20:05:23 -04:00 |
englehardt
|
1aa4b0b232
|
Merge branch 'master' of https://github.com/citp/OpenWPM-dev
|
2014-05-28 17:26:26 -04:00 |
Christian
|
f38943794c
|
Moving API to dictionary-based approach
|
2014-05-28 13:10:12 -04:00 |
Christian
|
a66d4d1576
|
Merging crawl DB parameters
|
2014-05-27 17:11:36 -04:00 |
englehardt
|
f7b084f5a0
|
Changing storage vector schema to make it less confusing
|
2014-05-27 15:55:08 -04:00 |
Christian
|
435e52cfc1
|
Fixed bug in run simple crawl and removed JS timeout from Ffx
|
2014-05-27 15:54:34 -04:00 |
englehardt
|
de5264c77b
|
removing news-specific code from master
|
2014-05-27 15:52:17 -04:00 |
englehardt
|
6736997241
|
Bugfix: Error handling for bot detection mitigation
|
2014-05-27 15:25:21 -04:00 |
englehardt
|
afda9ceee0
|
removed extra code, adding note about Leuven
|
2014-05-27 14:31:53 -04:00 |