Граф коммитов

1624 Коммитов

Автор SHA1 Сообщение Дата
englehardt 77d49f9719 version bump + minor correction 2015-01-05 22:32:32 -05:00
englehardt d16a03b22f Merge branch 'vtoubiana-master' Closes #2 2015-01-05 22:25:17 -05:00
englehardt 02774ec03f expose num_links to user 2015-01-05 22:23:17 -05:00
englehardt 51fbd568ed remove duplicate code, tweaks to scroll timing, only click visible links 2015-01-05 22:15:49 -05:00
englehardt bbcae27615 cleanup of changes, removed unneeded code, slight refactoring 2015-01-04 14:26:22 -05:00
Janos 01d935fdac Merged master fixed conflict. 2015-01-02 16:18:43 +01:00
Janos 274628fa0e Add feature to browse a site 2015-01-02 16:09:06 +01:00
englehardt 1fe205e872 Merge remote-tracking branch 'origin' into release
Conflicts:
	VERSION
	demo.py
2014-12-31 12:38:49 -05:00
Janos 4540aadbb1 Fix compatibility issues cause by libmproxy update from 0.10 to 0.11 2014-12-31 12:04:05 +01:00
englehardt 5fccd99a3c cleanup + replace run_simple_crawl with demo.py 2014-12-30 19:13:05 -05:00
englehardt c1e05a6e4b Add support for browser reset after command execution + optimizations 2014-12-30 19:02:13 -05:00
englehardt 2d05288331 fixed duplicate cookies on multiple runs 2014-12-30 18:58:42 -05:00
englehardt bf85a7797d referer now working in HTTP response 2014-12-30 18:48:09 -05:00
englehardt 1a043ee35f fixes for API changes in MITMProxy v0.11 2014-12-30 18:42:11 -05:00
englehardt 36739921cd 0.2.0 2014-08-12 18:51:15 -04:00
englehardt 705a1fd960 Merge branch 'master' into release 2014-08-12 18:49:21 -04:00
englehardt 8d8fa345ac Adding post-processing pipeline + Fix #13 2014-08-12 18:46:18 -04:00
Paul Ellenbogen 3cc27701a8 Merge branch 'paul-fix-busywait' 2014-07-11 13:35:54 -04:00
englehardt 3889b21fd5 Merge pull request #12 from citp/paul-extract-links
Add a command for extracting links from a page.
2014-07-11 11:23:57 -04:00
Paul Ellenbogen 3945329088 Clean up reading from Queue in TaskManager.
Fixes #11
2014-07-10 17:10:43 -04:00
Paul Ellenbogen d0138e1042 Add a command for extracting links from a page. 2014-07-10 15:35:43 -04:00
englehardt c1449783de 0.1.1 release 2014-07-01 12:37:17 -04:00
englehardt 4ec45c1c38 Merge branch 'master', remote-tracking branch 'origin' into release 2014-07-01 12:34:48 -04:00
englehardt db92602978 Added a method to load and copy default settings 2014-07-01 12:32:30 -04:00
englehardt 228e063084 Merge branch 'release', remote-tracking branch 'origin' 2014-06-10 14:13:45 -04:00
englehardt e138bd4d1e 0.1.0 initial public release 2014-06-10 13:41:03 -04:00
englehardt 95fa9a69c5 Initial commit 2014-06-10 12:59:28 -04:00
englehardt 5b8f779b42 Check if flash exists before trying to load. Skip if not 2014-06-06 14:42:16 -04:00
englehardt 1b358d18ee Updated threads to daemon threads to prevent hanging on crash/interrupt 2014-06-05 13:38:47 -04:00
englehardt b6fe171d47 Added native support for flash loading/saving. Bugfixes in
run_simple_crawl.py
2014-06-04 21:44:24 -04:00
Arvind Narayanan 2e025716f1 typo 2014-06-02 13:40:41 -04:00
cgeubank 98c8cfe5da Pulled out sleep constants; copied over OpenWPM description from site 2014-06-01 21:20:07 -04:00
englehardt 0810c3ba5f Updates bot detection mitigation to close issue #9 2014-06-01 17:21:04 -04:00
Christian a77d149194 Updated style and inline comments 2014-05-30 10:42:32 -04:00
Christian c43dbd0ac5 Updated style and inline comments 2014-05-29 16:57:45 -04:00
Christian 6d6ba9cb40 Moving tab-restart logic to make more portable gets 2014-05-29 15:33:34 -04:00
Christian ff40bba2f1 Made bot mitigation optional; simplified executor a bit 2014-05-29 13:11:01 -04:00
Christian 6125108cb3 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-29 01:40:14 -04:00
Christian 81f15471b3 Added TLD support for http traffic 2014-05-29 01:39:52 -04:00
englehardt 9650d19ecd Bugfix! browser.reset() properly resets profile variable 2014-05-28 21:36:39 -04:00
Christian 1cd8a30c2b Adds Task Manager support for deep copying single input dictionary 2014-05-28 20:50:58 -04:00
englehardt 161d456dab Adding in utilities from crawler classic 2014-05-28 20:05:23 -04:00
englehardt 1aa4b0b232 Merge branch 'master' of https://github.com/citp/OpenWPM-dev 2014-05-28 17:26:26 -04:00
Christian f38943794c Moving API to dictionary-based approach 2014-05-28 13:10:12 -04:00
Christian a66d4d1576 Merging crawl DB parameters 2014-05-27 17:11:36 -04:00
englehardt f7b084f5a0 Changing storage vector schema to make it less confusing 2014-05-27 15:55:08 -04:00
Christian 435e52cfc1 Fixed bug in run simple crawl and removed JS timeout from Ffx 2014-05-27 15:54:34 -04:00
englehardt de5264c77b removing news-specific code from master 2014-05-27 15:52:17 -04:00
englehardt 6736997241 Bugfix: Error handling for bot detection mitigation 2014-05-27 15:25:21 -04:00
englehardt afda9ceee0 removed extra code, adding note about Leuven 2014-05-27 14:31:53 -04:00