Граф коммитов

25 Коммитов

Автор SHA1 Сообщение Дата
Gunes Acar df50fb2a15 Fix issues raised in the review.
Make timestamp the last column again.
Add debug logs for stream types.

Add more extensive comments for POST data parsing and streams.

Return original formData without modification, if the POST
data is not parseable into key=value form.

Remove missing onload handler in the post data test.
Add test for parsing file uploads.
Add test for sending base64 encoded data.
2016-12-28 21:26:39 +01:00
Gunes Acar f4cc4ef180 Store POST request data as JSON in the database.
Incorporated some code from: https://github.com/redline13/selenium-jmeter

Handle various content encodings for the POST data (encType).
This includes `text/plain`, `application/x-www-form-urlencoded` and
`multipart/form-data`.

Store "request headers from upload stream" in the database.
We add additional headers from POST body to existin headers column.

Discard OCSP (POST) requests to prevent noise.

Add tests for form submissions with different encodings by JavaScript.
Add tests for making POST requests with AJAX (jQuery) and FormData.
Add test for byte array POST data.

Handle exception when looking up the `Content-Type` response header.

Add shared/utils.js file. We can add common test functions to this file.

Fix some style inconsistencies.
2016-12-28 19:22:05 +01:00
Gunes Acar 60f3ac37ec Add instrumentation for document.cookie.
Log cookie read and writes, capture call stack.
2016-12-21 23:24:40 +01:00
englehardt 6a23b6ca06 Merge branch 'http-extension' of github.com:citp/OpenWPM into http-extension 2016-12-05 09:42:18 -05:00
englehardt e3f434f305 Fixing a few style issues in support of #111. 2016-12-05 09:41:17 -05:00
Gunes Acar af03b187d9 Fix the problems with the test page URL and asserts in the HTTP stack trace test.
DRY in the expected.py.
Fix tab-space mix up in the test page.
2016-12-05 15:28:47 +01:00
englehardt 8aa9cd6218 Merge remote-tracking branch 'origin/master' into http-extension
Conflicts:
	automation/Extension/firefox/openwpm.xpi
2016-12-02 16:29:26 -05:00
Gunes Acar c7535dee0d Store function name and eval/Function details for the JS calls.
Remove regex based call script URL parsing.
Remove redundant array access and parenthesis.
Add test for the call stack parsing.

Fixes #49.
2016-12-02 15:14:45 +01:00
englehardt ddf91fd564 Bugfixes and tests of javascript saving from the extension 2016-11-29 19:20:14 -05:00
Gunes Acar d3d59ae839 Exclude chrome callers from http stackstrace, add new tests.
Add a test for parse_http_stack_trace_str.
Add a test for http stackstrace instrumentation where we use different
 methods to inject an element to trigger a request (appendChild and
 innerHTML).
Test http stackstrace with an external script.
Combine http stackstrace tests in a single page.
2016-11-15 19:51:20 -05:00
Gunes Acar d659792766 Instrument the stackstrace for the HTTP requests.
Use a stack trace format similar to the javascript instrumentation.
Add a function to parse HTTP stack trace strings.
Add a test for the HTTP callstack instrumentation.

Conflicts:
	automation/platform_utils.py
2016-11-15 19:49:42 -05:00
englehardt fef6c32c50 [WIP] Adding extension-based HTTP instrumentation.
Includes flattened commits by @dreisman:
53ff16c37fdf6d2a47917d32bbb9d645402c5ab2
ecd719beaae979e1292d33e1b4002801d0951eb7
2a57dd985fe977dd64509e4941cde9214c7d183b

Conflicts:
	automation/DeployBrowsers/deploy_firefox.py
	automation/Extension/firefox/index.js
	automation/default_browser_params.json
2016-11-15 19:39:16 -05:00
dreisman 6f8bdcc1e3 Modified test of save screenshot 2016-10-04 14:43:01 -04:00
dreisman 9c59781885 Forgot to add expected source for test 2016-10-04 14:28:31 -04:00
dreisman 7733912fd4 save_screenshot tests done 2016-10-04 12:20:24 -04:00
englehardt 4a9f18a86b Adding Audio API instrumentation and tests 2016-09-12 11:18:22 -04:00
englehardt ae21cd26c2 Fix browse command to use PS+1, minor bugfix, and additional tests. Closes #85 Closes #78 Closes #82 2016-09-08 23:24:28 -04:00
dreisman 8aff632e59 Added test for visit_id in firefox extension, minor style/comment changes 2016-05-05 11:38:56 -04:00
dreisman ce6f266ca3 Adding test pages to fix broken tests 2016-05-04 12:24:16 -04:00
Gunes Acar c9e1ed8ab0 Inject intrumentation code to page content as a script element.
Add a manual_test module to make it easy to run interactive tests.

Add plugin and mimeType instrumentation.

Log line number, column number of the calling function and stack
entries.

Add local test files for Flash cookie and JS cookie testing.

Add test to make sure the required Python and OS packages are installed.

Mark test_crawl as "slow" to easily avoid calling it. Running
py.test -m "not slow" will exclude crawl test but will run all the
remanining tests.

Add test utility functions to DRY test code.

Add a WebRTC test.

Add a parent class and visit method for the tests.

Fix address in use errors related to local server
by using a py.test fixture with session scope.
2016-04-12 02:47:05 +02:00
englehardt d070cb3305 Fixing AdBlock Plus extension loading. Close #35. In support of #25.
By default, AdBlock Plus will download the list on startup unless it's
already present. It will also load the list after the browser loads.
I've disabled both of these features with prefs. Since auto-update is
disabled, I assume the list will not update mid-crawl.

I've added a utility to fetch a new list from a fresh instance of the
plugin, this should be called before startup. I've also prevented it
from calling home. Tests have been added.

I also fixed a related bug of the new version of Firefox calling
home to check for a localized search provider.
2016-01-20 16:55:27 -08:00
englehardt 1652c9d25b Adding a WebRTC Local IP discovery test page 2015-12-30 18:20:19 -08:00
englehardt cbee9ad197 Bugfix is canvas fingerprinting test script 2015-12-30 13:16:15 -08:00
englehardt 7bfeefaf02 Adding test for canvas fingerprinting 2015-12-29 16:43:17 -05:00
englehardt c737f9c40b Adding in tests for property enumeration instrumentation 2015-12-21 16:21:15 -05:00