Граф коммитов

97 Коммитов

Автор SHA1 Сообщение Дата
Benjamin Forehand Jr dcf5e891db
Fix for 'Server Error' with integration-tests on CI. (#11169)
* Fix for 'Server Error' with integration-tests on CI.

* Fix for codestyle.
2019-04-08 13:35:15 -04:00
Benjamin Forehand Jr 187b7c2a89
Remove pytest reruns from integration-tests. (#11139)
* Remove pytest reruns from integration-tests.

* Updated submission logic.

* Fixes for codestyle.
2019-04-04 14:09:00 -04:00
Benjamin Forehand Jr 241c59e2d5
Update docs for new procedures regarding integration testing. (#11076)
* Update docs for new procedures regarding integration testing.

* Add section for setup.

* Add setup command to makefile-os.
2019-04-01 20:45:40 -04:00
Benjamin Forehand Jr 901ad6a5f8
Update docker-compose file to use latest addons-frontend image. Added new homepage test. (#11050) 2019-04-01 10:12:28 -04:00
Benjamin Forehand Jr 9f8f44dfe6
Add devhub upload, approve, install (#11021)
* Add devhub upload, approve, install integration-test
2019-03-28 09:05:41 -04:00
Benjamin Forehand Jr d1504e4ee3
Try using newer circleci image for integration-test job. (#11007)
* Try using newer circleci image for integration-test job.
2019-03-25 19:35:50 -04:00
Benjamin Forehand Jr a5e921077c
[UI-Tests] Add preference that prints console logs to geckodriver log. (#10958) 2019-03-18 22:42:04 -04:00
Benjamin Forehand Jr 2d99d6f3da
Fix ui tests for new nginx config (#10888)
* Fixes for Ui-tests using new nginx config.
2019-03-11 19:20:06 -04:00
Christopher Grebs 7b34c1b7d1
Fix addons-frontend running as default frontend. (#10692)
The frontend runs quite nicely with the changes from addons-nginx container but the initial page load runs into some wacky connection errors.

https://www.irccloud.com/pastebin/gTMteTUf/

This change fixes this.

Fixes https://github.com/mozilla/addons-server/issues/10855
2019-03-05 13:23:56 +01:00
Christopher Grebs f26a150086
Remove amo-validator, remove support for uploading legacy-addons. (#10553)
* Remove amo-validator, remove more support for uploading legacy-addons.

This is dropping most of our compatibility checks for legacy add-ons and
completely blocks them from being uploaded.

We workaround this block for mozilla-signed add-ons by issuing the same
error, just as a warning instead of an actual error.

This affected *loads* of our tests so the PR contains more test-changes
then I'd like.

In addition to that this PR adds file extension validation for uploads,
we only did that in our JavaScript and never in our code. So from now
on, we have a hard limit to only allow whatever is in
`VALID_EXTENSIONS`.

Further...

* drop amo-validator and related dependencies
* remove `dump_apps` management command
* removed unused fixture files from the repo

Fixes #10502

Future improvement idea for our test-suite: Unify add-on file fixtures
under one single folder to avoid any duplication.

There is most certainly some more improvements that could be made to
code and test structure but I went for the least changes, it's way too
huge already :-/

* Fix syntax error in JavaScript, thus ui tests

* Switch back to passing 'channel' around

* Move valid addon file extensions to constants/base

* Fix validate() call

* Fix more tests

* Update src/olympia/devhub/tests/test_views_validation.py

Co-Authored-By: EnTeQuAk <cg@webshox.org>

* Remove old comment

* Issue description specific only to Thunderbird and Seamonkey if targeting thunderbird or seamonkey
2019-02-01 08:52:04 +01:00
Christopher Grebs 9e8468f8cd
Replace pytest-responses with our own custom implementation. (#10410)
Fixes #10399

Closes #10378
Closes #10317

This also updates pytest to 4.1.1
2019-01-16 12:26:45 +01:00
Benjamin Forehand Jr 16a485421c
Add additional search tests (#10206)
### Add additional search tests

* Check that search suggestion list exact matches higher than other suggestions
* Check that long terms searching don't break results page
* Verify blank search functionality
* Check that selecting an item from search suggestions can be made by clicking on it
* Check that ESC dismisses the suggestion search results
* Check that suggestions change if chars are added or deleted
* Check that special chars don't break search
* Check that caps and lowercases have same search suggestions
2018-12-19 10:50:49 -05:00
Christopher Grebs 4fcf788bd0
Proposal: Reverse 'Continue' and 'Cancel and Disable...' buttons. (#10142)
Personally, the current order adds a lot of stress to the user to click
the correct button.

When you upload your file (very first screen) the Continue button is on
the very left side, all continuous screens switch it to be on the right
hand site. Even though the 'Cancel' button is red, it takes a bit of
time to parse which button you're going to press and ending up in a
disabled/incomplete state isn't really nice.

This changes that behaviour and fixes #7556 along the way.

![screenshot from 2018-12-03 13-07-10](https://user-images.githubusercontent.com/139033/49372994-c6111580-f6fc-11e8-9b41-d3cebc69771a.png)

cc @jvillalobos or @wagnerand for opinions on that.
2018-12-05 10:20:50 +01:00
Benjamin Forehand Jr 7b322c8ec0
Xfail filter search tests. (#10152)
Fixes #10150
2018-12-03 13:51:19 -05:00
Christopher Grebs 4a207aeed2
Split selenium based docker-config into tests/ui/docker-compose.selenium.yml (#10143)
Unfortunately, we'll have to duplicate the environment config but I added
a comment so that should be fine. It's very rarely being used anyway.

Fixes #9288
2018-12-03 17:40:00 +01:00
Benjamin Forehand Jr 042931ec39
Added footer link tests. (#10017) 2018-11-20 09:04:47 -05:00
Benjamin Forehand Jr ceee0474e7
Add type incompatibility test. (#9769)
* Add type incompatibility test.
2018-10-23 13:00:52 -04:00
Benjamin Forehand Jr 66573f6da7
Allow for running flake8 on integration tests directory. (#9772) 2018-10-22 18:29:57 -04:00
Benjamin Forehand Jr f64b8bfa0b
Added new ui tests (#9748)
Added new UI Tests.
* test_devhub_logout, tests logging out from the developer hub.
* test_devhub_register, tests the register links navigates to the fxa signup page.
* test_title_routes_to_home, tests Firefox Addons title routes to home page.
* test_more_dropdown_navigates_correctly, tests the more drop down navigates to the correct links.
2018-10-19 11:19:53 -04:00
Benjamin Forehand Jr 1cbaf538b0
Change addon title locator. (#9694)
* Change addon title locator.
2018-10-15 10:56:10 -04:00
Benjamin Forehand Jr 80bbc69dfd
Added configuration to run multiple ui tests in parallel. (#9266)
* Changed fxa account generation to allow assigning an fxa ID to a created user.
* Moved pytest execution to makefile to access variables.
* Removed second login tests as the devhub tests also log in.
2018-08-28 14:48:35 -04:00
Benjamin Forehand Jr cafc5d0519
Add UI devhub login and upload tests (#8559)
* Added devhub login and upload tests.
* Add ui-test webext.
* Remove management commands.
2018-07-13 08:55:40 -04:00
Christopher Grebs 6c6c3578ec
Try to fix ui-tests (#8808)
Fix our ui-tests.

* Update list of add-ons that are required for the July content update 
* Mark `test_browse_all_themes_button_loads_correct_page` as xfail for now as the latest content update removed static theme listings from the home page
2018-07-10 13:40:50 +02:00
Benjamin Forehand Jr 7eaf3bff8a Fixed test for personas URL check. 2018-06-26 18:54:20 -04:00
Christopher Grebs 086d3da8a1
Fix how our load-tests pick a random language and app.
This makes sure we actually hit the legacy pages no matter
how many clients are configured during a locust run.
2018-06-01 14:47:04 +02:00
Christopher Grebs c1112d89a1
WIP: Cleanup locustio based performance / smoke tests, add more entities (#8358)
* Port mozilla/amo-loadtest to FXA authentication and WebExtensions.

This is the first part of many to improve our load-tests and allow them
to be run regularly as part of a regression test suite.

This commit primarily ports the existing tests over to our repository,
updates them to use FxA authentication and uses a WebExtension for the
upload test.

This only implements the baseline for more work to come in #7744 but
it's important to have authentication and the basic infrastructure
working correctly.

It's also still using the legacy add-on detail and listing pages,
that'll obviously change - or be only true for SeaMonkey and Thunderbird
related tests since we still have to support them (very low priority though)

It also adds a first step of a summary report that links to new-relic.
That'll need a bit more tooling and testing but it worked quite well in
first tests.

Refs #7744

Next steps:
 * Implement most of the read-only tests from #7744
 * Check what needs auth in #7744, implement it properly
 * Implement database and cache query logging
 * Implement a unified merged test-report that uses the database and
 cache query logging and merges it with locust logs (using our new
 unique request id)

* Fix makefile, show dummy-usage for now.

* Delete generate-summary script for now

* Pin and cleanup dependencies

* Reverse all urls

* Use passed in account for login

* split things up

* Use gevent for waiting, some cleanups, add first version of Dockerfile, running script, disable developer stuff for now

* Add browsing collections and browsing categories

* Add loads more variation, add support for thunderbird, seamonkey, multiple languages

* Decrease size of docker images for local testing

* Get installation and docker image mostly to work, docs, cleanups

* Allow fxa environment variables be overwritten

* Hit legacy site of every variation

* More explicit theme testing

* Add browsing for app-versions and various rss feeds

* More variation in rss feeds, add featured and search tools

* Add a few more response.success() calls

* Test user profile pages, warn for empty collection pages

* More docs

* Add review browsing
2018-05-30 16:46:16 +02:00
Andrew Williamson b457a5cece
some py3 friendly syntax changes (#8372) 2018-05-30 11:29:13 +01:00
Benjamin Forehand Jr cc18f2c986
Update tests for May 31st update. (#8357) 2018-05-26 22:57:16 -04:00
Christopher Grebs e439450c6e
Port mozilla/amo-loadtest to FXA authentication and WebExtensions. (#8089)
* Port mozilla/amo-loadtest to FXA authentication and WebExtensions.

This is the first part of many to improve our load-tests and allow them
to be run regularly as part of a regression test suite.

This commit primarily ports the existing tests over to our repository,
updates them to use FxA authentication and uses a WebExtension for the
upload test.

This only implements the baseline for more work to come in #7744 but
it's important to have authentication and the basic infrastructure
working correctly.

It's also still using the legacy add-on detail and listing pages,
that'll obviously change - or be only true for SeaMonkey and Thunderbird
related tests since we still have to support them (very low priority though)

It also adds a first step of a summary report that links to new-relic.
That'll need a bit more tooling and testing but it worked quite well in
first tests.

Refs #7744

Next steps:
 * Implement most of the read-only tests from #7744
 * Check what needs auth in #7744, implement it properly
 * Implement database and cache query logging
 * Implement a unified merged test-report that uses the database and
 cache query logging and merges it with locust logs (using our new
 unique request id)

* Fix makefile, show dummy-usage for now.

* Delete generate-summary script for now

* Pin and cleanup dependencies

* Reverse all urls
2018-04-25 11:32:40 +02:00
Benjamin Forehand Jr ab1fe7c170 Add ui login tests (#8076)
* Update tests for fxa login.

* Updates to docker compose file to allow localhost logins.

* Updated files.

* Updated readme and circle file.

* Fix typo.

* Removed debugging steps and updated readme and comments.

* April 26 Homepage update.
2018-04-23 08:02:15 +02:00
Benjamin Forehand Jr af22aabb49
Update tests for April 5th content. (#7945)
* Update tests for April 5th content.
2018-03-29 16:33:21 -04:00
Benjamin Forehand Jr d2e5a4c51f
Fix search box locators. (#7793) 2018-03-14 08:54:54 -04:00
Benjamin Forehand Jr 66eaaa7b0d
Add Integration test documentation (#7695)
* Initial docs for new ui tests.
2018-03-02 10:13:00 -08:00
Benjamin Forehand Jr 9747bb84fe
Updated UI tests to use the new AMO frontend. (#7565)
* Uses addons-frontend docker image to create an instance of the new frontend.
* Add testing for both mobile and desktop resolutions.
2018-03-01 14:05:40 -08:00
Christopher Grebs 17bb6968e5
First part moving to olympia.test 2018-01-26 07:11:48 +01:00
Benjamin Forehand Jr cb1550301e
Update test addon creation to work better with new amo frontend. (#7334)
These changes help compatibility with the new amo frontend for integration testing.

* Create 2 new collections under the username 'Mozilla'.
* Change the status of the installable addon to Public.
* Allow for custom named extensions and collections.
* Added 3 lists to ease updates of the tests as the new homepage changes.
2018-01-23 13:43:17 -08:00
Benjamin Forehand Jr 8a646cadc4 Addon Install Test (#6641)
* Use docker-compose>=1.18 and minimal docker-compose config version to 2.3
* Starts ui-tests in Firefox docker container
* Let's the Firefox docker-container hit directly nginx
* makes use of https://github.com/jrbenny35/selenium-firefox/ firefox+selenium image
* makes use of /user-media/ serving directly via nginx for XPI installs
* Adds a helper that creates an installable add-on
* Update `firefox_options` fixture with all options needed to install add-ons with a test signing signature

Fixes #7270 
Fixes #2488
2018-01-12 06:58:00 +01:00
Benjamin Forehand Jr d6bb402a44 Updated UI-tests to run inside of docker and switched to circleci 2.0 (#6457)
* Updated config to use circleci as well as configure ui-tests to run within docker

* Removed hacky certifi installs

* Update requirements to master versions

Fixes #4697 (though not only that)
2017-10-05 13:14:08 +02:00
pyup-bot f17a71ed4e Update selenium from 3.5.0 to 3.6.0 2017-09-26 01:33:46 +02:00
pyup-bot 0cc60b75dd Update pytest from 3.2.1 to 3.2.2 2017-09-07 22:51:12 +02:00
pyup.io bot d2f82a3246 Update pyjwt to 1.5.3 (#6332) 2017-09-06 17:55:07 +08:00
pyup-bot 7c170dc4e0 Update pytest-selenium from 1.11.0 to 1.11.1 2017-08-31 21:32:07 +02:00
pyup.io bot c47fd6a34b Update pytest-xdist to 1.20.0 (#6194)
* Update pytest-xdist from 1.19.1 to 1.20.0

* Update pytest-xdist from 1.19.1 to 1.20.0
2017-08-18 18:59:15 +02:00
pyup-bot 1c2af09405 Update pytest-xdist from 1.19.0 to 1.19.1 2017-08-15 18:41:04 +02:00
pyup.io bot 9e0c002396 Update selenium from 3.4.3 to 3.5.0 (#6145) 2017-08-11 17:30:30 +02:00
pyup.io bot 25494fa8ca Update pytest-xdist to 1.19.0 (#6138)
* Update pytest-xdist from 1.18.2 to 1.19.0

* Update pytest-xdist from 1.18.2 to 1.19.0

* Add new pytest-forked dependency
2017-08-11 17:06:34 +02:00
pyup-bot d12b3d2eb9 Update pytest from 3.2.0 to 3.2.1 2017-08-10 03:38:30 +02:00
pyup-bot 1476a3d021 Update pytest-variables from 1.6.1 to 1.7.0 2017-08-08 13:30:24 +02:00
pyup-bot 9565dfd74d Update pytest from 3.1.3 to 3.2.0 2017-08-02 01:22:15 +02:00
pyup.io bot ad140c6e0f Update pytest-xdist to 1.18.2 (#6039) 2017-07-28 14:10:10 +01:00