Norberto Arrieta
0b7505e58f
Allow tests to run on random images ( #2817 )
...
* Allow tests to run on random images
* PR feedback
---------
Co-authored-by: narrieta <narrieta>
2023-05-10 11:28:37 -07:00
Norberto Arrieta
4ba20de526
Use cloud when validating test location ( #2806 )
...
* Use cloud when validating test location
---------
Co-authored-by: narrieta <narrieta>
2023-04-20 17:18:56 -07:00
Norberto Arrieta
cb566561a7
Add tests for no outbound connectivity ( #2804 )
...
* Add tests for no outbound connectivity
---------
Co-authored-by: narrieta <narrieta>
2023-04-18 13:17:36 -07:00
Norberto Arrieta
9390ce579f
Add support for Azure Clouds ( #2795 )
...
* Add support for Azure Clouds
---------
Co-authored-by: narrieta <narrieta>
2023-04-11 10:26:51 -07:00
Norberto Arrieta
1601e88cd1
Python configuration for tests ( #2793 )
...
* Python configuration for tests
---------
Co-authored-by: narrieta <narrieta>
2023-04-04 12:58:43 -07:00
Norberto Arrieta
08f86dbfd4
Improvements in test logs ( #2792 )
...
Co-authored-by: narrieta <narrieta>
2023-03-29 15:24:16 -07:00
Nageswara Nandigam
a78787bb01
retry ssh run in e2e tests ( #2788 )
...
* ssh retry
* update comment
* addressed comment
2023-03-22 11:10:11 -07:00
Norberto Arrieta
1640510271
Check agent log for errors; install test libraries ( #2787 )
...
* Check agent log for errors; install test libraries
---------
Co-authored-by: narrieta <narrieta>
2023-03-22 10:13:04 -07:00
Norberto Arrieta
0583078833
Add Flatcar to end-to-end tests, install Pypy on test VMs, etc ( #2779 )
...
Add Flatcar, install Pypy, etc
---------
Co-authored-by: narrieta <narrieta>
2023-03-09 11:45:33 -08:00
Norberto Arrieta
66a6258536
Add support for Azure clouds ( #2771 )
...
Co-authored-by: narrieta <narrieta>
2023-03-01 07:05:38 -08:00
Norberto Arrieta
5aa1df6268
Add distros to end-to-end automation ( #2769 )
...
* Add distros to end-to-end automation
---------
Co-authored-by: narrieta <narrieta>
2023-02-23 20:31:25 -08:00
Norberto Arrieta
7c44c2f6b7
Use unique name for test VMs. Remove hardcoded log path ( #2767 )
...
* Use unique name for test VMs. Remove hardcoded log path
---------
Co-authored-by: narrieta <narrieta>
2023-02-23 06:47:44 -08:00
Norberto Arrieta
2c0cacd7ef
Bug fixes for test pipeline ( #2764 )
...
* Bug fixes for test pipeline
* Add support to execute test suites in multiple locations. Separate ARM64 images into their own image set
---------
Co-authored-by: narrieta <narrieta>
2023-02-21 10:54:05 -08:00
Norberto Arrieta
9e6f64e298
Add support for VHDs; add image, location and vm_size as parameters to the pipeline ( #2758 )
...
* Add support for VHDs; add image, location and vm_size as parameters to the pipeline
---------
Co-authored-by: narrieta <narrieta>
2023-02-16 09:35:45 -08:00
Norberto Arrieta
41a275f6e3
Add distros and location to the test suites definition files ( #2756 )
...
* Add distro, location, and VM size configuration to test suites
---------
Co-authored-by: narrieta <narrieta>
2023-02-13 15:45:02 -08:00
Norberto Arrieta
36a5ec1db1
Improvements in Pipeline parameters ( #2748 )
...
* Improvements in Pipeline parameters
* remove extra space
* fix jq
---------
Co-authored-by: narrieta <narrieta>
2023-02-06 11:43:54 -08:00
Norberto Arrieta
ce369acb20
Report results for individual tests ( #2751 )
...
* Report results for individual tests
* mark failure
---------
Co-authored-by: narrieta <narrieta>
2023-02-03 15:42:51 -08:00
Norberto Arrieta
becea90267
Report test results for multiple suites ( #2747 )
...
Co-authored-by: narrieta <narrieta>
2023-01-31 18:59:28 -08:00
Norberto Arrieta
629a0eced7
Load tests dynamically + Parameterize the test pipeline ( #2745 )
...
* Load tests dynamically + Parameterize the test pipeline
2023-01-30 14:24:04 -08:00
Norberto Arrieta
8328286872
Add Mariner 2 ARM64 to test run ( #2740 )
...
Co-authored-by: narrieta <narrieta>
2023-01-25 11:03:34 -08:00
Norberto Arrieta
0f0759660b
Update azure-mgmt-compute in container image ( #2739 )
...
Co-authored-by: narrieta <narrieta>
2023-01-24 12:57:08 -08:00
Norberto Arrieta
32dd7a841f
Add ARM64 to the daily test run ( #2734 )
...
* Add ARM64 to the daily test run
* remove mariner 2 arm64
Co-authored-by: narrieta <narrieta>
2023-01-23 15:07:51 -08:00
Norberto Arrieta
106979e2a8
Bug fixes for test results ( #2732 )
...
* Bug fixes for test results
* pylint warnings
Co-authored-by: narrieta <narrieta>
2023-01-20 14:11:44 -08:00
Norberto Arrieta
43b7c3c671
Add lambda in calls to execute_with_retry ( #2733 )
...
Co-authored-by: narrieta <narrieta>
2023-01-19 17:03:25 -08:00
Norberto Arrieta
4b8fe5ebda
Create individual log files for each (distro, test suite) pair ( #2731 )
...
* Create individual log files for each test
* cleanup
* typo
* remove duplicate
Co-authored-by: narrieta <narrieta>
2023-01-18 15:37:34 -08:00
Norberto Arrieta
abf4161d89
Add support to execute tests on multiple distros ( #2725 )
...
* Execute BVT on multiple distros
* concurrency; distro differences
* add all distros
* remove comment
* Update Dockerfile
Co-authored-by: narrieta <narrieta>
2023-01-12 12:29:50 -08:00
Norberto Arrieta
2bd03c9abd
Add BVT for the agent ( #2719 )
...
* Add BVT for extension workflow
* logging
* update scenario
* test context
* AgentTest
* vmaccess bvt
* arguments; protected settings
* fix username
* RunCommand
* Test dependencies
* ssh key mode
* ssh key file
* key mode
* log type
* PR review
* Unused import
Co-authored-by: narrieta <narrieta>
2023-01-05 17:00:47 -08:00
Norberto Arrieta
a3a41bd1e5
Improvements in error handling on end-to-end tests ( #2716 )
...
* Improvements in error handling on end-to-end tests
* Undo changes to daily.yml
* pylint
Co-authored-by: narrieta <narrieta>
2022-12-20 13:49:16 -08:00
Norberto Arrieta
cc91dc67c3
Install agent on test VMs ( #2714 )
2022-12-15 15:18:43 -08:00
Norberto Arrieta
cdb25bfdb4
Update LISA setup in container image ( #2710 )
...
Co-authored-by: narrieta <narrieta>
2022-12-07 15:31:42 -08:00
Norberto Arrieta
efc39df80b
Reorganize directory structure of end-to-end tests ( #2708 )
...
* Reorganize directory structure of end-to-end tests
* change path
Co-authored-by: narrieta <narrieta>
2022-12-07 06:46:39 -08:00
Norberto Arrieta
6872beff7e
Publish test results and logs ( #2707 )
...
Co-authored-by: narrieta <narrieta>
2022-12-01 13:06:50 -08:00
Norberto Arrieta
a07e48af88
Run tests using a container ( #2704 )
...
* Run tests within a container
* cleanup
Co-authored-by: narrieta <narrieta>
2022-11-23 11:35:21 -08:00
Norberto Arrieta
a1f30494da
Initial (bare-bones) implementation of the infrastructure for end-to-end tests ( #2691 )
...
* Prototype for end-to-end tests
* Add agent BVT
* Cleanup SSH key; delete cleanup pipeline
* Delete unused references
* Delete unused references - Part 2
* Remove local configuration
* Remove unused references, Part 3
* Disable proxy
Co-authored-by: narrieta <narrieta>
2022-10-26 09:25:08 -07:00