Граф коммитов

184 Коммитов

Автор SHA1 Сообщение Дата
Norberto Arrieta 0b7505e58f
Allow tests to run on random images (#2817)
* Allow tests to run on random images

* PR feedback

---------

Co-authored-by: narrieta <narrieta>
2023-05-10 11:28:37 -07:00
Norberto Arrieta 4ba20de526
Use cloud when validating test location (#2806)
* Use cloud when validating test location
---------

Co-authored-by: narrieta <narrieta>
2023-04-20 17:18:56 -07:00
Norberto Arrieta cb566561a7
Add tests for no outbound connectivity (#2804)
* Add tests for no outbound connectivity

---------

Co-authored-by: narrieta <narrieta>
2023-04-18 13:17:36 -07:00
Norberto Arrieta 9390ce579f
Add support for Azure Clouds (#2795)
* Add support for Azure Clouds
---------

Co-authored-by: narrieta <narrieta>
2023-04-11 10:26:51 -07:00
Norberto Arrieta 1601e88cd1
Python configuration for tests (#2793)
* Python configuration for tests

---------

Co-authored-by: narrieta <narrieta>
2023-04-04 12:58:43 -07:00
Norberto Arrieta 08f86dbfd4
Improvements in test logs (#2792)
Co-authored-by: narrieta <narrieta>
2023-03-29 15:24:16 -07:00
Nageswara Nandigam a78787bb01
retry ssh run in e2e tests (#2788)
* ssh retry

* update comment

* addressed comment
2023-03-22 11:10:11 -07:00
Norberto Arrieta 1640510271
Check agent log for errors; install test libraries (#2787)
* Check agent log for errors; install test libraries

---------

Co-authored-by: narrieta <narrieta>
2023-03-22 10:13:04 -07:00
Norberto Arrieta 0583078833
Add Flatcar to end-to-end tests, install Pypy on test VMs, etc (#2779)
Add Flatcar, install Pypy, etc
---------

Co-authored-by: narrieta <narrieta>
2023-03-09 11:45:33 -08:00
Norberto Arrieta 66a6258536
Add support for Azure clouds (#2771)
Co-authored-by: narrieta <narrieta>
2023-03-01 07:05:38 -08:00
Norberto Arrieta 5aa1df6268
Add distros to end-to-end automation (#2769)
* Add distros to end-to-end automation

---------

Co-authored-by: narrieta <narrieta>
2023-02-23 20:31:25 -08:00
Norberto Arrieta 7c44c2f6b7
Use unique name for test VMs. Remove hardcoded log path (#2767)
* Use unique name for test VMs. Remove hardcoded log path

---------

Co-authored-by: narrieta <narrieta>
2023-02-23 06:47:44 -08:00
Norberto Arrieta 2c0cacd7ef
Bug fixes for test pipeline (#2764)
* Bug fixes for test pipeline

* Add support to execute test suites in multiple locations. Separate ARM64 images into their own image set

---------

Co-authored-by: narrieta <narrieta>
2023-02-21 10:54:05 -08:00
Norberto Arrieta 9e6f64e298
Add support for VHDs; add image, location and vm_size as parameters to the pipeline (#2758)
* Add support for VHDs; add image, location and vm_size as parameters to the pipeline
---------

Co-authored-by: narrieta <narrieta>
2023-02-16 09:35:45 -08:00
Norberto Arrieta 41a275f6e3
Add distros and location to the test suites definition files (#2756)
* Add distro, location, and VM size configuration to test suites

---------

Co-authored-by: narrieta <narrieta>
2023-02-13 15:45:02 -08:00
Norberto Arrieta 36a5ec1db1
Improvements in Pipeline parameters (#2748)
* Improvements in Pipeline parameters

* remove extra space

* fix jq

---------

Co-authored-by: narrieta <narrieta>
2023-02-06 11:43:54 -08:00
Norberto Arrieta ce369acb20
Report results for individual tests (#2751)
* Report results for individual tests

* mark failure

---------

Co-authored-by: narrieta <narrieta>
2023-02-03 15:42:51 -08:00
Norberto Arrieta becea90267
Report test results for multiple suites (#2747)
Co-authored-by: narrieta <narrieta>
2023-01-31 18:59:28 -08:00
Norberto Arrieta 629a0eced7
Load tests dynamically + Parameterize the test pipeline (#2745)
* Load tests dynamically + Parameterize the test pipeline
2023-01-30 14:24:04 -08:00
Norberto Arrieta 8328286872
Add Mariner 2 ARM64 to test run (#2740)
Co-authored-by: narrieta <narrieta>
2023-01-25 11:03:34 -08:00
Norberto Arrieta 0f0759660b
Update azure-mgmt-compute in container image (#2739)
Co-authored-by: narrieta <narrieta>
2023-01-24 12:57:08 -08:00
Norberto Arrieta 32dd7a841f
Add ARM64 to the daily test run (#2734)
* Add ARM64 to the daily test run

* remove mariner 2 arm64

Co-authored-by: narrieta <narrieta>
2023-01-23 15:07:51 -08:00
Norberto Arrieta 106979e2a8
Bug fixes for test results (#2732)
* Bug fixes for test results

* pylint warnings

Co-authored-by: narrieta <narrieta>
2023-01-20 14:11:44 -08:00
Norberto Arrieta 43b7c3c671
Add lambda in calls to execute_with_retry (#2733)
Co-authored-by: narrieta <narrieta>
2023-01-19 17:03:25 -08:00
Norberto Arrieta 4b8fe5ebda
Create individual log files for each (distro, test suite) pair (#2731)
* Create individual log files for each test

* cleanup

* typo

* remove duplicate

Co-authored-by: narrieta <narrieta>
2023-01-18 15:37:34 -08:00
Norberto Arrieta abf4161d89
Add support to execute tests on multiple distros (#2725)
* Execute BVT on multiple distros

* concurrency; distro differences

* add all distros

* remove comment

* Update Dockerfile

Co-authored-by: narrieta <narrieta>
2023-01-12 12:29:50 -08:00
Norberto Arrieta 2bd03c9abd
Add BVT for the agent (#2719)
* Add BVT for extension workflow

* logging

* update scenario

* test context

* AgentTest

* vmaccess bvt

* arguments; protected settings

* fix username

* RunCommand

* Test dependencies

* ssh key mode

* ssh key file

* key mode

* log type

* PR review

* Unused import

Co-authored-by: narrieta <narrieta>
2023-01-05 17:00:47 -08:00
Norberto Arrieta a3a41bd1e5
Improvements in error handling on end-to-end tests (#2716)
* Improvements in error handling on end-to-end tests

* Undo changes to daily.yml

* pylint

Co-authored-by: narrieta <narrieta>
2022-12-20 13:49:16 -08:00
Norberto Arrieta cc91dc67c3
Install agent on test VMs (#2714) 2022-12-15 15:18:43 -08:00
Norberto Arrieta cdb25bfdb4
Update LISA setup in container image (#2710)
Co-authored-by: narrieta <narrieta>
2022-12-07 15:31:42 -08:00
Norberto Arrieta efc39df80b
Reorganize directory structure of end-to-end tests (#2708)
* Reorganize directory structure of end-to-end tests

* change path

Co-authored-by: narrieta <narrieta>
2022-12-07 06:46:39 -08:00
Norberto Arrieta 6872beff7e
Publish test results and logs (#2707)
Co-authored-by: narrieta <narrieta>
2022-12-01 13:06:50 -08:00
Norberto Arrieta a07e48af88
Run tests using a container (#2704)
* Run tests within a container

* cleanup

Co-authored-by: narrieta <narrieta>
2022-11-23 11:35:21 -08:00
Norberto Arrieta a1f30494da
Initial (bare-bones) implementation of the infrastructure for end-to-end tests (#2691)
* Prototype for end-to-end tests

* Add agent BVT

* Cleanup SSH key; delete cleanup pipeline

* Delete unused references

* Delete unused references - Part 2

* Remove local configuration

* Remove unused references, Part 3

* Disable proxy

Co-authored-by: narrieta <narrieta>
2022-10-26 09:25:08 -07:00