Граф коммитов

184 Коммитов

Автор SHA1 Сообщение Дата
maddieford 71e2658a2d
update rocky publisher name (#3251) (#3266)
(cherry picked from commit 5a94b1e150)

Co-authored-by: Nageswara Nandigam <84482346+nagworld9@users.noreply.github.com>
2024-11-25 16:42:23 -08:00
maddieford 6e2ed79147
new rockylinux publisher (#3250) (#3265)
(cherry picked from commit 7cbde8b6fe)

Co-authored-by: Nageswara Nandigam <84482346+nagworld9@users.noreply.github.com>
2024-11-25 16:33:37 -08:00
maddieford c1bc00481f
Ubuntu 24 image (#25) (#3229) (#3230)
* Update ubuntu 24

* Add ubuntu 24 to nat clouds

* Add arm64 ubuntu 24

* Update all ubuntu images

* Skip arm64 in nat clouds

* Fix syntax issues

(cherry picked from commit 31adf25ca9)
2024-09-23 12:46:22 -07:00
Nageswara Nandigam 83213bc0f3
fixing attribute error (#3202) 2024-09-03 13:17:45 -07:00
maddieford 04490fb9b8
Capture logcollector pattern only once (#3194)
* Capture logcollector pattern only once

* Add comment
2024-08-27 11:43:30 -07:00
maddieford 0681f148f2
Add cgroupv2 support for log collector (#3188)
* Lc v2 implementation branch (#18)

* memory experimentation changes

* Initial changes

* obvious issues

* Fix e2e test

* First round of unit test fixes

* Fix existing unit tests

* Remove unneeded cpu files

* Get memory usage should return tuple

* Fix log for tracking cgroup

* Add unit tests

* Add unit tests

* Address pylint comments

* Clean up code

* clean up code

* Fix unit tests (#19)

* Fix unit tests

* Fix unit tests

* Revisions (#20)

* Respond to comments

* Test failures

* Fix type issue

* Revisions

* Additional revisions (#21)

* Revisions

* Remove unit test for sending telem

* final fixes

* add config flag

* Fix e2e tests
2024-08-26 14:23:24 -07:00
Norberto Arrieta fc7644afae
Disable multi-config test in AzureCloud (#3192)
Co-authored-by: narrieta@microsoft <narrieta>
2024-08-26 10:45:00 -07:00
Nageswara Nandigam 4412778a70
Use self-update for initial update (#3184)
* use self-update for initial update

* addressing comments

* cleanup files

* state files

* remove comment
2024-08-23 14:00:26 -07:00
Norberto Arrieta 1a0f1b5b17
Add support for Azure Linux 3 (#3183)
* .

* Add Azure Linux 3 to test runs

* .

* .

* .

* .

* Update setup.py

---------

Co-authored-by: narrieta@microsoft <narrieta>
2024-08-15 10:06:25 -07:00
maddieford 23d4c5b1b8
Fix regex pattern for ext seq scenario (#3162) 2024-07-16 16:32:26 -07:00
Nageswara Nandigam bf45d50a1d
fixing custom image test run (#3147) 2024-06-18 17:15:19 -07:00
maddieford 610e12b3f1
refactor cgroup controllers (#3135)
* refactor cgroup controllers (#13)

* Refactor Cgroup, CpuCgroup, MemoryCgroup to ControllerMetrics, CpuMetrics, MemoryMetrics

* Create methods to get unit/process cgroup representation

* Refactoring changes

* Refactoring changes

* Fix e2e test

* Fix unintentional comment change

* Remove unneeded comments

* Clean up comments and make code more readable

* Simplify get controller metrics

* Clean up cgroupapi

* Cleanup cgroup -> controllermetrics changes

* Clean up cgroup configurator

* Fix unit tests for agent.py

* Fix cgroupapi tests

* Fix cgroupconfigurator and tests

* Rename controller metrics tests

* Ignore pylint issues

* Improve test coverage for cgroupapi

* Rename cgroup to metrics

* Update cgroup.procs to accurately represent file

* Do not track metrics if controller is not mounted

* We should set cpu quota before tracking cpu metrics

* Pylint

* address pr comments (#14)

* Address Nag's comments

* pyling

* pylint

* remove lambda (#15)
2024-06-16 11:41:57 -07:00
maddieford cc6501d6dd
eFix multi config (#16) (#3145)
* Use runcommand api for runcommand multiconfig operations

* remove rc

* Fix comments

* Remove comment

* Fix rc

* pylint

* Add line
2024-06-14 18:10:46 -07:00
Nageswara Nandigam d655c29160
support dict/list resources type for lisa template (#3140)
* support dict/list for resources schema

* addressed comment
2024-06-10 15:44:00 -07:00
Nageswara Nandigam 49d3ce3e85
new namespace (#3139) 2024-06-10 13:20:55 -07:00
Nageswara Nandigam 81140ee669
Switching to SNI based authentication for aad app (#3137)
* SNI auth

* new env var

* pylint
2024-06-10 11:14:05 -07:00
Nageswara Nandigam eb503d4879
wait for rg creation in e2e tests (#3117)
* wait for rg creation

* update param

* check for rg existance

* input rg name
2024-05-07 14:43:06 -07:00
Nageswara Nandigam 6e5cde0144
remove secret and use cert for aad app in e2e pipeline (#3116)
* remove secret and use cert

* address comment
2024-05-07 14:31:08 -07:00
maddieford 7adb8d42d7
Update agent_publish test to check for new agent update pattern (#3114) (#3119)
* Add new agent update pattern

* Use record message

* Need to update log record timestamp

(cherry picked from commit 1d91c149d2)
2024-05-06 09:55:42 -07:00
maddieford b986425c23
Allow retries for ifdown and add comments (#3106) 2024-04-10 10:41:13 -07:00
maddieford 5373e9de8c
Keep whole goal state in log (#3104) 2024-04-08 13:54:29 -07:00
maddieford eb42b8f8a7
Increase timeout for agent to start and provisioning to complete (#3105) 2024-04-08 13:43:32 -07:00
maddieford f84cde24f6
Cgroups api refactor for v2 (#3096)
* Cgroups api refactor (#6)

* Initial changes for log collector cgroups v2 support

* Fix pylint issues

* Fix pylint issues

* Fix pylint issues

* Check that both controllers are mounted in the chosen cgroups version for log collector

* Fix regex

* Update test_agent unit tests

* Fix unit tests

* Update format strings

* Fix broken cgroupconfigurator unit tests

* pyling

* Fix cgroups api unit tests

* Ignore unused args

* Ignore unused args

* Add cgroup configurator tests

* v2 required check in parent cgroup

* unit tests is_controller_enabled

* Fix test failure and pylint:

* pylint

* Update agent checks

* Fix controller enable logic and unit tests

* Remove changes to collect logs

* Fix pylint

* Add e2e test for v2

* Fix log warnings

* Add cgroups v2 disabled scenario to daily runbook

* Address PR comments (#7)

* get_cgroup_api should raise exception when controllers not mounted

* Combine cgroups_supported() check

* Combine SystemdCgroupsApi and CGroupApi classes

* fix pylint and tests with sudo

* Rename SystemdCgroupsApi to SystemdCgroupApi

* Cgroup should be singular when referring to the APi

* Unimpleneted methods should raise NotImplementederror

* Check for cpu,cpuacct

* v2 start extension command should not be implemented

* log_cgorup_info and log_cgroup_warning should be in cgroupapi

* Systemd check should come before api

* Explicitly check for empty dict

* Only check if controllers are enabled at root for v2

* Remove unnecessary mocked paths in mock cgroup env

* V2 does not have concept of mounting controllers

* Fix super call for python 2

* get_cgroup_api should be function

* Move logging functions up

* Use stat -f to get cgroup mode

* Mock hybrid path

* Fix unit tests:

* Debug tests

* Debug tests

* Debug unit tests

* Fix unit tests

* Fix pylint

* Fix e2e test for v2

* Fix e2e test

* Fix e2e test

* Fix e2e test

* Combine common implementations

* Improve comments

* Pylint

* Address PR comments (#8)

* Run unit tests

* Clean up drop in files if cgroups are disabled

* Init values for cgroup apis

* Rever test change

* get_cgroup_api should check if mountpoints are correct (#9)

* Fix conflict after merge

* Merge issues (#10)

* Fix merge issues

* Fix unit tests

* get_cgroup_api raises InvalidCroupMountpointException (#11)

* get_cgroup_api can raise InvalidCgroupMountpointException

* Add unit test for agent

* Address PR comments (#12)
2024-04-04 17:11:55 -07:00
Nageswara Nandigam 782a165242
check for unexpected process in agent cgroups before cgroups enabled (#3103)
* check for unexpected process in cgroup before enable

* agent restart

* move the process check

* fix unit tests

* address comments

* pylint
2024-04-04 10:18:07 -07:00
Norberto Arrieta 3f49315a57
Add Ubuntu minimal to test run (#3102)
* Add ubuntu minimal to test run

* typo

* suppress warnings

---------

Co-authored-by: narrieta <narrieta>
2024-03-28 16:05:26 -07:00
Nageswara Nandigam 101cc1ed10
agent publish refactor (#3091)
* agent publish refactor

* support arm 64vm

* convert dict to str

* address comments

* pylint

* new comments

* updated comment
2024-03-28 09:25:17 -07:00
Nageswara Nandigam c125edc1bb
wait for provision to complete before install test agent (#3094)
* wait for provision to complete

* address comments
2024-03-20 19:07:30 -07:00
maddieford d98580381e
Reboot Vm if CSE timesout so logs are collected (#3097) 2024-03-19 13:53:53 -07:00
Norberto Arrieta 5d40813bf1
Add retry on keyvault test (#3095)
* Add retry on keyvault test

* newline

---------

Co-authored-by: narrieta <narrieta>
2024-03-18 13:31:03 -07:00
Nageswara Nandigam ee6eb7d290
ignore case (#3093) 2024-03-14 11:10:43 -07:00
Norberto Arrieta e72f9e8a3f
Add keyvault test to daily run + Specify tests suite as a list (#3089)
Co-authored-by: narrieta <narrieta>
2024-03-11 13:04:08 -07:00
Nageswara Nandigam 3b2c905a54
update setup (#3088) 2024-03-08 11:45:31 -08:00
Nageswara Nandigam f947ddeaad
cron job script (#3077) 2024-03-05 17:30:01 -08:00
Nageswara Nandigam cc94d46faa
added retries for agent cgroups test (#3075)
* retries for agent cgroups test

* pylint warn

* addressed comment
2024-03-01 12:47:14 -08:00
Norberto Arrieta 6697ea8669
Ignore network unreachable error in hostname test (#3074)
* Ignore network unreachable error in hostname test

---------

Co-authored-by: narrieta <narrieta>
2024-02-29 15:20:55 -08:00
Norberto Arrieta 8e02671547
Skip network unreachable error in publish hostname test (#3071)
Co-authored-by: narrieta <narrieta>
2024-02-28 12:31:04 -08:00
Nageswara Nandigam 5af6621133
retry on quota reset check (#3068) 2024-02-27 11:21:30 -08:00
Nageswara Nandigam 5759501cb2
reset uphold setting for agent service in flatcar distro (#3066)
* reset uphold settings for flatcar images

* updated comment

* stop the rebbot service

* address comments
2024-02-27 10:05:20 -08:00
maddieford 591b5492ba
Retry ssh check if connection reset (#3065) 2024-02-22 15:12:14 -08:00
Nageswara Nandigam f27b7b23b9
retry on agent cgroups tracking check (#3062)
* retry on agentcgroups check

* address comments
2024-02-22 14:23:55 -08:00
Nageswara Nandigam 2e83971a95
skip run on flatcar (#3061) 2024-02-20 17:36:55 -08:00
Nageswara Nandigam 99aca99867
modify agent update flag (#3053) (#3055)
(cherry picked from commit 049de5c7b1)
2024-02-20 16:44:03 -08:00
Norberto Arrieta b1b0545a1a
Address pylint warning deprecated-method (#3059)
Co-authored-by: narrieta <narrieta>
2024-02-20 11:03:09 -08:00
maddieford 0aabddd0bf
Ignore network unreachable errors in publish hostname (#3060) 2024-02-20 10:53:55 -08:00
Norberto Arrieta 0163223620
Add Python 3.10 to the pylint matrix (#3057)
Co-authored-by: narrieta <narrieta>
2024-02-16 10:10:22 -08:00
Nageswara Nandigam 540e0670ff
update canary region (#3056) 2024-02-16 09:37:55 -08:00
maddieford 49de9b3fc4
Ext_sequencing scenario should check agent log for extension enable order (#3049)
* Ext_sequencing scenario should check agent log for extension enable order

* Format timestamp for ignore errors before timestamp

* If test is skipped, scenario start will be datetime min

* Remove unnecessary log

* Make none check explicit
2024-02-13 16:06:53 -08:00
maddieford b498fd54c2
Skip test on alma and rocky until we investigate (#3047) 2024-02-09 15:54:54 -08:00
Norberto Arrieta 694e41d15c
Create symlink for waagent.com on Flatcar (#3045)
Co-authored-by: narrieta <narrieta>
2024-02-07 19:43:00 -08:00
Norberto Arrieta 32e61e1416
Skip capture of VM information on test runs (#3043)
Co-authored-by: narrieta <narrieta>
2024-02-07 16:05:24 -08:00