ARO-RP/go.mod

593 строки
33 KiB
Modula-2
Исходник Обычный вид История

module github.com/Azure/ARO-RP
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
go 1.17
require (
github.com/AlekSi/gocov-xml v0.0.0-20190121064608-3a14fb1c4737
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/Azure/azure-sdk-for-go v63.1.0+incompatible
github.com/Azure/go-autorest/autorest v0.11.25
2022-01-25 18:53:07 +03:00
github.com/Azure/go-autorest/autorest/adal v0.9.18
github.com/Azure/go-autorest/autorest/azure/auth v0.5.11
github.com/Azure/go-autorest/autorest/date v0.3.0
github.com/Azure/go-autorest/autorest/to v0.4.0
2021-01-14 23:55:44 +03:00
github.com/Azure/go-autorest/autorest/validation v0.3.1
github.com/Azure/go-autorest/tracing v0.6.0
github.com/alvaroloes/enumer v1.1.2
github.com/apparentlymart/go-cidr v1.1.0
github.com/axw/gocov v1.0.0
2020-12-14 17:58:43 +03:00
github.com/codahale/etm v0.0.0-20141003032925-c00c9e6fb4c9
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/containers/image/v5 v5.21.0
2021-01-14 23:55:44 +03:00
github.com/coreos/go-oidc v2.2.1+incompatible
2022-09-05 07:04:08 +03:00
github.com/coreos/go-semver v0.3.0
2021-05-19 16:08:23 +03:00
github.com/coreos/go-systemd/v22 v22.3.2
Updated Azure Pipelines config for admin portal page source Modified css selectors for test Remove Test Focus Minor change in deploy-dev-rp.md move validate-go to github action (#2153) include openshift-operator-lifecycle-manager in monitoring for gateway change arm deployment template name from storage to gatewayprivateendpoint fix bug where mhc wouldn't kick in after CR change RP support for 2-zone regions, centraluseuap Bump github.com/coreos/ignition/v2 from 2.13.0 to 2.14.0 Bumps [github.com/coreos/ignition/v2](https://github.com/coreos/ignition) from 2.13.0 to 2.14.0. - [Release notes](https://github.com/coreos/ignition/releases) - [Changelog](https://github.com/coreos/ignition/blob/main/docs/release-notes.md) - [Commits](https://github.com/coreos/ignition/compare/v2.13.0...v2.14.0) --- updated-dependencies: - dependency-name: github.com/coreos/ignition/v2 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> reduce the use of bindata by using embed for machinehealthcheck controller Add the development AKS ARM template. New deploy_aks_dev function for the AKS ARM template. Script to SSH into AKS node pool VM instances for prototyping and debugging. Add 'make aks.kubeconfig' for use in development environments. Documentation on accessing the private AKS cluster via the VPN for oc or direct SSH access. Display list of clusters when a search returns 0 or >1 AKS clusters. Filter for the system node pool for cases when there are more than one deployed. Updates to ARM template for AKS keyvault access, node resource group, and various AAD changes. add managed identity Format JSON. Wire up the user assigned MSI, peer with rp-vnet, and add the AKS keyvault back in. Minor tweaks to naming, max agent VMs, and variables. Add a podSubnet, autoscaling, and orchestratorVersion for nodepool upgrades. Add aks.kubeconfig to Makefile .PHONY Output an error if the AKS kubeconfig generation fails Delegate pod subnet and wire up the AzureSecrets identity for keyvault access. Remove any previous AKS config. Limit MSI role assignment to subnet collaborator, bump max pods, and parameterize availabilityZones. improve Python unit testing and refactor _validators.py (#2120) * refactor: apply Guard clauses in _validators.py to simplify code * fix _validators.py trailing whitespace * improve python test tructure, include execution of unit tests in make test-python * crate make directive to run python unit tests, add unit tests for azext_aro._validators.validate_cidr * add tests for test_validate_client_id and include test cases description * add unit tests for validate_client_secret from azext_aro._validators * add explicit fields to named tuple in test cases in test_validators.py * add two test scenarios for validate_cluster_resource_group * simplify mocks * add test case for test_validate_cluster_resource_group * improve test descriptions * add test_validate_disk_encryption_set test to test validate_disk_encryption_set * add test cases to test_validate_disk_encryption_set() * refactor test_validator.py to use classes instead of namedtuples. Use mocks instead of specific defined classes * refactor (simplify code): remove explicit assignemnt to None when it is the default value * create test_validate_domain() with 1st test case * add test case, domain with '_' * explicit import of unittest.TestCase * fix test message in test_validate_domain * finish test_validate_domain() * finish test_validate_sdn() and test_validate_pull_secret() * create test_validate_subnet() with first test case * finish test_validate_subnet() and minor refactor in _validators.py * create test_validate_subnets() and add first test case * finish validate_vnet_resource_group_name() * finish test_validate_worker_count() of test_validators.py and simple refactor in _validators.py * finish test_validate_worker_vm_disk_size_gb() * refactor _validators.py * add test_validate_refresh_cluster_credentials() and minor refactor of test_validators() * refactor _test_validators.py to use pytest, create script and invoke it from Makefile * simplify test_validate_cidr() using pytest.mark.parametrize * simplify some tests using pytest.mark.parametrize * finish applying pytest.mark.parametrize * clean up Makefile test-python * add blank line to hack/unit-test-python.sh * fix typo in test case * fix mega-linter error, blank space * fix test case to fail due to invalid range * fix typo in beeing to be being * remove redundant test case * reformat code for better readability * add missing license to __init__.py files Panic on AdminUpdate with MaintenanceTaskEverything Fixed formatting issues and made the changes suggested in PR 2152 Panic on AdminUpdate PR changes. error message updated as per PR comments move installtime set to startInstallation rather than in the middle of kubeconfig generation enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Minor change in deploy-dev-rp.md move validate-go to github action (#2153) include openshift-operator-lifecycle-manager in monitoring for gateway change arm deployment template name from storage to gatewayprivateendpoint fix bug where mhc wouldn't kick in after CR change RP support for 2-zone regions, centraluseuap Bump github.com/coreos/ignition/v2 from 2.13.0 to 2.14.0 Bumps [github.com/coreos/ignition/v2](https://github.com/coreos/ignition) from 2.13.0 to 2.14.0. - [Release notes](https://github.com/coreos/ignition/releases) - [Changelog](https://github.com/coreos/ignition/blob/main/docs/release-notes.md) - [Commits](https://github.com/coreos/ignition/compare/v2.13.0...v2.14.0) --- updated-dependencies: - dependency-name: github.com/coreos/ignition/v2 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> reduce the use of bindata by using embed for machinehealthcheck controller Add the development AKS ARM template. New deploy_aks_dev function for the AKS ARM template. Script to SSH into AKS node pool VM instances for prototyping and debugging. Add 'make aks.kubeconfig' for use in development environments. Documentation on accessing the private AKS cluster via the VPN for oc or direct SSH access. Display list of clusters when a search returns 0 or >1 AKS clusters. Filter for the system node pool for cases when there are more than one deployed. Updates to ARM template for AKS keyvault access, node resource group, and various AAD changes. add managed identity Format JSON. Wire up the user assigned MSI, peer with rp-vnet, and add the AKS keyvault back in. Minor tweaks to naming, max agent VMs, and variables. Add a podSubnet, autoscaling, and orchestratorVersion for nodepool upgrades. Add aks.kubeconfig to Makefile .PHONY Output an error if the AKS kubeconfig generation fails Delegate pod subnet and wire up the AzureSecrets identity for keyvault access. Remove any previous AKS config. Limit MSI role assignment to subnet collaborator, bump max pods, and parameterize availabilityZones. improve Python unit testing and refactor _validators.py (#2120) * refactor: apply Guard clauses in _validators.py to simplify code * fix _validators.py trailing whitespace * improve python test tructure, include execution of unit tests in make test-python * crate make directive to run python unit tests, add unit tests for azext_aro._validators.validate_cidr * add tests for test_validate_client_id and include test cases description * add unit tests for validate_client_secret from azext_aro._validators * add explicit fields to named tuple in test cases in test_validators.py * add two test scenarios for validate_cluster_resource_group * simplify mocks * add test case for test_validate_cluster_resource_group * improve test descriptions * add test_validate_disk_encryption_set test to test validate_disk_encryption_set * add test cases to test_validate_disk_encryption_set() * refactor test_validator.py to use classes instead of namedtuples. Use mocks instead of specific defined classes * refactor (simplify code): remove explicit assignemnt to None when it is the default value * create test_validate_domain() with 1st test case * add test case, domain with '_' * explicit import of unittest.TestCase * fix test message in test_validate_domain * finish test_validate_domain() * finish test_validate_sdn() and test_validate_pull_secret() * create test_validate_subnet() with first test case * finish test_validate_subnet() and minor refactor in _validators.py * create test_validate_subnets() and add first test case * finish validate_vnet_resource_group_name() * finish test_validate_worker_count() of test_validators.py and simple refactor in _validators.py * finish test_validate_worker_vm_disk_size_gb() * refactor _validators.py * add test_validate_refresh_cluster_credentials() and minor refactor of test_validators() * refactor _test_validators.py to use pytest, create script and invoke it from Makefile * simplify test_validate_cidr() using pytest.mark.parametrize * simplify some tests using pytest.mark.parametrize * finish applying pytest.mark.parametrize * clean up Makefile test-python * add blank line to hack/unit-test-python.sh * fix typo in test case * fix mega-linter error, blank space * fix test case to fail due to invalid range * fix typo in beeing to be being * remove redundant test case * reformat code for better readability * add missing license to __init__.py files Panic on AdminUpdate with MaintenanceTaskEverything Fixed formatting issues and made the changes suggested in PR 2152 Panic on AdminUpdate PR changes. error message updated as per PR comments move installtime set to startInstallation rather than in the middle of kubeconfig generation Fix azureproviderspec regression (#2167) * Fix AzureMachineProviderSpec regression in 4.10 * refactor to reduce branches and clean up Co-authored-by: bennerv <10840174+bennerv@users.noreply.github.com> Removed temporary timestamp update code (#2172) mirror MUO and Hive images to ACR attempt to make this e2e test a bit more reliable Add pull secret to allow mirroring from pd -> int Pass NIC on CreateOrUpdate call add required build images to mirror add a listen to the cluster pull secret move deploystorage portions to pkg/installer manager for installer code, call the installer code from the cluster/install.go code move some steps earlier in the installer we haven't loaded the kubeconfig files into oc yet, so use the ones from the graph directly Hive AKS development environment deploy (#2171) * Add hive config generation script * Script to install hive into the AKS dev environments * Add note about semi-scientific container image search * Vanilla hive config gleaned from app-sre config * Initial OCP 4.10.15 image set * Ignore the generated hive config files * Check for crds folder and ask to re-running install * Add docs * Add newline to yaml EOF * Spelling is clearly hard at this hour... * Fix typo, grammer, and spelling * Use the shell var instead * Use the expanded output variable syntax. No lazy typing :) * Use 1's for all error exit's * Fix make aks.kubeconfig in docs/hive.md Co-authored-by: Spencer Amann <samann@redhat.com> * Fix hive docs kubeconfig typo * Use HIVE_IMAGE_COMMIT_HASH in the HIVE image and comments for popd/pushd * Update docs to reflect the use of the HIVE_IMAGE_COMMIT_HASH define Co-authored-by: Spencer Amann <samann@redhat.com> Go vet with tags
2022-06-10 03:42:57 +03:00
github.com/coreos/ignition/v2 v2.14.0
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/coreos/stream-metadata-go v0.2.0
github.com/form3tech-oss/jwt-go v3.2.5+incompatible
github.com/ghodss/yaml v1.0.1-0.20190212211648-25d852aebe32
github.com/go-bindata/go-bindata v3.1.2+incompatible
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/go-logr/logr v1.2.3
2022-01-25 18:53:07 +03:00
github.com/go-test/deep v1.0.8
github.com/gofrs/uuid v4.2.0+incompatible
github.com/golang/mock v1.6.0
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/golangci/golangci-lint v1.42.1
2022-11-23 14:23:29 +03:00
github.com/google/go-cmp v0.5.9
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/googleapis/gnostic v0.6.8
github.com/gorilla/csrf v1.7.1
github.com/gorilla/mux v1.8.0
2020-03-17 01:58:52 +03:00
github.com/gorilla/securecookie v1.1.1
github.com/gorilla/sessions v1.2.1
github.com/jewzaam/go-cosmosdb v0.0.0-20220315232836-282b67c5b234
github.com/jstemmer/go-junit-report v0.9.1
2022-10-31 14:57:19 +03:00
github.com/onsi/ginkgo/v2 v2.3.1
github.com/onsi/gomega v1.22.0
2022-11-23 14:23:29 +03:00
github.com/open-policy-agent/frameworks/constraint v0.0.0-20221109005544-7de84dff5081
2022-07-26 04:54:39 +03:00
github.com/openshift/api v3.9.1-0.20191111211345-a27ff30ebf09+incompatible
github.com/openshift/client-go v0.0.0-20220525160904-9e1acff93e4a
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/openshift/console-operator v0.0.0-20220407014945-45d37e70e0c2
2022-07-26 04:54:39 +03:00
github.com/openshift/hive v1.1.16
github.com/openshift/hive/apis v0.0.0
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/openshift/installer v0.16.1
2022-07-26 04:54:39 +03:00
github.com/openshift/library-go v0.0.0-20220525173854-9b950a41acdc
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/openshift/machine-config-operator v3.11.0+incompatible
github.com/pires/go-proxyproto v0.6.2
github.com/pkg/errors v0.9.1
2022-07-26 04:54:39 +03:00
github.com/prometheus-operator/prometheus-operator/pkg/apis/monitoring v0.50.0
2022-11-23 14:23:29 +03:00
github.com/prometheus/client_golang v1.13.0
github.com/prometheus/common v0.37.0
github.com/serge1peshcoff/selenium-go-conditions v0.0.0-20170824121757-5afbdb74596b
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/sirupsen/logrus v1.8.1
github.com/stretchr/testify v1.7.1
github.com/tebeka/selenium v0.9.9
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/ugorji/go/codec v1.2.7
golang.org/x/crypto v0.0.0-20220331220935-ae2d96664a29
2022-11-23 14:23:29 +03:00
golang.org/x/net v0.0.0-20220909164309-bea034e7d591
2022-07-26 04:54:39 +03:00
golang.org/x/oauth2 v0.0.0-20220411215720-9780585627b5
2022-10-31 14:57:19 +03:00
golang.org/x/sync v0.0.0-20220722155255-886fb9371eb4
2022-09-05 07:04:08 +03:00
golang.org/x/text v0.3.7
2022-10-31 14:57:19 +03:00
golang.org/x/tools v0.1.12
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
gotest.tools/gotestsum v1.6.4
2022-11-23 14:23:29 +03:00
k8s.io/api v0.24.7
k8s.io/apiextensions-apiserver v0.24.7
k8s.io/apimachinery v0.24.7
2022-07-26 04:54:39 +03:00
k8s.io/cli-runtime v0.24.1
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
k8s.io/client-go v12.0.0+incompatible
2022-07-26 04:54:39 +03:00
k8s.io/code-generator v0.24.1
k8s.io/kubectl v0.24.1
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
k8s.io/kubernetes v1.23.5
sigs.k8s.io/cluster-api-provider-azure v1.2.1
2022-11-23 14:23:29 +03:00
sigs.k8s.io/controller-runtime v0.12.3
2022-07-26 04:54:39 +03:00
sigs.k8s.io/controller-tools v0.9.0
2022-11-23 14:23:29 +03:00
sigs.k8s.io/yaml v1.3.0
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
)
require (
4d63.com/gochecknoglobals v0.0.0-20201008074935-acfc0b28355a // indirect
cloud.google.com/go/compute v1.5.0 // indirect
github.com/AlecAivazis/survey/v2 v2.3.4 // indirect
github.com/Antonboom/errname v0.1.4 // indirect
github.com/Azure/go-ansiterm v0.0.0-20210617225240-d185dfc1b5a1 // indirect
github.com/Azure/go-autorest v14.2.0+incompatible // indirect
github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 // indirect
github.com/Azure/go-autorest/logger v0.2.1 // indirect
github.com/BurntSushi/toml v1.1.0 // indirect
2022-07-26 04:54:39 +03:00
github.com/Djarvur/go-err113 v0.1.0 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/IBM-Cloud/bluemix-go v0.0.0-20220407050707-b4cd0d4da813 // indirect
github.com/IBM/go-sdk-core/v5 v5.9.5 // indirect
github.com/IBM/networking-go-sdk v0.28.0 // indirect
github.com/IBM/platform-services-go-sdk v0.24.0 // indirect
github.com/IBM/vpc-go-sdk v1.0.1 // indirect
github.com/MakeNowJust/heredoc v1.0.0 // indirect
github.com/Masterminds/semver v1.5.0 // indirect
github.com/Microsoft/go-winio v0.5.2 // indirect
github.com/OpenPeeDeeP/depguard v1.0.1 // indirect
github.com/PuerkitoBio/purell v1.1.1 // indirect
github.com/PuerkitoBio/urlesc v0.0.0-20170810143723-de5bf2ad4578 // indirect
github.com/VividCortex/ewma v1.2.0 // indirect
github.com/acarl005/stripansi v0.0.0-20180116102854-5a71ef0e047d // indirect
github.com/alexkohler/prealloc v1.0.0 // indirect
github.com/aliyun/alibaba-cloud-sdk-go v1.61.1550 // indirect
github.com/aliyun/aliyun-oss-go-sdk v2.2.2+incompatible // indirect
2022-11-23 14:23:29 +03:00
github.com/antlr/antlr4/runtime/Go/antlr v0.0.0-20210826220005-b48c857c3a0e // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/asaskevich/govalidator v0.0.0-20210307081110-f21760c49a8d // indirect
github.com/ashanbrown/forbidigo v1.2.0 // indirect
github.com/ashanbrown/makezero v0.0.0-20210520155254-b6261585ddde // indirect
github.com/aws/aws-sdk-go v1.43.34 // indirect
github.com/baiyubin/aliyun-sts-go-sdk v0.0.0-20180326062324-cfa1a18b161f // indirect
github.com/beorn7/perks v1.0.1 // indirect
github.com/bkielbasa/cyclop v1.2.0 // indirect
github.com/blang/semver v3.5.1+incompatible // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/bombsimon/wsl/v3 v3.3.0 // indirect
github.com/cespare/xxhash/v2 v2.1.2 // indirect
github.com/chai2010/gettext-go v0.0.0-20160711120539-c6fed771bfd5 // indirect
github.com/charithe/durationcheck v0.0.8 // indirect
github.com/chavacava/garif v0.0.0-20210405164556-e8a0a408d6af // indirect
github.com/clarketm/json v1.17.1 // indirect
github.com/containers/image v3.0.2+incompatible // indirect
github.com/containers/libtrust v0.0.0-20200511145503-9c3a6c22cd9a // indirect
github.com/containers/ocicrypt v1.1.3 // indirect
github.com/containers/storage v1.39.0 // indirect
github.com/coreos/go-systemd v0.0.0-20191104093116-d3cd4ed1dbcf // indirect
github.com/coreos/ignition v0.35.0 // indirect
github.com/coreos/vcontext v0.0.0-20220326205524-7fcaf69e7050 // indirect
github.com/daixiang0/gci v0.2.9 // indirect
2022-09-05 07:04:08 +03:00
github.com/davecgh/go-spew v1.1.1 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/denis-tingajkin/go-header v0.4.2 // indirect
github.com/dimchansky/utfbom v1.1.1 // indirect
github.com/dnephin/pflag v1.0.7 // indirect
github.com/docker/distribution v2.8.1+incompatible // indirect
github.com/docker/docker v20.10.14+incompatible // indirect
github.com/docker/docker-credential-helpers v0.6.4 // indirect
github.com/docker/go-connections v0.4.0 // indirect
github.com/docker/go-metrics v0.0.1 // indirect
github.com/docker/go-units v0.4.0 // indirect
github.com/esimonov/ifshort v1.0.2 // indirect
github.com/ettle/strcase v0.1.1 // indirect
github.com/evanphx/json-patch v5.6.0+incompatible // indirect
github.com/exponent-io/jsonpath v0.0.0-20210407135951-1de76d718b3f // indirect
github.com/fatih/color v1.12.0 // indirect
github.com/fatih/structtag v1.2.0 // indirect
2022-11-23 14:23:29 +03:00
github.com/fsnotify/fsnotify v1.5.4 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/fzipp/gocyclo v0.3.1 // indirect
github.com/go-critic/go-critic v0.5.6 // indirect
github.com/go-errors/errors v1.4.2 // indirect
github.com/go-openapi/errors v0.20.2 // indirect
github.com/go-openapi/jsonpointer v0.19.5 // indirect
github.com/go-openapi/jsonreference v0.19.6 // indirect
github.com/go-openapi/strfmt v0.21.2 // indirect
github.com/go-openapi/swag v0.21.1 // indirect
github.com/go-playground/locales v0.14.0 // indirect
github.com/go-playground/universal-translator v0.18.0 // indirect
github.com/go-playground/validator/v10 v10.10.1 // indirect
github.com/go-stack/stack v1.8.1 // indirect
2022-10-07 07:47:15 +03:00
github.com/go-task/slim-sprig v0.0.0-20210107165309-348f09dbbbc0 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/go-toolsmith/astcast v1.0.0 // indirect
github.com/go-toolsmith/astcopy v1.0.0 // indirect
github.com/go-toolsmith/astequal v1.0.0 // indirect
github.com/go-toolsmith/astfmt v1.0.0 // indirect
github.com/go-toolsmith/astp v1.0.0 // indirect
github.com/go-toolsmith/strparse v1.0.0 // indirect
github.com/go-toolsmith/typep v1.0.2 // indirect
github.com/go-xmlfmt/xmlfmt v0.0.0-20191208150333-d5b6f63a941b // indirect
2022-07-26 04:54:39 +03:00
github.com/gobuffalo/flect v0.2.5 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/gobwas/glob v0.2.3 // indirect
github.com/gofrs/flock v0.8.1 // indirect
github.com/gogo/protobuf v1.3.2 // indirect
github.com/golang-jwt/jwt/v4 v4.4.1 // indirect
github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect
github.com/golang/protobuf v1.5.2 // indirect
github.com/golangci/check v0.0.0-20180506172741-cfe4005ccda2 // indirect
github.com/golangci/dupl v0.0.0-20180902072040-3e9179ac440a // indirect
github.com/golangci/go-misc v0.0.0-20180628070357-927a3d87b613 // indirect
github.com/golangci/gofmt v0.0.0-20190930125516-244bba706f1a // indirect
github.com/golangci/lint-1 v0.0.0-20191013205115-297bf364a8e0 // indirect
github.com/golangci/maligned v0.0.0-20180506175553-b1d89398deca // indirect
github.com/golangci/misspell v0.3.5 // indirect
github.com/golangci/revgrep v0.0.0-20210208091834-cd28932614b5 // indirect
github.com/golangci/unconvert v0.0.0-20180507085042-28b1c447d1f4 // indirect
github.com/google/btree v1.0.1 // indirect
2022-11-23 14:23:29 +03:00
github.com/google/cel-go v0.10.2 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/google/gofuzz v1.2.0 // indirect
2022-10-07 07:47:15 +03:00
github.com/google/pprof v0.0.0-20210720184732-4bb14d4b1be1 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/google/renameio v1.0.1 // indirect
github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 // indirect
github.com/google/uuid v1.3.0 // indirect
github.com/googleapis/gax-go/v2 v2.2.0 // indirect
github.com/gophercloud/gophercloud v0.24.0 // indirect
github.com/gophercloud/utils v0.0.0-20220307143606-8e7800759d16 // indirect
github.com/gordonklaus/ineffassign v0.0.0-20210225214923-2e10b2664254 // indirect
github.com/gostaticanalysis/analysisutil v0.4.1 // indirect
github.com/gostaticanalysis/comment v1.4.1 // indirect
github.com/gostaticanalysis/forcetypeassert v0.0.0-20200621232751-01d4955beaa5 // indirect
github.com/gostaticanalysis/nilerr v0.1.1 // indirect
github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 // indirect
github.com/h2non/filetype v1.1.3 // indirect
github.com/hashicorp/errwrap v1.1.0 // indirect
github.com/hashicorp/go-cleanhttp v0.5.2 // indirect
github.com/hashicorp/go-multierror v1.1.1 // indirect
github.com/hashicorp/go-retryablehttp v0.7.0 // indirect
github.com/hashicorp/hcl v1.0.0 // indirect
github.com/imdario/mergo v0.3.12 // indirect
github.com/inconshreveable/mousetrap v1.0.0 // indirect
github.com/jgautheron/goconst v1.5.1 // indirect
github.com/jingyugao/rowserrcheck v1.1.0 // indirect
github.com/jirfag/go-printf-func-name v0.0.0-20200119135958-7558a9eaa5af // indirect
github.com/jmespath/go-jmespath v0.4.0 // indirect
github.com/jonboulle/clockwork v0.2.2 // indirect
github.com/josharian/intern v1.0.0 // indirect
github.com/json-iterator/go v1.1.12 // indirect
github.com/julz/importas v0.0.0-20210419104244-841f0c0fe66d // indirect
github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51 // indirect
github.com/kisielk/errcheck v1.6.0 // indirect
github.com/kisielk/gotool v1.0.0 // indirect
github.com/klauspost/compress v1.15.1 // indirect
github.com/klauspost/pgzip v1.2.5 // indirect
github.com/kulti/thelper v0.4.0 // indirect
github.com/kunwardeep/paralleltest v1.0.2 // indirect
github.com/kyoh86/exportloopref v0.1.8 // indirect
github.com/ldez/gomoddirectives v0.2.2 // indirect
github.com/ldez/tagliatelle v0.2.0 // indirect
github.com/leodido/go-urn v1.2.1 // indirect
github.com/libvirt/libvirt-go v7.4.0+incompatible // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de // indirect
github.com/magiconair/properties v1.8.5 // indirect
github.com/mailru/easyjson v0.7.7 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/maratori/testpackage v1.0.1 // indirect
github.com/matoous/godox v0.0.0-20210227103229-6504466cf951 // indirect
2022-01-25 18:53:07 +03:00
github.com/mattn/go-colorable v0.1.12 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/mattn/go-isatty v0.0.14 // indirect
github.com/mattn/go-runewidth v0.0.13 // indirect
github.com/matttproud/golang_protobuf_extensions v1.0.2-0.20181231171920-c182affec369 // indirect
github.com/mbilski/exhaustivestruct v1.2.0 // indirect
github.com/metal3-io/baremetal-operator v0.0.0-20220405082045-575f5c90718a // indirect
github.com/metal3-io/baremetal-operator/apis v0.0.0 // indirect
github.com/metal3-io/baremetal-operator/pkg/hardwareutils v0.0.0 // indirect
github.com/mgechev/dots v0.0.0-20190921121421-c36f7dcfbb81 // indirect
github.com/mgechev/revive v1.1.1 // indirect
github.com/mgutz/ansi v0.0.0-20200706080929-d51e80ef957d // indirect
2022-01-25 18:53:07 +03:00
github.com/miekg/pkcs11 v1.1.1 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/mitchellh/go-homedir v1.1.0 // indirect
github.com/mitchellh/go-wordwrap v1.0.1 // indirect
2022-01-25 18:53:07 +03:00
github.com/mitchellh/mapstructure v1.4.3 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/moby/spdystream v0.2.0 // indirect
github.com/moby/sys/mountinfo v0.6.0 // indirect
github.com/moby/term v0.0.0-20210619224110-3f7ff695adc6 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect
github.com/modern-go/reflect2 v1.0.2 // indirect
github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 // indirect
github.com/moricho/tparallel v0.2.1 // indirect
github.com/nakabonne/nestif v0.3.0 // indirect
github.com/nbutton23/zxcvbn-go v0.0.0-20210217022336-fa2cb2858354 // indirect
github.com/nishanths/exhaustive v0.2.3 // indirect
github.com/nishanths/predeclared v0.2.1 // indirect
github.com/oklog/ulid v1.3.1 // indirect
github.com/olekukonko/tablewriter v0.0.5 // indirect
github.com/opencontainers/go-digest v1.0.0 // indirect
github.com/opencontainers/image-spec v1.0.3-0.20211202193544-a5463b7f9c84 // indirect
github.com/opencontainers/runc v1.1.1 // indirect
github.com/opencontainers/runtime-spec v1.0.3-0.20210326190908-1c3f411f0417 // indirect
github.com/openshift/cloud-credential-operator v0.0.0-20220316185125-ed0612946f4b // indirect
2022-07-26 04:54:39 +03:00
github.com/openshift/cluster-api v0.0.0-20191129101638-b09907ac6668 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/openshift/cluster-api-provider-baremetal v0.0.0-20220218121658-fc0acaaec338 // indirect
2022-07-26 04:54:39 +03:00
github.com/openshift/cluster-api-provider-ibmcloud v0.0.1-0.20220201105455-8014e5e894b0 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/openshift/cluster-api-provider-libvirt v0.2.1-0.20191219173431-2336783d4603 // indirect
2022-07-26 04:54:39 +03:00
github.com/openshift/cluster-api-provider-ovirt v0.1.1-0.20220323121149-e3f2850dd519 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/ovirt/go-ovirt v0.0.0-20210308100159-ac0bcbc88d7c // indirect
github.com/pascaldekloe/name v0.0.0-20180628100202-0fd16699aae1 // indirect
github.com/pborman/uuid v1.2.1 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/pelletier/go-toml v1.9.3 // indirect
github.com/peterbourgon/diskv v2.0.1+incompatible // indirect
github.com/phayes/checkstyle v0.0.0-20170904204023-bfd46e6a821d // indirect
github.com/pmezard/go-difflib v1.0.0 // indirect
github.com/polyfloyd/go-errorlint v0.0.0-20210722154253-910bb7978349 // indirect
2021-05-19 16:08:23 +03:00
github.com/pquerna/cachecontrol v0.1.0 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/proglottis/gpgme v0.1.1 // indirect
github.com/prometheus/client_model v0.2.0 // indirect
2022-11-23 14:23:29 +03:00
github.com/prometheus/procfs v0.8.0 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/quasilyte/go-ruleguard v0.3.4 // indirect
2022-07-26 04:54:39 +03:00
github.com/quasilyte/regex/syntax v0.0.0-20200805063351-8f842688393c // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/rivo/uniseg v0.2.0 // indirect
github.com/russross/blackfriday v1.6.0 // indirect
github.com/ryancurrah/gomodguard v1.2.3 // indirect
github.com/ryanrolds/sqlclosecheck v0.3.0 // indirect
github.com/sanposhiho/wastedassign/v2 v2.0.6 // indirect
github.com/securego/gosec/v2 v2.8.1 // indirect
github.com/shazow/go-diff v0.0.0-20160112020656-b6b7b6733b8c // indirect
github.com/sonatard/noctx v0.0.1 // indirect
github.com/sourcegraph/go-diff v0.6.1 // indirect
github.com/spf13/afero v1.6.0 // indirect
github.com/spf13/cast v1.3.1 // indirect
2022-11-23 14:23:29 +03:00
github.com/spf13/cobra v1.5.0 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/spf13/jwalterweatherman v1.1.0 // indirect
github.com/spf13/pflag v1.0.6-0.20210604193023-d5e0c0615ace // indirect
github.com/spf13/viper v1.10.0 // indirect
github.com/ssgreg/nlreturn/v2 v2.1.0 // indirect
github.com/stefanberger/go-pkcs11uri v0.0.0-20201008174630-78d3cae3a980 // indirect
2022-11-23 14:23:29 +03:00
github.com/stoewer/go-strcase v1.2.0 // indirect
2022-07-26 04:54:39 +03:00
github.com/stretchr/objx v0.3.0 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/subosito/gotenv v1.2.0 // indirect
github.com/syndtr/gocapability v0.0.0-20200815063812-42c35b437635 // indirect
github.com/tdakkota/asciicheck v0.0.0-20200416200610-e657995f937b // indirect
github.com/tetafro/godot v1.4.9 // indirect
github.com/timakin/bodyclose v0.0.0-20200424151742-cb6215831a94 // indirect
github.com/tomarrell/wrapcheck/v2 v2.3.0 // indirect
github.com/tommy-muehle/go-mnd/v2 v2.4.0 // indirect
github.com/ulikunitz/xz v0.5.10 // indirect
github.com/ultraware/funlen v0.0.3 // indirect
github.com/ultraware/whitespace v0.0.4 // indirect
github.com/uudashr/gocognit v1.0.5 // indirect
github.com/vbatts/tar-split v0.11.2 // indirect
github.com/vbauerster/mpb/v7 v7.4.1 // indirect
github.com/vincent-petithory/dataurl v1.0.0 // indirect
github.com/vmware/govmomi v0.27.4 // indirect
github.com/xlab/treeprint v1.1.0 // indirect
github.com/yeya24/promlinter v0.1.0 // indirect
go.etcd.io/bbolt v1.3.6 // indirect
go.mongodb.org/mongo-driver v1.9.0 // indirect
go.mozilla.org/pkcs7 v0.0.0-20210826202110-33d05740a352 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
go.opencensus.io v0.23.0 // indirect
go.starlark.net v0.0.0-20220328144851-d1966c6b9fcd // indirect
2022-10-31 14:57:19 +03:00
golang.org/x/mod v0.6.0-dev.0.20220419223038-86c51ed26bb4 // indirect
golang.org/x/sys v0.1.0 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
golang.org/x/term v0.0.0-20210927222741-03fcf44c2211 // indirect
golang.org/x/time v0.0.0-20220224211638-0e9765cccd65 // indirect
gomodules.xyz/jsonpatch/v2 v2.2.0 // indirect
google.golang.org/api v0.74.0 // indirect
google.golang.org/appengine v1.6.7 // indirect
google.golang.org/genproto v0.0.0-20220405205423-9d709892a2bf // indirect
2022-11-23 14:23:29 +03:00
google.golang.org/grpc v1.49.0 // indirect
google.golang.org/protobuf v1.28.1 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
gopkg.in/go-playground/validator.v9 v9.31.0 // indirect
gopkg.in/inf.v0 v0.9.1 // indirect
gopkg.in/ini.v1 v1.66.4 // indirect
gopkg.in/square/go-jose.v2 v2.6.0 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
gopkg.in/yaml.v2 v2.4.0 // indirect
2022-10-31 14:57:19 +03:00
gopkg.in/yaml.v3 v3.0.1 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
honnef.co/go/tools v0.2.1 // indirect
2022-11-23 14:23:29 +03:00
k8s.io/apiserver v0.24.7 // indirect
k8s.io/component-base v0.24.7 // indirect
2022-07-26 04:54:39 +03:00
k8s.io/gengo v0.0.0-20211129171323-c02415ce4185 // indirect
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
k8s.io/klog v1.0.0 // indirect
k8s.io/klog/v2 v2.60.1 // indirect
k8s.io/kube-openapi v0.0.0-20220401212409-b28bf2818661 // indirect
k8s.io/utils v0.0.0-20220210201930-3a6ce19ff2f9 // indirect
mvdan.cc/gofumpt v0.1.1 // indirect
mvdan.cc/interfacer v0.0.0-20180901003855-c20040233aed // indirect
mvdan.cc/lint v0.0.0-20170908181259-adc824a0674b // indirect
mvdan.cc/unparam v0.0.0-20210104141923-aac4ce9116a7 // indirect
sigs.k8s.io/cluster-api-provider-aws v1.4.0 // indirect
sigs.k8s.io/cluster-api-provider-openstack v0.5.3 // indirect
sigs.k8s.io/json v0.0.0-20211208200746-9f7c6b3444d2 // indirect
sigs.k8s.io/kustomize/api v0.11.4 // indirect
sigs.k8s.io/kustomize/kyaml v0.13.6 // indirect
2022-01-25 18:53:07 +03:00
sigs.k8s.io/structured-merge-diff/v4 v4.2.1 // indirect
)
exclude (
2022-03-05 00:55:25 +03:00
github.com/containerd/containerd v1.2.10
// exclude github.com/containerd/containerd < 1.6.1, 1.5.10, 1.14.12 https://nvd.nist.gov/vuln/detail/CVE-2022-23648
github.com/containerd/containerd v1.2.7
github.com/containerd/containerd v1.3.0
github.com/containerd/containerd v1.3.2
github.com/containerd/containerd v1.4.1
github.com/containerd/containerd v1.4.3
github.com/containerd/containerd v1.4.4
github.com/containerd/containerd v1.4.9
github.com/containerd/containerd v1.5.0-beta.1
github.com/containerd/containerd v1.5.0-beta.3
github.com/containerd/containerd v1.5.0-beta.4
github.com/containerd/containerd v1.5.0-rc.0
github.com/containerd/containerd v1.5.1
github.com/containerd/containerd v1.5.2
github.com/containerd/containerd v1.5.7
github.com/containerd/containerd v1.5.9
// force use of go.etcd.io/bbolt
github.com/coreos/bbolt v1.3.0
github.com/coreos/bbolt v1.3.2
github.com/coreos/bbolt v1.3.3
github.com/etcd-io/bbolt v1.3.3
github.com/etcd-io/bbolt v1.3.6
2022-03-03 02:23:55 +03:00
// exclude github.com/golang/protobuf < 1.3.2 https://nvd.nist.gov/vuln/detail/CVE-2021-3121
github.com/gogo/protobuf v1.0.0
github.com/gogo/protobuf v1.1.1
github.com/gogo/protobuf v1.2.0
github.com/gogo/protobuf v1.2.1
github.com/gogo/protobuf v1.3.0
github.com/gogo/protobuf v1.3.1
// force use of golang.org/x/lint
github.com/golang/lint v0.0.0-20180702182130-06c8688daad7
// exclude github.com/golang/protobuf < 1.3.2 https://nvd.nist.gov/vuln/detail/CVE-2021-3121
github.com/golang/protobuf v1.0.0
github.com/golang/protobuf v1.1.1
github.com/golang/protobuf v1.2.0
github.com/golang/protobuf v1.2.1
github.com/golang/protobuf v1.3.0
github.com/golang/protobuf v1.3.1
// exclude github.com/hashicorp/vault < v1.5.1: https://nvd.nist.gov/vuln/detail/CVE-2020-16251
github.com/hashicorp/vault v0.10.4
github.com/hashicorp/vault v0.11.0
2021-03-25 22:00:37 +03:00
github.com/hashicorp/vault v0.11.0-beta1
github.com/hashicorp/vault v0.11.1
github.com/hashicorp/vault v0.11.2
github.com/hashicorp/vault v0.11.3
github.com/hashicorp/vault v0.11.4
github.com/hashicorp/vault v0.11.5
github.com/hashicorp/vault v0.11.6
github.com/hashicorp/vault v0.11.7
github.com/hashicorp/vault v0.11.8
2021-03-25 22:00:37 +03:00
github.com/hashicorp/vault v1.0.0
github.com/hashicorp/vault v1.0.0-beta1
github.com/hashicorp/vault v1.0.0-beta2
github.com/hashicorp/vault v1.0.0-rc1
github.com/hashicorp/vault v1.0.1
github.com/hashicorp/vault v1.0.2
github.com/hashicorp/vault v1.0.3
2021-03-25 22:00:37 +03:00
github.com/hashicorp/vault v1.1.0
github.com/hashicorp/vault v1.1.0-beta1
github.com/hashicorp/vault v1.1.0-beta2
github.com/hashicorp/vault v1.1.1
github.com/hashicorp/vault v1.1.2
github.com/hashicorp/vault v1.1.3
github.com/hashicorp/vault v1.1.4
github.com/hashicorp/vault v1.1.5
2021-03-25 22:00:37 +03:00
github.com/hashicorp/vault v1.2.0
github.com/hashicorp/vault v1.2.0-beta1
github.com/hashicorp/vault v1.2.0-beta2
github.com/hashicorp/vault v1.2.0-rc1
github.com/hashicorp/vault v1.2.1
github.com/hashicorp/vault v1.2.2
github.com/hashicorp/vault v1.2.3
github.com/hashicorp/vault v1.2.4
github.com/hashicorp/vault v1.3.0
github.com/hashicorp/vault v1.3.1
github.com/hashicorp/vault v1.3.2
github.com/hashicorp/vault v1.3.3
github.com/hashicorp/vault v1.3.4
github.com/hashicorp/vault v1.3.5
github.com/hashicorp/vault v1.3.6
github.com/hashicorp/vault v1.3.7
2021-03-25 22:00:37 +03:00
github.com/hashicorp/vault v1.4.0
github.com/hashicorp/vault v1.4.0-beta1
github.com/hashicorp/vault v1.4.0-beta2
github.com/hashicorp/vault v1.4.0-beta3
github.com/hashicorp/vault v1.4.0-rc1
github.com/hashicorp/vault v1.4.1
github.com/hashicorp/vault v1.4.2
github.com/hashicorp/vault v1.4.3
2021-03-25 22:00:37 +03:00
github.com/hashicorp/vault v1.5.0
github.com/hashicorp/vault v1.5.0-beta1
github.com/hashicorp/vault v1.5.0-beta2
github.com/hashicorp/vault v1.5.0-rc1
// force use of github.com/envoyproxy/protoc-gen-validate
github.com/lyft/protoc-gen-validate v0.0.13
// https://www.whitesourcesoftware.com/vulnerability-database/WS-2018-0594
github.com/satori/go.uuid v0.0.0
github.com/satori/uuid v0.0.0
// force use of cloud.google.com/go
google.golang.org/cloud v0.0.0-20151119220103-975617b05ea8
)
replace (
bitbucket.org/ww/goautoneg => github.com/munnerz/goautoneg v0.0.0-20120707110453-a547fc61f48d // 404 on bitbucket.org/ww/goautoneg
github.com/Unknwon/com => github.com/unknwon/com v1.0.1
github.com/clarketm/json => github.com/clarketm/json v1.15.7 // Later versions not compatible with Go 1.16
github.com/cockroachdb/sentry-go => github.com/getsentry/sentry-go v0.11.0
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/docker/spdystream => github.com/docker/spdystream v0.1.0
2021-03-03 21:45:39 +03:00
github.com/go-openapi/spec => github.com/go-openapi/spec v0.19.8
// Replace old GoGo Protobuf versions https://nvd.nist.gov/vuln/detail/CVE-2021-3121
github.com/gogo/protobuf => github.com/gogo/protobuf v1.3.2
github.com/mrnold/go-libnbd => github.com/mrnold/go-libnbd v1.4.1-cdi // v1.10.0 uses an invalid module path
github.com/operator-framework/operator-sdk => github.com/operator-framework/operator-sdk v0.19.4
2021-04-07 23:48:30 +03:00
// https://www.whitesourcesoftware.com/vulnerability-database/WS-2018-0594
github.com/satori/go.uuid => github.com/satori/go.uuid v1.2.1-0.20181028125025-b2ce2384e17b
github.com/satori/uuid => github.com/satori/uuid v1.2.1-0.20181028125025-b2ce2384e17b
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/spf13/pflag => github.com/spf13/pflag v1.0.6-0.20210604193023-d5e0c0615ace
github.com/spf13/viper => github.com/spf13/viper v1.7.1
2021-01-14 23:55:44 +03:00
github.com/terraform-providers/terraform-provider-aws => github.com/openshift/terraform-provider-aws v1.60.1-0.20200630224953-76d1fb4e5699
github.com/terraform-providers/terraform-provider-azurerm => github.com/openshift/terraform-provider-azurerm v1.40.1-0.20200707062554-97ea089cc12a
github.com/terraform-providers/terraform-provider-ignition/v2 => github.com/community-terraform-providers/terraform-provider-ignition/v2 v2.1.0
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
k8s.io/api => k8s.io/api v0.23.0
k8s.io/apiextensions-apiserver => k8s.io/apiextensions-apiserver v0.23.0
k8s.io/apimachinery => k8s.io/apimachinery v0.23.0
k8s.io/apiserver => k8s.io/apiserver v0.23.0
k8s.io/cli-runtime => k8s.io/cli-runtime v0.23.0
k8s.io/client-go => k8s.io/client-go v0.23.0
k8s.io/cloud-provider => k8s.io/cloud-provider v0.23.0
k8s.io/cluster-bootstrap => k8s.io/cluster-bootstrap v0.23.0
k8s.io/code-generator => k8s.io/code-generator v0.23.0
k8s.io/component-base => k8s.io/component-base v0.23.0
k8s.io/component-helpers => k8s.io/component-helpers v0.23.0
k8s.io/controller-manager => k8s.io/controller-manager v0.23.0
k8s.io/cri-api => k8s.io/cri-api v0.23.0
k8s.io/csi-translation-lib => k8s.io/csi-translation-lib v0.23.0
k8s.io/kube-aggregator => k8s.io/kube-aggregator v0.23.0
k8s.io/kube-controller-manager => k8s.io/kube-controller-manager v0.23.0
k8s.io/kube-proxy => k8s.io/kube-proxy v0.23.0
k8s.io/kube-scheduler => k8s.io/kube-scheduler v0.23.0
k8s.io/kubectl => k8s.io/kubectl v0.23.0
k8s.io/kubelet => k8s.io/kubelet v0.23.0
k8s.io/kubernetes => k8s.io/kubernetes v1.23.0
k8s.io/legacy-cloud-providers => k8s.io/legacy-cloud-providers v0.23.0
k8s.io/metrics => k8s.io/metrics v0.23.0
k8s.io/mount-utils => k8s.io/mount-utils v0.23.0
k8s.io/pod-security-admission => k8s.io/pod-security-admission v0.23.0
k8s.io/sample-apiserver => k8s.io/sample-apiserver v0.23.0
sigs.k8s.io/controller-runtime => sigs.k8s.io/controller-runtime v0.9.1
2021-04-01 14:16:22 +03:00
sigs.k8s.io/controller-tools => sigs.k8s.io/controller-tools v0.5.0
)
2021-05-19 14:24:33 +03:00
2021-05-19 16:08:23 +03:00
// Installer dependencies. Some of them are being used directly in the RP.
replace (
git.apache.org/thrift.git => github.com/apache/thrift v0.15.0
github.com/BurntSushi/toml => github.com/BurntSushi/toml v0.3.1
github.com/IBM-Cloud/terraform-provider-ibm => github.com/openshift/terraform-provider-ibm v1.26.2-openshift-2
github.com/c-bata/go-prompt => github.com/c-bata/go-prompt v0.2.5
github.com/circonus-labs/circonusllhist => github.com/openhistogram/circonusllhist v0.3.0
github.com/cockroachdb/errors => github.com/cockroachdb/errors v1.8.5
github.com/codahale/hdrhistogram => github.com/HdrHistogram/hdrhistogram-go v1.1.2
github.com/containernetworking/plugins => github.com/containernetworking/plugins v1.0.0
github.com/containers/image => github.com/containers/image v3.0.2+incompatible
github.com/coreos/bbolt => go.etcd.io/bbolt v1.3.6
github.com/coreos/fcct => github.com/coreos/butane v0.13.1
github.com/coreos/prometheus-operator => github.com/prometheus-operator/prometheus-operator v0.48.1
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/coreos/stream-metadata-go => github.com/coreos/stream-metadata-go v0.1.3
github.com/cortexproject/cortex => github.com/cortexproject/cortex v1.10.0
github.com/deislabs/oras => github.com/oras-project/oras v0.12.0
github.com/etcd-io/bbolt => go.etcd.io/bbolt v1.3.6
github.com/go-check/check => gopkg.in/check.v1 v0.0.0-20201130134442-10cb98267c6c
github.com/go-logr/logr => github.com/go-logr/logr v0.4.0
github.com/golang/lint => golang.org/x/lint v0.0.0-20210508222113-6edffad5e616
github.com/google/tcpproxy => inet.af/tcpproxy v0.0.0-20210824174053-2e577fef49e2
github.com/googleapis/gnostic => github.com/google/gnostic v0.5.5
github.com/h2non/filetype => github.com/h2non/filetype v1.1.1
github.com/hashicorp/vault => github.com/hasicorp/vault v1.8.7
github.com/influxdata/flux => github.com/influxdata/flux v0.132.0
github.com/knq/sysutil => github.com/chromedp/sysutil v1.0.0
github.com/kshvakov/clickhouse => github.com/ClickHouse/clickhouse-go v1.4.9
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/metal3-io/baremetal-operator => github.com/openshift/baremetal-operator v0.0.0-20211201170610-92ffa60c683d // Use OpenShift fork
github.com/metal3-io/baremetal-operator/apis => github.com/openshift/baremetal-operator/apis v0.0.0-20211201170610-92ffa60c683d // Use OpenShift fork
github.com/metal3-io/baremetal-operator/pkg/hardwareutils => github.com/openshift/baremetal-operator/pkg/hardwareutils v0.0.0-20211201170610-92ffa60c683d // Use OpenShift fork
github.com/metal3-io/cluster-api-provider-baremetal => github.com/openshift/cluster-api-provider-baremetal v0.0.0-20190821174549-a2a477909c1d // Pin OpenShift fork
github.com/mholt/certmagic => github.com/caddyserver/certmagic v0.15.0
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/openshift/api => github.com/openshift/api v0.0.0-20220124143425-d74727069f6f
github.com/openshift/client-go => github.com/openshift/client-go v0.0.0-20211209144617-7385dd6338e3
2021-05-19 16:08:23 +03:00
github.com/openshift/cloud-credential-operator => github.com/openshift/cloud-credential-operator v0.0.0-20200316201045-d10080b52c9e
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/openshift/cluster-api-provider-gcp => github.com/openshift/cluster-api-provider-gcp v0.0.1-0.20211123160814-0d569513f9fa
github.com/openshift/cluster-api-provider-ibmcloud => github.com/openshift/cluster-api-provider-ibmcloud v0.0.0-20211008100740-4d7907adbd6b
github.com/openshift/cluster-api-provider-kubevirt => github.com/openshift/cluster-api-provider-kubevirt v0.0.0-20210719100556-9b8bc3666720
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
github.com/openshift/cluster-api-provider-libvirt => github.com/openshift/cluster-api-provider-libvirt v0.2.1-0.20191219173431-2336783d4603
github.com/openshift/cluster-api-provider-ovirt => github.com/openshift/cluster-api-provider-ovirt v0.1.1-0.20211215231458-35ce9aafee1f
github.com/openshift/console-operator => github.com/openshift/console-operator v0.0.0-20220318130441-e44516b9c315
github.com/openshift/installer => github.com/jewzaam/installer-aro v0.9.0-master.0.20220524230743-7e2aa7a0cc1a
github.com/openshift/library-go => github.com/openshift/library-go v0.0.0-20220303081124-fb4e7a2872f0
github.com/openshift/machine-api-operator => github.com/openshift/machine-api-operator v0.2.1-0.20220124104622-668c5b52b104
github.com/openshift/machine-config-operator => github.com/openshift/machine-config-operator v0.0.1-0.20220319215057-e6ba00b88555
github.com/oras-project/oras-go => oras.land/oras-go v0.4.0
2021-05-19 16:08:23 +03:00
github.com/ovirt/go-ovirt => github.com/ovirt/go-ovirt v0.0.0-20210112072624-e4d3b104de71
github.com/prometheus/prometheus => github.com/prometheus/prometheus v1.8.2-0.20210421143221-52df5ef7a3be
github.com/terraform-providers/terraform-provider-azuread => github.com/hashicorp/terraform-provider-azuread v1.6.0
github.com/thanos-io/thanos => github.com/thanos-io/thanos v0.23.0
github.com/uber-go/atomic => go.uber.org/atomic v1.9.0
github.com/uber/athenadriver => github.com/uber/athenadriver v1.1.10
github.com/willf/bitset => github.com/bits-and-blooms/bitset v1.2.1
google.golang.org/cloud => cloud.google.com/go v0.97.0
google.golang.org/grpc => google.golang.org/grpc v1.40.0
k8s.io/klog/v2 => k8s.io/klog/v2 v2.8.0
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
k8s.io/kube-openapi => k8s.io/kube-openapi v0.0.0-20211115234752-e816edb12b65
k8s.io/kube-state-metrics => k8s.io/kube-state-metrics v1.9.7
mvdan.cc/unparam => mvdan.cc/unparam v0.0.0-20211002133954-f839ab2b2b11
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
sigs.k8s.io/cluster-api-provider-aws => github.com/openshift/cluster-api-provider-aws v0.2.1-0.20210121023454-5ffc5f422a80
sigs.k8s.io/cluster-api-provider-azure => github.com/openshift/cluster-api-provider-azure v0.1.0-alpha.3.0.20210626224711-5d94c794092f
sigs.k8s.io/cluster-api-provider-openstack => github.com/openshift/cluster-api-provider-openstack v0.0.0-20211111204942-611d320170af
//sigs.k8s.io/controller-tools => sigs.k8s.io/controller-tools v0.3.1-0.20200617211605-651903477185
sigs.k8s.io/kustomize/api => sigs.k8s.io/kustomize/api v0.11.2
sigs.k8s.io/kustomize/kyaml => sigs.k8s.io/kustomize/kyaml v0.13.3
2021-05-19 16:08:23 +03:00
sigs.k8s.io/structured-merge-diff => sigs.k8s.io/structured-merge-diff v1.0.1-0.20191108220359-b1b620dd3f06
Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Initial files + dependencies for the react-fluent portal Initial POC for portal UI Finished front end API for cluster information Co-authored-by: Brett Embery <bembery@redhat.com> Adding cluster detail pane Co-authored-by: Ellis Johnson <elljohns@redhat.com> Format tsx source Add cluster detail nav + tweaks Co-authored-by: Ellis Johnson <elljohns@redhat.com> Cluster detail MVP Co-authored-by: Brett Embery <bembery@redhat.com> bump deps fixes update deps cleanups and style improvements for the portal, as well as a new copy resource ID button update package deps Added base eslint config Fixed linter errors in SRE Portal Added linter step for e2e pipeline Reverting package-lock json to appease PR testing Another attempt to test admin portal linting in e2e pipeline Another fix for e2e admin portal linting Yet another attempt Reordered e2e jobs Added fix to commands Modifying linting settings to try and working e2e pipeline More config changes More changes Modified eslintrc Modified eslintrc Perform npm install before running container Debugging Trying npm install as a seperate task Moved admin portal lint from e2e pipeline to ci pipeline Fixed formatting Fixed formatting Fixed formatting Fixed image name Added dockerfile for SRE Portal linting Using new docker image in ADO CI pipeline Removed old dockerfile and modified package.json Split portal into v1 and v2 Modified portal backend to allow v1 and v2 portals to run at the same time Modified makefile to make both v1 and v2 portal Added option to change portal hostname locally whether wanting to run dev server or compiled build code Created initial selenium script Fixed linter Added documentation for new admin portal Added makefile command for linting admin portal Remove accident commit Refactored portal backend code Renamed temp to template in portal code Modified documentation to explain NO_NPM env var Renamed portal v1 compilation directory from dist to build and fixed TODOs in typescript Fixed SSHModal indexing Fixed SSHModal indexing Commit generated bindata code Added vscode folders to gitignore Made minor changes based on review feedback Added conditional statements for linting Fixed booleans Added vm image to first stage Modified powershell to bash Made small changes based on review feedback Update Makefile Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Update docs/admin-portal.md Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Small documentation change Small ci fix Small ci fix Small ci fix Small ci fix Still fixing CI Still fixing CI Still fixing CI Still fixing CI Fix CI again Fix CI again Fix CI again Fix CI again Fix CI again Removing conditional linting and moving to future PR Remove stage from CI yaml to pass github check Fixed off by one error with SSH in admin portal First 3 e2e test cases complete Test image pull Rewrote first test in golang on e2e pipeline Added second test Fixed tests for CT Added 2 more tests Added 1 more test and fixed others Finished initial e2e tests Fixed linting errors Fixed validation and linting Still trying to fix linting issues Moved cookie generation back out to hack file and refactored test Fixed linting of dot imports Remove test focus for e2e Fixed potential infinite for loop Removed test command from makefile Removed test pipeline step Fixed vendoring removals Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Fixed dodgy e2e test Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. Testing test in isolation refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Added more checks for cluster panel test to figure out test failure enable reconciling azuresubnets/NSGs by default refector e2e for removing dependency. Update 2 removed old code. make test to fail on getting error. Expect(err).NotTo(HaveOccurred()) Formating done White-spaces removed. handle the use of the AddressPrefixes field alongside AddressPrefix improved ValidateCIDRRanges test add vnet names to help with debugging if needed in the future comment improvement Bump follow-redirects from 1.14.0 to 1.14.7 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.0 to 1.14.7. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.0...v1.14.7) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Store downloaded cert only when it differs When systemd downloader downloads fresh certificate check whether it differs from the stored one. Replace old one with fresh when there is a difference. Signed-off-by: Petr Kotas <pkotas@redhat.com> Restart mdm service on cert change Forces MDM container to pick up changed certificate. Signed-off-by: Petr Kotas <pkotas@redhat.com> doc: Document fp cert rotation Add doc file with information how the first party certificate is rotated in the RP and on the host VM. Signed-off-by: Petr Kotas <pkotas@redhat.com> Replace artifacts with direct code checkout Replaces configuration fetching via build pipeline with direct code checkout. Signed-off-by: Petr Kotas <pkotas@redhat.com> Update .pipelines/int-release.yml Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> provide the ability to specify an overridden fluentbit image in operator feature flags Download aro deployer from tagged image Pull aro deployer from tagged container instead of pipeline artifact. Signed-off-by: Petr Kotas <pkotas@redhat.com> Add deploy pipelines using tag Add new pipelines using tagged deployment Signed-off-by: Petr Kotas <pkotas@redhat.com> Set XDG_RUNTIME_DIR explicitly on CI VMs Add tagged aro image Add annotated tag build and push into makefile. Without annotation, the TAG is empty and action is not performed. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build and push tagged aro image into ACR When annotated TAG is not set the new step fails. Otherwise it builds the tagged image and pushes it to the ACR. Signed-off-by: Petr Kotas <pkotas@redhat.com> Build release on tag When CI started from tag build image and push to registry. Extract annotation from the tag and use it as summary for changelog. Automated summary is extracted from commits titles. Signed-off-by: Petr Kotas <pkotas@redhat.com> mdm/mdsd++ make generate Revert "[PIPELINES 4] Create release based on annotated git tag" Fix: Broken pull path The original path is not working as it is blocked for writing, Using the pipeline default instead Signed-off-by: Petr Kotas <pkotas@redhat.com> Fix: Broken checkout code path The checkout behaves differently when checking out single repository. It checkout to /s Signed-off-by: Petr Kotas <pkotas@redhat.com> Update prod pipeline params to be consistent Enable SBOM on all OneBranch pipelines Fixing typo in paths Add Documentation and Scripts for ARO Monitor Metric testing Fix typo Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Handle cleanup of spawned processes. Clarify a few things in the procdure. Add example script to directly inject test data Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" Fix: Remove build to run after e2e Signed-off-by: Petr Kotas <pkotas@redhat.com> Bump nanoid from 3.1.22 to 3.2.0 in /portal Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.22 to 3.2.0. - [Release notes](https://github.com/ai/nanoid/releases) - [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md) - [Commits](https://github.com/ai/nanoid/compare/3.1.22...3.2.0) --- updated-dependencies: - dependency-name: nanoid dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Add uaenorth to non-zonal regions imageconfig controller Fixing bug where incorrect ACR domain name was being generated added doc for cert rotation Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Vendor installer release 4.9 This also forces the RP from Go 1.14 to Go 1.16. Aside from requiring OCP 4.9 / Kubernetes 1.22 modules, the other go.mod changes are all manual workarounds from failed "make vendor" runs. Automated updates from "make vendor" Alter client-gen command to stay within repo The way this is written seems to assume the ARO-RP repo is cloned under the user's $GOPATH tree. That's not where I typically clone git repos for development. Use relative paths in the client-gen command and arguments to stay within the ARO-RP git repo. Automated updates from "make generate" Set InstallStream to OCP 4.9.8 Automated updates from "make discoverycache" pipelines: Demand agents with go-1.16 capability for CI/E2E Update documentation for Go 1.16 and installer 4.9 Fix: Remove the wrong git pull path Removes the wrong git pull path for ADO RP-config Removes unused parameter Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: Add go1.16 requirement to run pipelines With addition of 4.9 release, the go build have to run with go1.16 Signed-off-by: Petr Kotas <pkotas@redhat.com> Add geneva action to reconcile a failed NIC Suppress stderr within Makefile command Do not overwrite FIPs environment variable in CI VMs fix: fix service connection to the github existing service connection does not meet requirement for the github release Signed-off-by: Petr Kotas <pkotas@redhat.com> ADO Pipelines make no sense Ensure TAG environment var is consistent case Incorrect quoting on variables in pipeline Clean up debug print statement in pipelines Add INT/Prod variable group requirements Update correct directory path for pipeline template files Update release tag pipeline parameters Vendor updated autorest adal to fix nil pointer exception in MSI add fl to owners :-) Fix: use the correct variable syntax for updated variables in pipelines Bump 4.9.8 to 4.9.9 as it contains a bugfix that prevents cluster creation success Vendor openshift installer carry patch Bump golang version to 1.16 in CI VMs Fix wrongly updated parameters and variables in prod release Feedback follow up on image config controller Use INT E2E Creds in Prod pipeline as we pull from the INT image registry and spin up our resources in our INT sub clean temporary gomock folders (#1912) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> fix 2 cred scan findings by adding suppression settings (#1960) add tsaoptions json file, enable tsa in build rp official pipeline (#1959) chore: removed logging onebranch pipelines files from aro-rp repo (#1942) quick fixes in docs (#1956) Removes unneeded field (#1962) Updated linux container image for build (#1964) Updating go-toolset tag to 1.16.12 (#1965) Bump follow-redirects from 1.14.7 to 1.14.8 in /portal Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.7 to 1.14.8. - [Release notes](https://github.com/follow-redirects/follow-redirects/releases) - [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.14.7...v1.14.8) --- updated-dependencies: - dependency-name: follow-redirects dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> add fips validation scripts and ci step drop net_raw and make generate Adding norwaywest to deploy from tag ALL regions Pipeline. (#1968) Include variable groups for prod single region release (#1957) Add Central US EUAP to nonZonalRegions (#1927) remove network acceleration due to issues discovered reapply the primary tag make generate Add metric gauge for nohost present on request to gateway Fix net_raw caps, make generate (#1971) Refactors operator requeues * Adds the clarifying comment on requeues into the checker controller * Removes `Requeue: true` in places where we use `RequeueAfter` as it is has no effect. add a field to indicate spotInstances in node.conditions metric (#1928) Bump url-parse from 1.5.3 to 1.5.7 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.7. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.7) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> docs: add cleaner info to shared env docs add westus3 to pipeline manifests add additional logging to redeploy to help understand state when this job fails in e2e Re-enable Egress Lockdown Enable egress lockdown feature by default on new clusters while also allowing current clusters to be admin-upgraded with the new feature Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> fix: use the tag/commit as the aro version ARO uses both tags and commits as its version. The commits are used for the development scenario, tags are used when building and deploing to production. add: copy ARO iamge to integration Signed-off-by: Petr Kotas <petr@kotas.tech> add: release pipeline documentation Signed-off-by: Petr Kotas <petr@kotas.tech> fix: HTTP 500 from "List cluster Azure resource" Geneva Action for unknown resource types (#1978) * If don't have an apiVersion defined for a resource, then skip over it instead of returning an error. * Reword the comment. * Double quote the resource type in the log warning message. Co-authored-by: Mikalai Radchuk <509198+m1kola@users.noreply.github.com> add operator storage acc and endpoints reconcilers operator tests storageacc handling for install/update generate vendor review feedback Add dev env rules exception Comply with the Authorizer changes Fix tests Fix merge conflicts Add operator flags Fix tests Change operator flags Addressing feedback generate Operator flag tests Addressing feedback FIx update cluster spec Add an Operator controller for Managed Upgrade Operator add MUO deployment manifests run go generate add a mocks directory in the operator make dynamichelper produce less spurious changes for MUO fix: move int mirroring to separate pipelines integration requires it own set of credentials, this can only by provided in a separate pipeline Signed-off-by: Petr Kotas <pkotas@redhat.com> fix: provide the correct dependent pipeline (#1982) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Remove unused parameter fix: replace parameter with variable (#1984) Signed-off-by: Petr Kotas <pkotas@redhat.com> Update mirror-aro-to-int.yml for Azure Pipelines Fix typo Cleans up unused args in `muo.NewReconciler` Bump url-parse from 1.5.7 to 1.5.10 in /portal Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.5.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Removes a explicit `gomock.Eq()` matcher calls (#1983) `gomock.Eq()` is a default matcher in gomock so it doesn't have to be explicitly called in these cases Docs: Set GOPATH (#1987) - A few developers on various OS flavors have seen make generate fail after the upgrade to golang 1.16 due to client-gen updates. This appears to fix. Adds extra fields to the PreviewFeature CRD Adds the controller implementation It currently implements only one feature: NSG flow logs preview feature controller and NSG flow log feature implementation L series support - RP changes (#1751) * add L-series SKUs to internal, admin, validate api * make client Add SKU availability and restriction checks to dynamic validation (#1790) * add sku filtering and restriction checks * add install-time instance validation Minor ARO operator refactoring * Gets rid of exported constants like `ENABLED` where exported constants are not required * Gets rid of constant concatenations like `CONFIG_NAMESPACE + ".enabled"` to make search easier * Removes unnecessary `Copy` method of `OperatorFlags` stuct as well as package level `DefaultOperatorFlags` variable. Introduces `DefaultOperatorFlags()` instead. Removing call to listByResourceGroup due to flakyness in the Azure API add validate-fips step into onebranch build rp template exclude vuln protobuf exclude vulnerable containerd versions Changed CloudErrorCodes from vars to consts. (#1997) Co-authored-by: Jeremy Facchetti <jfacchet@jfacchet.remote.csb> Add sourcebranchname to build_tag (#1996) adding a way to pass additional flags to E2E tests (#1998) Fix typo in deploy-development-rp doc (#2005) Better documentation support for multiple envs (#1932) - Now there are two env files: standard, and int-like files - Instructions modified for int envs to create the new file and source it - Fixed a small typo in the instructions that was being masked by indentation vendor: fake operator client Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: add autosizednodes reconciler Introduce autosizednodes reconciler which watches aro cluster object feature flags for ReconcileAutoSizedNodes. When feature flag is present new KubeletConfig is created enabling the AutoSizingReserver feature which auto computes the system reserved for nodes. feature: add aro cluster to workaround Adds aro cluster instance to IsRequires check to allow for feature flags checking. Signed-off-by: Petr Kotas <pkotas@redhat.com> feature: disable systemreserved when autosizednodes enabled Signed-off-by: Petr Kotas <pkotas@redhat.com> Avoid AdminUpdate panic when Nodes are down (#1972) * Skip ensureAROOperator and aroDeploymentReady when the IngressProfiles data is missing, esp after cluster VM restarts as part of the update call * Refactor Cluster Manager code to make ensureAROOperator code testable * Add unit test for ensureAROOperator code Co-authored-by: Ulrich Schlueter <uschlueter@redhat.com> update go-cosmosdb version to incorporate the latest change (#2006) Filter out unwanted data from azure list geneva action (#1969) * filter our Microsoft.Compute/snapshots from azure list geneva action * change filter input for test Doc to create & push ARO Operator image to ACR/Quay (#1888) * Doc to create/push AROOperator image ACR/Quay A document on How to create & publish ARO Operator image to ACR/Quay. Added alternative to go get command (#2015) Update Makefile (#2020) The ARO-RP returns special characters in color encoding special character, which is not decoded as of now. This change removes the color encoding characters by default in e2e tests Update node-selector on muo namespace Dockerfile for MUO image (#1993) Update OB Build Pipeline to Pass Build Tag as Var (#2011) * adding release_tag functionality to support releasing by tag or commit add managed upgrade operator configuration settings and connected MUO if allowed and a pullsecret exists add muo config yaml add openshift-azure-logging to the ignored namespaces run go generate Fix VM Redeploy Test Flake - Removing test to check k8s Events for Node readiness - Adding test for Azure VM readiness (power state) - Adding test for Linux Kernel uptime to guarantee reboot disable ipv6 router advertisements on rp/gateway vmss Install python3 on RP and gateway VMs make pullspec an optional flag add enabled and managed by default add e2e test Bump minimist from 1.2.5 to 1.2.6 in /portal Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> cleanup: proxy now uses idiomatic waitgroup. cleanup: removed useless anonymous function definition. add containers_image_openpgp tag (#2032) Change secrets-update to allow subsequent updates (#2038) Co-authored-by: Nont <nthanonchai@microsoft.com> add containers_image_openpgp everywhere add controller into operator for machine health check (#1950) * add worker only controller with operator for machine health check * align mhc node selector pattern with osd Create 2022-04-01 API (#1876) check for default ingressIP when ingressProfiles > 1 (#2021) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Skip Linux AZ Sec Pack policies from running on VMSS creation (#2041) Admin Portal v2 (#2019) Add in sre portal v2, still default to v1 Co-authored-by: Amber Brown <ambrown@redhat.com> Co-authored-by: Brett Embery <bembery@redhat.com> Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Bump minimist from 1.2.5 to 1.2.6 in /portal/v2 (#2043) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> added changes to make local e2e test work/ update doc (#2036) * added changes to make local e2e test work/ update doc updated operator README to include instructions for running the ARO operator locally for a private cluster (#2045) Fix off by one error when truncating name Now it truncates to 14 instead of 15. the corresponding arm templates truncate to 15. Refactors createOrUpdateRouterIPFromCluster Make it reuse isIngressProfileAvailable to check IngressProfile Adds an extra case into TestAroDeploymentReady Updates dev env docs * Removes mention of Python virtualenv as it comes by default with Python 3 * Updates macOS docs to make sure that steps work for Intel and ARM macs * Markdown formatting fixes give /tmp a bit more room for when the CI VM gets busy refactor+test: refactored some functions to test refactored tests added license to test file added err check on validateProxyResquest made the errors more explicit fixed typo in function name removed useless test case renamed oddly named metrics.Interface to Emitter update codeowners renamed github username updated path to quota file (#2058) refactor/add-test : refactored linkid and gateway to add tests (#2013) Enable first basic linters in ARO (#2060) * Enable first basic linters in ARO * Remove modules-download-mode from the linter run config Commit to allow password auth for VMSS jit access (#2027) * Commit to allow password auth for VMSS jit access fix: now uses renamed interface metricsEmitter fix issues with linting new test files added doc.go for imgconfig controller (#2064) Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Revert 2027: Commit to allow password auth for VMSS jit access Add logic to reconcile failed Nic on az aro delete Co-authored-by: Ben Vesel <bennerv@users.noreply.github.com> Update pull secret references from cloud.redhat.com to cloud.openshift.com (#2084) Enables go fmt simplify (#2081) update reference to cloud.redhat.com in README file (#2085) ensure apiserverready check redesigned the quota computation to something understandable (#2059) Bump 4.9 install image to latest stable 4.9.28 to address etcd split brain issue Fail MUO test if we expect an error but don't get one Bump fluentbit, mdm, and mdsd images to mitigate P0/P1s Bump async from 2.6.3 to 2.6.4 in /portal/v2 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Update the secret rotate time to 7 days during RP deploy (#2051) Remove dead mirror code referencing 4.3 version which isn't mirrored (#2092) add MTU to the internal OCP Document make generate before mock added unit tests for two new functions fix import order remove trailing spaces make validate-go wants to add trailing lines again found/fixed trailing new line add new line at end of test file added admin update method to adminupdate tests newlinw fixed unit test issue add helper method Improve comment gofmt Remove ACR Image Override (#2090) added stylecheck and moved golangci-lint to a github action (#2083) * enabled github action instead of running from ADO * fixed style * fixed some style fixed styling fixed failing tests because of case on errs Small updates to shared rp docs (#2079) "note" syntax adjustments Small updates to shared rp docs from working sessions added note related to gwy keyvault not being in dev Update docs/prepare-a-shared-rp-development-environment.md Language adjustment. Committing syntax change per Caden's suggestion. Co-Authored-By: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Co-authored-by: Caden Marchese <56140267+cadenmarchese@users.noreply.github.com> Additional gateway tests (#2062) * Add coverage for pkg/gateway. Gateway creation now fails fast when env properties are missing. * refactor large test into multiple test cases Move gateway fluentbit to container Bump async from 2.6.3 to 2.6.4 in /portal/v1 Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> set MDSD_MSGPACK_SORT_COLUMNS to perf column sorting on MDSD side and try to avoid hitting max schema count (#2095) Remove mwoodson from codeowners (#2106) Updated FIPs e2e test for 2022-04-01 API Development subscription migration prepare for dns migration Signed-off-by: Karan.Magdani <kmagdani@redhat.com> Update az cli extension to use api v2022_04_01 (#2042) * Bumping az aro extenion api version to v2022_04_01 * Adding new command flags and data structures to az aro create * linting Update cluster Update pkg/util/cluster/cluster.go Co-authored-by: Ben Vesel <10840174+bennerv@users.noreply.github.com> Better err handling to customer remove installconfig dependency from deploystorage Remove unnecessary to.StringPtr usages Fixing exception handling for missing subnet (#2117) * Fixing exception handling for missing subnet * use isinstance * Another err.message fix Added a new function for a hardcoded filter of namespaces (#1994) Added unit test for the makeURLSegments function of dynamichelper (#2031) add minor version Master resize (#1889) * master resize GA move arm template deploy to util use the ARM deploytemplate code directly in pkg/cluster Add David Newman to CODEOWNERS il5 series support, vm.go improvements and tests (#2086) Add improvements to `deploy-full-rp-service-in-dev.md` doc (#2048) * Add improvements to full rp service doc * Update docs/deploy-full-rp-service-in-dev.md Co-authored-by: Spencer Amann <samann@redhat.com> NSG controller - reconcile nil NSG (#2116) * adding test case for NSGs = nil * Adding handling of empty NSG Fix deleteNic when the nic is in failed provisioning state Add documentation outlining our keyvaults, certificates, and secrets Provide clearer error for a particular type of PUCM failure Instead of "subnet ID "" has incorrect length", catch the error earlier and provide a clearer "lastAdminUpdateError" message. This particular PUCM failure occurs when a machineset object fails to decode during cluster document enriching. increase the timeout to 10 minutes, since a rebuild can trigger the timeout Vendor installer release 4.10 Switches to go.1.17, OCP 4.10, and Kubernetes 1.23 modules. Automated updates from "make generate" Set default InstallStream to OCP 4.10.15 Automated updates from "make discoverycache". pipelines: Require agents with go-1.17 capability for CI/E2E Update documentation for Go 1.17 and installer 4.10 Switch from the azureprovider to the new machinev1.AzureMachineProviderSpec machine API * Due to the move of the AzureMachineProviderSpec into the openshift/api we need to marshal the existing clusters machine provider spec into the new struct. * Switches tests to use the new machine API struct. Ref: https://github.com/openshift/installer/commit/f9725ddd9496b999ac06bd0343791d7c50b00d48 Switch to building with golang 1.17 Switch maoclient -> machineclient and maofake -> machinefake gofmt: add "go:build e2e" Switch to using the ubi8 go-toolset for building. Add additional values to CloudError and Cluster Operation Logs (#2094) * Added additional values to CloudError * Update pkg/api/error.go Co-authored-by: Weinong Wang <weinong@outlook.com> * Add details for cluster logs in terminal state * Fixed issue with logging clusterResult * Changed to generic name, add String() func * Update logging comments Co-authored-by: Weinong Wang <weinong@outlook.com> * Add prefix to cloudErrorMessage String() * Add additional json monikers * Fix bug with resultType output * Defined CloudErrorCategory string type * Empty-Commit to retrigger test * Shift logs, remove code for next PR * Added log fields, removed category * Shift resultType to Logs * Empty-Commit to retrigger test * Remove all error changes * Update openshiftcluster.go change logs to lowercase Co-authored-by: BCarvalheira <bcarvalheira@microsoft.com> Co-authored-by: Weinong Wang <weinong@outlook.com> Improved the unit test coverage for the merge function of dynamichelper Fixed the validate golang code errors in the pipeline Updated the code based on Mikalai's feedback Fixed a go validation error added yaml lint (#2132) * added yaml lint * updated the doc Build the MSFT Go fips enabled code and tag the CI Agent as having Go 1.17. Bump to the latest Microsoft Golang FIPS release. Updated bindata. Switch back to the vanilla ci vmss names. Revert the address prefix and keyvault name changes necessary to deploy to CI. Switch back to using the RHEL go-toolset now that 8.6 is available on Azure. Double the OS Disk size. Increase the disk size of the CI vmss to 200GB. Updated bindata and move disk size to the correct vmss spec. Add an option to send metrics via UDP instead of Unix Domain Sockets (#2074) replace allowOCM flag with a forceLocalOnly flag upgrade image to b4 when mhc is managed create an alert for frequent remediation (#2123) allow overriding the operator version in the admin API (#2134) Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) update mdm/mdsd Add new ARO regions to pipelines - australiacentral - australiacentral2 - swedencentral test for infra ID generation this does not need installconfig, and so can be moved upwards in the install replace it with a vendored version, so that we don't need to utilise the installer portion validate apimachinery rand as utilrand split ensuregraph into applying customisations and then saving it to the storage account. if we use the vanilla installer, we will likely still need to save the graph (after fetching it from hive) but we will not change things inside of it like currently. refactored muo to extract deployer (#2122) removed go-bindata from pkg/operator (#2119) add: Getpodlogs kubeaction api (#1885) Migrate from AD to MS Graph Also changed the AADManager so that it only returns values instead of the data structure. This hides the implementation details so that in the future if MSAL changes the internal representation, any required changes will be contained within the class (vs. right now custom.py has to be changed accordingly). fixed conflict created when moving to the new library (#2150) Bump eventsource from 1.1.0 to 1.1.1 in /portal/v2 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Bump eventsource from 1.1.0 to 1.1.1 in /portal/v1 Bumps [eventsource](https://github.com/EventSource/eventsource) from 1.1.0 to 1.1.1. - [Release notes](https://github.com/EventSource/eventsource/releases) - [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md) - [Commits](https://github.com/EventSource/eventsource/compare/v1.1.0...v1.1.1) --- updated-dependencies: - dependency-name: eventsource dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> clean up of validate import, now uses a yaml file for maintainability (#2136) Updated portal bindata create lint-go script and call it from Makefile (#2118) Co-authored-by: Jeremy Facchetti <facchettos@gmail.com> Add name length validation on ARO clusters for non-zonal regions Truncate cluster names to 19 char in e2e pipelines Typo in pipeline script Added cookie as part of test and added extra error output Seperated image pull and container start for selenium Fixing up docker command
2022-05-05 04:11:23 +03:00
sourcegraph.com/sourcegraph/go-diff => github.com/sourcegraph/go-diff v0.5.1
vbom.ml/util => github.com/fvbommel/util v0.0.3
2021-05-19 16:08:23 +03:00
)
2022-07-26 04:54:39 +03:00
replace (
github.com/openshift/hive => github.com/openshift/hive v1.1.17-0.20220719141355-c63c9b0281d8
github.com/openshift/hive/apis => github.com/openshift/hive/apis v0.0.0-20220719141355-c63c9b0281d8
)