Граф коммитов

127 Коммитов

Автор SHA1 Сообщение Дата
Or Raz 49eff97aff
Initial start of RP int automation (#3670)
* Initial start of RP int automation
Creating new pipeline with new templates for some of the steps

* Rename files and fetch image tags for ACR images
Remove the int/integration phrase from file names and directories, add bash script for fetching the image tag from pkg/util/version/const.go, and remove the clenup subscription template

* Get default image, tag and import it to ACR
Add new functions and scripts to get the images tag and set it nicely for importing and copying images by digest (e.g., for the fluenbit image).

* Add validation commands for downloading secrets and rp-dev-config creation
Check created directory and three config files after downloading the secrets from the shared RP config, and validate that a new rp-dev-config file has been created

* Use Azure unique prefix
Use an Azure unique prefix for the Azure resource names that ARO-RP is creating

* Update env vars
No cahce is needed for running the pipeline, az aro source can be discarded, and remove the e2e suite var

* Simplify two bash scripts and use newer base image
Use UBI8 toolbox image v8.10 with a better name, and shorter env declartion or env validation over multiple lines

* Logically group steps for rp-full-dev-setup
Simplify 'main' pipeline by grouping them by their purpose and use -e flag for the bash scripts

* Typo fix + git commit
s/delpoy/deploy
2024-07-19 19:27:07 +02:00
Tony Schneider b9446b5672 remove trailing whitespace 2024-06-17 13:20:42 -05:00
Tony Schneider 49db8b5e9f delete acr-credentials.json 2024-06-17 13:20:42 -05:00
Tony Schneider a4794ce154 fix copy/paste error 2024-06-17 13:20:42 -05:00
Tony Schneider b5795e460f update aro-classic-e2e to use generated acr credentials 2024-06-17 13:20:42 -05:00
Christoph Blecker a96312fdf4
Remove unneeded codeql template 2023-08-17 13:46:18 -07:00
Amber Brown ede320dd33
Run prettier on the pipeline yaml files (#2979)
* move prettierrc up one level

* add a prettierignore

* update files
2023-08-01 21:41:31 +10:00
Amber Brown b5ea75e75f
Add jq for must-gather (#3050) 2023-07-28 11:29:23 +10:00
Matthew Barnes 156383c4a6
Migrate RP from Azure AD Graph to Microsoft Graph (#1970)
* go.mod: Add github.com/microsoftgraph/msgraph-sdk-go

* azureclient: Add NewGraphServiceClient

Creates a GraphServiceClient with scope and graph endpoint set
appropriately for the cloud environment (public or US government).

* pkg/util/graph: Add GetServicePrincipalIDByAppID

* armhelper: Use MS Graph to obtain service principal ID

* armhelper: Remove unused authorizer parameter

* Use MS Graph endpoint to validate service principal

I don't think it matters for the purpose of validation, but the
AD Graph endpoint is nearing its end-of-life.

* pkg/cluster: Use MS Graph to obtain service principal ID

* pkg/util/cluster: Use MS Graph to create and delete clusters

* Pretty-print OData errors from MS Graph

To aid debugging failed MS Graph requests.

MS Graph's top-level APIError message is hard-coded and only says
"error status code received from the API".  Further details have
to be extracted from the "ODataErrorable" interface type.

* azureclient: Remove ActiveDirectoryGraphScope

No longer used.

* Remove pkg/util/azureclient/graphrbac

No longer used.

* pipelines: Run CodeQL analysis for Go on 1ES Hosted Pool

Vendoring the Microsoft Graph SDK for Go causes memory consumption
during CodeQL analysis to double due to its enormous API surface,
putting it well beyond the memory limit of standard GitHub Action
runners.

I inquired with the Azure organization admins about provisioning
larger GitHub runners, but was directed instead to use the 1ES
Hosted Pool which runs our other CI checks. Since ARO controls
the VM type for Hosted Pool agents, we can use a VM type with
adequate memory for CodeQL analysis with the Graph SDK.

Note: Implemented CodeQL commands in a template in case we
      ever decide to move Javascript or Python analysis to
      1ES Hosted Pool as well.
2023-06-14 11:10:37 -06:00
Jeremy Facchetti 667533415a
bumped go version (#2836) 2023-04-07 10:08:58 +02:00
cadenmarchese 113362e56f use GOCACHE=/tmp 2023-03-08 15:47:16 -05:00
cadenmarchese f98e10b8f9 add jq 2023-03-08 15:46:59 -05:00
Amber Brown 53bd3d5d65
Migrate last items to 1ES (#2683)
* No image mirroring via Pipelines

* run the subscription cleaner in the 1ES pool
2023-02-10 15:10:37 +11:00
Amber Brown 127b0565f1
Migrate E2E to 1ES pool (#2638)
This doesn't include portal tests, those will follow.
2023-01-31 10:10:05 +11:00
Amber Brown 530c5cccc5
Port CI to 1ES (#2624) 2023-01-16 12:18:27 +11:00
Amber Brown 0133334378 Remove all unused prod-related pipeline configurations, leaving just PR CI, PR E2E, Image Mirroring (for now), and OneBranch configs. 2022-11-24 14:42:29 +11:00
Mikalai Radchuk e2f927b67a Makes e2e flags consistent 2022-09-30 16:54:58 +01:00
Amber Brown 26ef9684eb update to ginkgo v2 in the e2e tests 2022-09-27 15:16:30 +01:00
tschneid bea9aec2d8 Bump ocp to 4.10.20, revert workarounds for BZ 2093044
Revert "Add name length validation on ARO clusters for non-zonal regions"
This reverts commit 13c3290ffc.

Revert "Typo in pipeline script"
This reverts commit 6e1acd4f13.

Revert "Truncate cluster names to 19 char in e2e pipelines"
This reverts commit b2273bdc6a.

Removed test cases in pkg/api/v20220904/openshiftcluster_validatestatic_test.go for cluster
name length validation, these tests are no longer needed as BZ 2093044 is fixed in 4.10.20
2022-07-07 14:24:10 -05:00
Ben Vesel bf87bb8cee
Clear the auth files when the pipeline exits (#2203) 2022-06-23 12:33:55 -04:00
Miguel Abad Perez 6e1acd4f13 Typo in pipeline script 2022-06-06 12:10:28 +10:00
Tony Schneider b2273bdc6a Truncate cluster names to 19 char in e2e pipelines 2022-06-03 16:34:07 -05:00
Ben Vesel 0442afdb22
Update pipelines to demand go 1.17 and update OB container to go 1.17 (#2146) 2022-05-31 11:44:29 -04:00
Petr Kotas ee5cd9a262
fix: move int mirroring to separate pipelines
integration requires it own set of credentials,
this can only by provided in a separate pipeline

Signed-off-by: Petr Kotas <pkotas@redhat.com>
2022-02-25 11:41:40 +01:00
Petr Kotas 907e0452ca add: copy ARO iamge to integration
Signed-off-by: Petr Kotas <petr@kotas.tech>
2022-02-24 13:30:08 +00:00
Petr Kotas b73ec7ce6d fix: use the tag/commit as the aro version
ARO uses both tags and commits as its version.
The commits are used for the development scenario,
tags are used when building and deploing to
production.
2022-02-24 13:30:08 +00:00
bennerv 2f882f91c7 Update correct directory path for pipeline template files 2022-02-07 12:55:51 -05:00
bennerv bc9146226c Clean up debug print statement in pipelines 2022-02-07 11:50:37 -05:00
bennerv 55db043dcb Incorrect quoting on variables in pipeline 2022-02-07 11:38:57 -05:00
Petr Kotas fc5da3dcad
fix: Add go1.16 requirement to run pipelines
With addition of 4.9 release, the go build
have to run with go1.16

Signed-off-by: Petr Kotas <pkotas@redhat.com>
2022-02-04 15:51:46 +01:00
Petr Kotas fb789a15e3
Fix: Remove the wrong git pull path
Removes the wrong git pull path for ADO RP-config
Removes unused parameter

Signed-off-by: Petr Kotas <pkotas@redhat.com>
2022-02-04 15:11:36 +01:00
Petr Kotas d3efc247d4 Revert "Revert "[PIPELINES 4] Create release based on annotated git tag"" 2022-01-31 13:51:44 +00:00
Petr Kotas 707315182a
Fix: Broken checkout code path
The checkout behaves differently when checking out single repository.
It checkout to /s

Signed-off-by: Petr Kotas <pkotas@redhat.com>
2022-01-20 15:07:06 +01:00
Petr Kotas 5f62ef8b08
Fix: Broken pull path
The original path is not working as it is blocked for writing,
Using the pipeline default instead

Signed-off-by: Petr Kotas <pkotas@redhat.com>
2022-01-20 12:24:27 +01:00
Petr Kotas 56b90ee8a0
Revert "[PIPELINES 4] Create release based on annotated git tag" 2022-01-19 15:07:14 +01:00
Petr Kotas 7197f3255d
Merge pull request #1684 from petrkotas/build-by-tag 2022-01-18 18:54:08 +01:00
Petr Kotas 9ca76bad49
Merge pull request #1688 from petrkotas/deploy-via-tag 2022-01-18 15:56:02 +01:00
Petr Kotas ecd4f6d8a3
Merge pull request #1674 from petrkotas/build-on-tah 2022-01-18 10:09:15 +01:00
Petr Kotas 3fbcaee47d
Download aro deployer from tagged image
Pull aro deployer from tagged container instead of pipeline artifact.

Signed-off-by: Petr Kotas <pkotas@redhat.com>
2022-01-17 08:29:42 +01:00
Petr Kotas 82edb0e92d
Build and push tagged aro image into ACR
When annotated TAG is not set the new step fails.
Otherwise it builds the tagged image and pushes it
to the ACR.

Signed-off-by: Petr Kotas <pkotas@redhat.com>
2022-01-14 13:57:39 +01:00
Petr Kotas 3e445902b6
Replace artifacts with direct code checkout
Replaces configuration fetching via build pipeline with
direct code checkout.

Signed-off-by: Petr Kotas <pkotas@redhat.com>
2022-01-14 11:30:28 +01:00
Mangirdas Judeikis a5e9183ac5
fluentbit pipeline 2021-09-17 12:36:35 +01:00
Mangirdas Judeikis eb893fd4c0
change SP for prod 2021-07-01 11:26:30 +01:00
Troy Connor a02238b644
util: get objectId by application for GovCloud 2021-06-15 14:04:27 -04:00
Jim Minter e8cce46105
fix script error which broke our our nightlies 2021-04-12 15:37:48 -05:00
Jim Minter 9cacea7b3c
remove rpMode from ARM templates 2021-04-08 09:12:14 -05:00
Jim Minter d7275e5bb5
remove hard-coded INT/PROD client IDs in e2e test 2021-04-08 09:12:13 -05:00
Jim Minter bbc0aef44d
Merge pull request #1329 from jim-minter/no-full-deploy
Remove full deploy
2021-02-24 07:55:40 -06:00
Jim Minter 5c5c0d2dc5
remove fullDeploy 2021-02-23 19:34:27 -06:00
Jim Minter d38bb997fc
fix vnet peering code in INT 2021-02-23 19:23:18 -06:00