Update Readme (#12)
* Update README.md Adding the details for load infra pipeline * Adding the images for readme * Adding images in readme document. Formatting the images. * Adding few links in the doc * Changed parameter positioning and corrected commented variable name * Correcting spelling * Addressing PR comments * Adding suggestions More details on test execution pipeline and moved AKS section at end
This commit is contained in:
Shuvajyoti Deb
GitHub
Родитель
2c127bd86b
Коммит
b97d2b358a
Двоичный файл не отображается.
|
После Ширина: | Высота: | Размер: 26 KiB |
Двоичный файл не отображается.
|
После Ширина: | Высота: | Размер: 204 KiB |
|
|
@ -12,7 +12,7 @@ trigger: none
|
|||
# NodeVmSize: ""
|
||||
# ServiceConnection: ""
|
||||
# KeyVaultName: ""
|
||||
# SecretNames: ""
|
||||
# SecretName: ""
|
||||
# Tenant: ""
|
||||
|
||||
steps:
|
||||
|
|
|
|||
142
README.md
142
README.md
|
|
@ -8,7 +8,17 @@ As the Azure DevOps cloud-based load testing by Microsoft has been deprecated, w
|
|||
|
||||
Currently we have also implemented an automated pipeline for running the performance test using Apache JMeter and AKS, which is also extended to simulate parallel load from multiple regions to reproduce a production scenario.
|
||||
|
||||
## Prerequisite for onboarding to the automated pipeline:
|
||||
<br>
|
||||
We also have another pipeline to set up the load test infrastructure along with scripts to run test locally. This is recommended when more control and precision is required.
|
||||
|
||||
# Contents
|
||||
|
||||
- [Prerequisites](#prerequisites-for-onboarding-to-the-automated-pipeline)
|
||||
- [Test Execution Pipeline](#test-execution-pipeline)
|
||||
- [Load Test Infrastructure Pipeline](#load-test-infrastructure-pipeline)
|
||||
- [More about AKS](#more-about-aks)
|
||||
|
||||
## Prerequisites for onboarding to the automated pipeline
|
||||
|
||||
Prerequisite script creates Service Connection, App Id, Service Principal and KeyVault. KeyVault has certificate and client secret.
|
||||
Steps to execute Prerequisite script:
|
||||
|
|
@ -16,69 +26,129 @@ Steps to execute Prerequisite script:
|
|||
1. Set working directory to Scripts folder where Prerequisite.ps1 resides.
|
||||
2. Run below command.
|
||||
|
||||
```Powershell
|
||||
.\Prerequisite -subscriptionId {Azure Subscription Id} -resourceGroupName {Resource Group Name} -keyVaultName {KeyVault Name} -location {Location} -certName {Certificate Name} -servicePrincipalName {Service Principal Name} -tenantId {Microsoft Tenand Id} -serviceConnectionName {Service Connection Name} -organizationName 'https://microsoftit.visualstudio.com' -projectName 'OneITVSO' -ServicePrincipalSecret {Service Principal Sercret Name}
|
||||
```
|
||||
|
||||
3. After execution of Prerequisite script, Search Service Principal Name in Azure Active Directory and fetch App Id.
|
||||
4. Onboard App Id to resource group with Contributor role.
|
||||
|
||||
## JMeter test scripts:
|
||||
### JMeter test scripts:
|
||||
|
||||
1. create the test suite with the help of how to setup JMeter test plan(https://jmeter.apache.org/usermanual/build-web-test-plan.html).
|
||||
2. Check in the JMX file and supporting files in a repository
|
||||
|
||||
## AKS setup
|
||||
## Test Execution Pipeline
|
||||
The test execution pipeline will help users to run tests with maximum automation. Once prerequisites are setup, users can straight away run their tests.
|
||||
For users who do not have a AKS cluster, the pipeline parameter `IsClusterRequired` will give an option to create this on the fly (it will get deleted after the test).
|
||||
This pipeline is recommended for tests less than 1 hour to avoid timeout. For running tests greater than 1 hr an advanced setup maybe required, refer to [Load Test Infrastructure Pipeline](#load-test-infrastructure-pipeline) for more details
|
||||
|
||||
1. Create AKS cluster with the help of how to create a AKS cluster(https://docs.microsoft.com/en-us/azure/aks/kubernetes-walkthrough-portal)
|
||||
2. Provide access to a Service Principal Name which would be used to run the JMX file in the cluster.
|
||||
### Steps to onboard and execute the pipeline:
|
||||
|
||||
## Steps to onboard and execute the pipeline:
|
||||
|
||||
1. Fork the test execution YAML pipeline from the repository: JMeterAKSLoadTest(https://github.com/microsoft/JMeterAKSLoadTest.git)
|
||||
1. Fork or create pipeline using the `test-execution-pipeline.yml`
|
||||
2. Folder structure looks like below
|
||||
|
||||
|
||||
|
||||
|
||||
3. Inside the JMeterFiles folder add the JMX and supporting files there
|
||||
|
||||
|
||||
|
||||
|
||||
4. Overview on the test execution pipeline variables which can be added by users before running the pipeline -
|
||||
- Tenant – Tenant id
|
||||
- NameSpace - AKS cluster namespace
|
||||
- ServiceConnection - Azure service connection
|
||||
- KeyVaultName - Key vault name for fetching the secrets used in the pipeline
|
||||
- SecretNames - List of secrets which can be fetched from the key vault e.g. "AKSSPNClientSecret, PerfTestClientSecret"
|
||||
- AKSResourceGroup - Resource group for keeping AKS resources
|
||||
- AKSRegion1 - Respective region name e.g. westus2
|
||||
- AKSRegion2 - Respective region name e.g. cus
|
||||
- AKSClusterNameRegion1 - Cluster name of the respective region
|
||||
- AKSClusterNameRegion2 - Cluster name of the respective region
|
||||
- AKSSPNClientId – Service principal id used for connecting to AKS clusters
|
||||
- AKSSPNClientSecret – Client secret used for connecting to AKS clusters
|
||||
- PerfTestResourceId – Resource Id for the API Auth
|
||||
- PerfTestClientId – Client Id for the API Auth
|
||||
- CSVFileNames – List of supported file names for execution like “users.csv,ids.csv”
|
||||
|
||||
- Tenant – Tenant id
|
||||
- NameSpace - AKS cluster namespace
|
||||
- ServiceConnection - Azure service connection
|
||||
- KeyVaultName - Key vault name for fetching the secrets used in the pipeline
|
||||
- SecretNames - List of secrets which can be fetched from the key vault e.g. "AKSSPNClientSecret, PerfTestClientSecret"
|
||||
- AKSResourceGroup - Resource group for keeping AKS resources
|
||||
- AKSRegion1 - Respective region name e.g. westus2
|
||||
- AKSRegion2 - Respective region name e.g. cus
|
||||
- AKSClusterNameRegion1 - Cluster name of the respective region
|
||||
- AKSClusterNameRegion2 - Cluster name of the respective region
|
||||
- AKSSPNClientId – Service principal id used for connecting to AKS clusters
|
||||
- AKSSPNClientSecret – Client secret used for connecting to AKS clusters
|
||||
- PerfTestResourceId – Resource Id for the API Auth
|
||||
- PerfTestClientId – Client Id for the API Auth
|
||||
- CSVFileNames – List of supported file names for execution like “users.csv,ids.csv”
|
||||
|
||||
|
||||
|
||||
5. Overview on the test execution pipeline parameters which can be configured at every run while running the pipeline -
|
||||
- IsMultiRegionEnabled - Allows user to optionally choose to run their workloads in more than one region
|
||||
- IsClusterRequired - Allows users to optionally create and tear down the cluster on demand while running the tests
|
||||
- JMeterFolderPath – JMX File folder path
|
||||
- JMeterFileName – JMX File name
|
||||
- Threads - Number of threads
|
||||
- Duration - Duration of the test
|
||||
- Loops - Number of loops
|
||||
- RampUpTime -Rampup time used to generate load from JMX file
|
||||
|
||||
- IsMultiRegionEnabled - Allows user to optionally choose to run their workloads in more than one region
|
||||
- IsClusterRequired - Allows users to optionally create and tear down the cluster on demand while running the tests
|
||||
- JMeterFolderPath – JMX File folder path
|
||||
- JMeterFileName – JMX File name
|
||||
- Threads - Number of threads
|
||||
- Duration - Duration of the test
|
||||
- Loops - Number of loops
|
||||
- RampUpTime -Rampup time used to generate load from JMX file
|
||||
|
||||
|
||||
|
||||
6. The results of the execution is published as artifact and it can be downloaded. The index.html file holds the report of the run.
|
||||
|
||||
## Advantages:
|
||||
### Advantages:
|
||||
|
||||
1. With minimal cost you can simulate parallel load from different regions to replicate the production scenario.
|
||||
2. As all the Loops, Threads and Ramp up time variables are configured through pipeline variables you can run the test suite with minimal changes
|
||||
3. Once the setup is complete no dependency on any specific machine or user credential, therefore it could be run more frequently to understand the application performance.
|
||||
|
||||
## Load Test Infrastructure Pipeline
|
||||
|
||||
It creates AKS cluster in the desired subscription and resource group. It also creates a default namespace. After creation of the resources required for load test, users can run test multiple times. This setup allows users to run their tests for more than an hour and can be useful in scenarios where more control of the test setup is required. After completion of testing cycle it is recommended to clean the test resources.
|
||||
|
||||
### Steps for running load infrastructure pipeline
|
||||
|
||||
1. For first time setup in your subscription/resource group, ensure to run the pre-requsites script which will setup the Service Principal, Service Connection, Keyvault etc. Check the [Prerequisites](#prerequisites-for-onboarding-to-the-automated-pipeline) section for more details.
|
||||
2. Fork or create pipeline using the `load-infrastructure-pipeline.yml`
|
||||
3. Run the pipeline using the following variables -
|
||||
- DefaultNamespace
|
||||
- AksClusterName
|
||||
- ResourceGroup
|
||||
- ServicePrincipalId
|
||||
- AksRegion
|
||||
- NodeVmSize
|
||||
- ServiceConnection
|
||||
- KeyVaultName
|
||||
- SecretNames
|
||||
- Tenant
|
||||
|
||||
|
||||
|
||||
### Pre-requisites for running tests on user machine via scripts
|
||||
|
||||
- Ensure you have the Azure CLI version 2.9.0 or later
|
||||
- Ensure you have the aks-preview CLI extension v0.4.55 or higher installed
|
||||
- Ensure you have installed kubectl v1.18.3+
|
||||
- Get sufficient permissions on the AKS cluster
|
||||
|
||||
### Steps to run tests locally on user's machine
|
||||
|
||||
- Run Following
|
||||
|
||||
```Powershell
|
||||
cd .\Scripts\
|
||||
.\Run-Test.ps1 -aksClusterName {cluster-name} -resourceGroup {rg-name} -testPath {Full Path to Test File} -agentCount {agent-count}
|
||||
```
|
||||
|
||||
- It creates JMeter master and slave pods on AKS
|
||||
- Copies Test plan to the master JMeter Pod
|
||||
- Executes the test plan, after test execution JMeter master and slave pods are deleted
|
||||
|
||||
|
||||
|
||||
### Collecting Test Results
|
||||
|
||||
- At the end of test, path to test results will be displayed in script
|
||||
- index.html file will give a brief summary of the test execution
|
||||
- Test report and jmeter server logs can be collected from the report folder
|
||||
|
||||
## More about AKS
|
||||
|
||||
- Create AKS cluster with the help of how to create a AKS cluster(https://docs.microsoft.com/en-us/azure/aks/kubernetes-walkthrough-portal)
|
||||
- Alternately, it can be created using the [Load Test Infrastrucure Pipeline](#load-test-infrastrucure-pipeline).
|
||||
- Provide access to a Service Principal Name which would be used to run the JMX file in the cluster.
|
||||
|
||||
## Contributing
|
||||
|
||||
This project welcomes contributions and suggestions. Most contributions require you to agree to a
|
||||
|
|
|
|||
|
|
@ -1,13 +1,13 @@
|
|||
param(
|
||||
[Parameter(Mandatory = $False)]
|
||||
[string]$namespace = "",
|
||||
[Parameter(Mandatory = $True)]
|
||||
[string]$aksClusterName,
|
||||
[Parameter(Mandatory = $True)]
|
||||
[string]$resourceGroup,
|
||||
# Complete path of test
|
||||
[Parameter(Mandatory = $True)]
|
||||
[string]$testPath,
|
||||
[Parameter(Mandatory = $True)]
|
||||
[string]$resourceGroup,
|
||||
[Parameter(Mandatory = $True)]
|
||||
[string]$aksClusterName,
|
||||
# Relative Path to Script Folder
|
||||
[Parameter(Mandatory = $False)]
|
||||
[string]$reportFolder = "Reports",
|
||||
|
|
|
|||
Загрузка…
Ссылка в новой задаче