sap-automation/README.md

44 строки
2.9 KiB
Markdown
Исходник Постоянная ссылка Обычный вид История

2021-11-16 21:43:15 +03:00
# Project
2021-11-17 20:29:07 +03:00
The SAP deployment automation framework on Azure is an open-source orchestration tool for deploying, installing and maintaining SAP environments. You can create infrastructure for SAP landscapes based on SAP HANA and NetWeaver with AnyDB on any of the SAP-supported operating system versions and deploy them into any Azure region.
2021-11-16 21:43:15 +03:00
2021-11-17 20:29:07 +03:00
The framework uses Terraform for infrastructure deployment, and Ansible for the operating system and application configuration.
2021-11-16 21:43:15 +03:00
3.8 release (#436) * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * BOM updates for accommodating Revision 2.00.059.7 (SPS05) for HANA DB 2.0 * Updates to SWPM 2.0 and SWPM 1.0 * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values * Workload zone pipeline updates (#409) * Update vm-webdisp.tf * Add support for dynamiv /hana/backup location * Debugging local install volume creation * JINJA fixes * Remove the if statement * adding is defined * Add better messaging * If workload zone defined AFS use it * AFS download update * Call AFS always * Add SCS diskspace check * /hana/data/backup tests * Take the first item from the list * Show mnt size * Use index * show raw data * simplify the size calculation * show backup location * show backup directory * Use the correct server * Correct the if statement * Move INI generation into the install block * Register BoM in all cases * Run az login earlier in the pipeline * Script updates * Show disk space requirement * Only check size of /usr/sap if it exists * Check if usr_sap is defined * Disk size calculation * missing line feed * Add support for providing ORACLE-ASM * Oracle ASM ports * Oracle - ASM support * Add support for Oracle ASM * Add ORACLE-ASM to playbooks * Oracle ASM support * change UIDs * move the check * calculate scs_virtual_hostname * remove extra part from tag * become for profile * use become for profile * remove duplicates * remove duplicates * Update parameters to accommodate JAVA installations * set become * invoke cluster commands as root * include_tasks instead of import_tasks * test ACSS registration * ACSS variable definitions and echo * Improve echo :-) * indentation * Add the missing call * pipeline updates * Enable SLES 15 SP4 * quote the secret when passing from pipeline and in set_secrets.sh * Disable Private FW * Registery Configuration - Ciphers and Protocols * Add memory dump configuration * Move domain join to roles-os * Add new OS configurations * troubleshooting BoM * Change the failed_when condition * remove duplicate code * debugging * Ansible Lint * troubleshooting * Linting * Linting * Removed the --- * Moved the tags * Debugging * Check directory exists * Create tmp directory * Fixed the Jinja * ensure directories exist * task naming * BoM tests * Linting fixes * Testing * Testing * BoM registration * Update common variable * Test * Revert download Dir * Test * Test * Test * Test * Test * Test * Updated the disks_config.yml * Playbook update - fetch the secrets * Linting * pass the secrets * Task name tweaks * Changed the directory logic * Indentation * SA tweaks * Ignore storage account download errors * Further testing * JAVA Paths for logs * Only validate BoM platform for deployment * setting storage account flag * Add the sa flag * Add platform validation * Log file paths * pass the value back to set fact * set the facts - slight modifications * align to block * align to block * duh! errors * indentation * Commenting out the JAVA ports * Removed the platform check * support redeployment * Test * add region code for wus3 * Test * Test * Test * Test * Additional instance_type's added * add the missing curly braces * SCS ERS installation logic tweaks * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * SAP software provisioning manager (sapinst) should be run with umask 022 (#402) The custom_umask variable allowes overrides of this default setting (cherry picked from commit d0b41974c92582e7c38f21a2c490b615448f1b61) * fix typo in commit #794b912 * Test * NW on Windows Enhancement (#410) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Test * Test * Test * Test * Test * Test * Export the Ansible collections to the correct path * Add tags for disk checking * Set the collection path * Comment out Tests * Comment out Tests * Test * Test * Provide the Ansible collection environment * Update helper scripts * BOM for DB2-11.1 * Windows clustering initial seed. * add quorum part * update pipelines to support NW750SPS20_DB2_11-1_v0001ms * removing unrar as a package for now as it is not directly available from native repos or epel. * handle python interpreter version * validate python interpreter version and logic improvement * need to check logic * missed python_version for the startup scripts * set python version when determining ensa versions * add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines * Remove the -ms from the new BoM * Patch 8 for SOFTWARE UPDATE MANAGER 2.0 SP15 * DevOps creation updates * Cleanup and logging for script * Fix the use_custom_dns_a_registration errors * Add validation for the name components in the tfvars file * Use the correct parameter for awk * Correct the switch * remove whitespace * awk fixes * Move the dos2unix earlier * Move dos2unix * whitespace * indentation * Update the case statement * syntax error * Quotes around the parenthesis * Syntax error for if statement * Add more verbose information * Final version for workload zone * Pipeline updates * System pipeline * Corrected the file name * Pipeline updates * Log on as SPN before ARM deployment * Key vault return values * Variable updates * Use the location code * Logout before running devops tasks * Value is always empty for secrets * Add ability to test deployment * Testing TEST_ONLY * Removed the extra quote * Perform login * Add Test only support * Logon as SPN when doing the system deployment * Show the variable * Show output for Test_Only * Show output * Better output * Fix the workload zone remover pipeline * Fix path * Path checks * Update workload zone removal * Remove control plane * Fix the parameter * ARM Password * USe the correct SPN * Debugging * password * Logon testing * Use the correct Subscription * The default is to use an external DNS registration * Use the prefix for all the templates * Include InstanceType in Jinja template * convert acss registration to playbook * Add the prefix to the BoM name * Use the BoM name * Rename the task * Update the User creation as well * BoM Fixes * Fix [BUG] Secondary IP not reachable #352 (#381) * Misc fixes * DNS storage account * Add DNS for Key Vault * Networking fro dual NICS * Get the install validations * multi-nic configuration updates * Add DNS for File Shares * Use the correct DNS names * pushing the changes * adjust permissions with leading zero * push changes to repo * debugging * Networking code updates * Win Disk configuration Jinja * Remove work in progress files * Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory * Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory * Restore code * Make the default secondary DNS different from the hostname * Return the secondary IP * Added the missing space * Add try statements * return only the first element of the array * debug, print the scs VM ids * debug, print the VM being picked up * print the VM Id of scs vm for better troubleshooting. * Get the last list item * Make the return value a list * Add App IPs to output * testing dual IPs * Temporary remove the output * Remove the unused resources * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. (cherry picked from commit 70f56738828e24a6898e2218c80f942966f6f0d0) * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. * Get the second IP if defined * IP Logic * Update the NIC * Simplify the IP passing * removed the unneeded variables * Fixing the variables * corrected variable name * Variable name * Output variable name * simplify the IP address logic * Add test option for the workload zone * Test option for workload zone * Update Experimental with the latest changes (#414) * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values * fix typo in commit #794b912 * Test * Test * Test * Test * Test * Test * Test * Export the Ansible collections to the correct path * Add tags for disk checking * Set the collection path * Comment out Tests * Comment out Tests * Test * Test * Provide the Ansible collection environment * Update helper scripts * BOM for DB2-11.1 * Windows clustering initial seed. * add quorum part * update pipelines to support NW750SPS20_DB2_11-1_v0001ms * removing unrar as a package for now as it is not directly available from native repos or epel. * handle python interpreter version * validate python interpreter version and logic improvement * need to check logic * missed python_version for the startup scripts * set python version when determining ensa versions * add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines * Remove the -ms from the new BoM * DevOps creation updates * Cleanup and logging for script * Fix the use_custom_dns_a_registration errors * Add validation for the name components in the tfvars file * Use the correct parameter for awk * Correct the switch * remove whitespace * awk fixes * Move the dos2unix earlier * Move dos2unix * whitespace * indentation * Update the case statement * syntax error * Quotes around the parenthesis * Syntax error for if statement * Add more verbose information * Final version for workload zone * Pipeline updates * System pipeline * Corrected the file name * Pipeline updates * Log on as SPN before ARM deployment * Key vault return values * Variable updates * Use the location code * Logout before running devops tasks * Value is always empty for secrets * Add ability to test deployment * Testing TEST_ONLY * Removed the extra quote * Perform login * Add Test only support * Logon as SPN when doing the system deployment * Show the variable * Show output for Test_Only * Show output * Better output * Fix the workload zone remover pipeline * Fix path * Path checks * Update workload zone removal * Remove control plane * Fix the parameter * ARM Password * USe the correct SPN * Debugging * password * Logon testing * Use the correct Subscription * The default is to use an external DNS registration * Use the prefix for all the templates * Include InstanceType in Jinja template * convert acss registration to playbook * Add the prefix to the BoM name * Use the BoM name * Rename the task * Update the User creation as well * BoM Fixes * Misc fixes * DNS storage account * Add DNS for Key Vault * Networking fro dual NICS * Get the install validations * multi-nic configuration updates * Add DNS for File Shares * Use the correct DNS names * pushing the changes * adjust permissions with leading zero * push changes to repo * debugging * Networking code updates * Win Disk configuration Jinja * Remove work in progress files * Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory * Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory * Restore code * Make the default secondary DNS different from the hostname * Return the secondary IP * Added the missing space * Add try statements * return only the first element of the array * debug, print the scs VM ids * debug, print the VM being picked up * print the VM Id of scs vm for better troubleshooting. * Get the last list item * Make the return value a list * Add App IPs to output * testing dual IPs * Temporary remove the output * Remove the unused resources * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. (cherry picked from commit 70f56738828e24a6898e2218c80f942966f6f0d0) * Get the second IP if defined * IP Logic * Update the NIC * Simplify the IP passing * removed the unneeded variables * Fixing the variables * corrected variable name * Variable name * Output variable name * simplify the IP address logic * Add test option for the workload zone * Test option for workload zone --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * Default variable updates * Add the missing variable * Add DNS registration for secondary DNS names * Use count.index * Incorrect variable used * Provide the correct defaults * SQL Disk fixes and DNS Resourcegroup name * Use the correct zone name DOH :) * add db-ha-done file * make the domain_ou_path a variable * task name quotes * Add additional configuration options * Persist the configuration settings * Remove quotes * remove encoding * Adding the Configuration parameters and the instance numbers * Add Linebreaks * become orchestration_ansible_user for the bom downloader playbook * Update the variable with the corrected value * Add a default value * Pass the DNS Resource group * Mounting logic update * Don't persist an empty collections * Added local. * Added the missing .local * Experimental tweaks from ACSS debug session (#417) * Missing variable for non AFS scenarios * Add use secondary ip flag * Add a default value * Create the temp files * Debug mounting * Install * Mounting logic * Don't mount local sapmnt * Alignment * Missing DNS resource group * Added the local. * Reboot handler * Correct the Jinja * Typo in jinja * Add the missing variable * Typo in JINJA * Remove the domain_name variable * hdbuserstore as sidadm * reboot if waconf is changed * Adding rsdb/ssfs_connect to DEFAULT.PFL * Change the failed when condition for SUSE * Adding the python version to support older distros * Add a rescue action for setting ENSA if MessageServer is down * Added logic for restarting message server for HA scenarios * Use scs_running_on is not defined instead * Add try statements * Add try statements * Change the IP for ansible * Add a rescue action for SUSEConnect * Missing region name * BoM update with same name * Provide ssfs_connect environment variable * Don't specify python for deployer * Add a wait * Update message * db_server_temp fix * Misc updates * Create users for Oracle * Don't run User creation * sa flag * Set SA Enabled * Show Debug info * DBLoad * Check storage account * Let SAP create the users * Adding more verbosity * Typo and missing variable * Set sa flag * Don't create users separately when deploying on Oracle * set allow_world_readable_tmpfiles for hdbuserstore code * and when to check for windows family * fix indentation * Addd Windows checks * Adding ORACLE-ASM as platform * Mount install on db node * add acl package to all tiers * add it for all vms * Add TF_LOG to workload and system pipelines --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * Calculate domain if not specified (#419) * Calculate domain if not specified * Missing POOL variable --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> * Release 3.7 pipeline updates (#420) * Calculate domain if not specified * Missing POOL variable * Fix the assert statements * Add the calculated domain * Download files on Windows * Set ARM_USE_MSI * Add use_msi into the provider * Use the correct backend * Adding the suffix * Change provider order * Switch provider * testing how to get MSI ID * Write the MSI Object ID * remove the sensitivity * Remove the "raw" * Show the Deployer MSI * deliberate error * Removed the error * Adding MSI client ID * Don't remove workload VNet changes * Testing jq * Removed jq * source the configuration from deployer * correct source * USE UPN for login * Fix the providers * Add domain calculation * remap providers * Use the main provider * Provide the correct provider for sapmnt * Use source for removals * Remove extra login * Rename variable * Correct the variable * Correct the parameter * Corrected the variable name * Merge branch 'experimental' of https://github.com/KimForss/sap-automation into experimental * fix typos for region code wus2 * Software download tests on Windows * whitespace removal --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * Change Oracle -> OracleLinux * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * ansible lint fixes - minor * ansible lint fixes - minor 002 * ansible lint fixes - minor 003 * Set the Terraform environment variables for non MSFT created deployers * Add Shared Disk for Windows clusters * linting * Added the missing counter * Change download directory to be Agent.TempDirectory * Add SCSHA and ERS inifile for HA deployments of S4HANA_2021_FP01 BOM (#430) * Fix hardcoded HANA port in hdbuserstore list (#435) HANA port in hdbuserstore is hardcoded to 30313 for App and PAS install tasks. Fixed to correctly generate correct port for deployed HANA instances. * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * Pre 3.8 release (#434) * update NSG name * resource_name * Resource name * ConnectivityToSAPApplicationSubnetFromControlPlane-ssh-rdp-winrm * admin subnet * Fix Rescue task for ERS * Use the first item * Use the correct plan * Add the plan details * Add dictionary object type to transform enable Plan * debug plan * debug: plan * Populate source_image_reference even if plan is defined * Remove whitespace * Add more ensa1/ensa2 logic * Add the ability to override ensa1/ensa2 * Add ensa1 for JAVA * Use scs_bom_instance_type * debug - change the resource attribute * Show Ensa1 & Ensa2 * Testing permission setting * test permission DSC * Test SqlPermission * pass necessary variables to the sap specific os configuration * try credssp * further complicate life * CNO needs to be disabled. Reverting credssp changes for now. * checking if we really need the become * enable credssp and try again * remove the becomes * give relative path * changes required for enabling credssp and relative paths for tasks inside blocks. * fixing typos-001 * debug for SQL Server service status * change to using split instead of cidrnetmask * become a domain user * correct plan disctioanry * add a random string to cluster name * shared disk resources * type was defined twice * debug * change names * add clarity in task names * correct the windows cluster svc account name * ensure create cluster is adding the cluster disks * typos in output name * make some changes to the db ha playbook * tier as a set fact persists and overrides the var passed to the role. So change tier to config_tier * the sql server installation tasks are being called. Need to investigate. * small adjustments * small changes * another set of small changes * add a few debugs * commit some small changes * switch to include tasks and include role so that the role/tasks are included as they are encountered. * rename tasks etc * do the installation validation * reorder tasks * missing dsc modules * correct casing for the agent account name * typos in dsc resource names * generic mistakes * parameter names * Test to run without PsDscRunAsCredential_username * make serverpermission a dictionary * pass on permissions * should they be passed liek this * pass the other two states * become true for setting permissions * fix typo again * calculate ag name * calculate ag listener name * hardcoded backup path for now * calculate subnet prefix * debug statements * sql server dsc modules call subnet prefix, unlike the cluster ones. * removed plan * subnet prefixes not available in same set fact * Install CLI the long way * Add support for providing the password for the SPNs * save and push changes before re-run * check if the backup path string is the problem * change the backup path back * Add debug info * support re-run * delegate the add db to ag task to the primary node * The sqlagdatabase as the last task on each node * Add RHEL support * package manager init * correct distro * Add RHEL support * add samples directory * use interactive variables * remove the double $ * Move lsb_release inside of case statement * Azure CLI install * Add the silent flag * show distro * remove the when condition * add config_tier * pass scs servername and add the domain service access to the SAP share * create directories that are needed for restore. * jinja changes * more jinja good ness * change the location from where we call jinja and set fact for disks. * Use the list * More jinja * More jinja * remove the double backslashes * rmove the SLES packages * backslashes * testing * remove the second backslash * remove the replace * fixes * testing * indentation * format * virtualenv * remove curlies * remove local * remove backslashes * Debug * debug * split to list * debugging * Testing directory creation * test the quotes * reduced the output * change quotes to see if regex escaping works differently * Path formatting for windows-test001 * convert it to a list * see if we can assign a var before * let's give it one more shot * more debug * flatten before calling to mimic with_items * add flattened list to debug * set probe port as well * print with loop_control * check what index is being used * modifications to use with_indexed_items * get ip of host * push with_indexed_items * removed the hard coded * probe port * rename probe port script to use ps1 extension * remove spaces between curlies * start ag resource along with ip address * sleep for a minute * Fix the hdbuserstore command * uncomment the sqlagdatabase * give permissions to the domain account * pass netbios domain name * trying something by adding the machine accounts * fixes to sqlpermissions * become * use only become and no dsc credentials * switch to using sidadm account * revert and give db_backupoperator * service accounts * add the user rights properly * set them correctly * fix params for SqlServiceAccount * set dummy pass for gMSA accounts * add a when clause * assign spns * change how dummy pass is encrypted * create spns * maybe we are passing the password wrong * set the correct service account for the sql agent service. * dsc seems to be throwing errors. switch to using win_service * change the ordering. * additional task to start agent service account and remove becomes for the adding database to AG * use sid_for_disks to calculate the sid to use. use sap_sid if db_sid is not defined. * final set of changes. * some more changes * pass in the variables needed * add logic for reboot immediately after the updates. * adding back the domain service account to sql logins * Add a try statement * add endpoint permissions on the second node * Get passwords from key vault * Get the credentials from key vault * update probe port, and its configuration. Add accounts to sysadmin role. * pass in the required variables. * removed curlies * pass in the domain name and the service accounts with the domain\accountname format * Corrected the task name * Set accounts for exports * Do another restart * change listener port * try waiting for the secondary creation * changes not pushed? * check if DB is added to primary and secondary * pass primary node to server name * pass teh correct account name * debug account names * pass domain_sqlsvc_account * remove the extra account calculation step * convert domain name to upper * caching facts leads to weird behaviour * push changes * profile changes etc. * missing curly * simplify the profile updates * update task description * Don't add the same sid multiple times * Centralize the component installation * Move packages call to run after domain join * set tier * Only check the DSC modules once * move the call to playbooks * change the rescue action for scs ha install to use builtin.shell instead of builtin.command * Update Terraform version * Test if the filter fixes disks_facts * Testing if Volumes fixes it * reverse the selection * removed the typo * update path * update the community.windows from the palybook to fix the win_disk_facts module * use builtin.raw with become * pass bash as the executable to use * Use correct venv * Troubleshooting * don't download module * test without rejectattr * Linting changes and removal of BOM-Catalog folder * lint fixes - 0001 --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * simplify the code * add network rules * Fix typos * restore the code * Changed the workload zone SPN naming logic * use DNS if private endpoint * lowercase DNS * DNS and NSG * Add DNS record * Add DNS records * deployer already has the packages * Bump up the version * rename sap_search.yamp file * install Ansible * removed the duplicate * update SQL probe port to handle other cluster parameters as well. * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * try with a linter file in another directory * Update github-actions-ansible-lint.yml * use the older lint-action plugin * add ansible lint badge and fix markdown issues * put all badges on the same line * calculate the path fact for HDB using the db_instance_number * Add SLES as supported deployer --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> Co-authored-by: Harm Jan Stam <harmjan+git@harmjan.com> Co-authored-by: Sumit Das <sumit8das@gmail.com> Co-authored-by: Shekhar Sorot ( MSFT ) <shekharssorot2002@gmail.com>
2023-03-31 16:36:08 +03:00
## Enterprise-scale - Reference Implementation
Create PR for release v 3.7.0.0 (#421) * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * Fix external support for key vaults * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * Cluster resources control & Terraform formatting (#408) * Use jinja * Add fail condition * add correct comparison * show disk free in GB * select first node * query for inode_available * select only first node * use json query * correct the query * don't convert * Add the disk space assert * make assert jinja * correct the calculation * convert to GB * Fix calculation * set the deployer free disk space threshhold * make free space a parameter * Add a dependency on the disk attachment resource * remove the defaults * Update vm-webdisp.tf * Add support for dynamiv /hana/backup location * Debugging local install volume creation * JINJA fixes * Remove the if statement * adding is defined * Add better messaging * If workload zone defined AFS use it * AFS download update * Call AFS always * Add SCS diskspace check * /hana/data/backup tests * Take the first item from the list * Show mnt size * Use index * show raw data * simplify the size calculation * show backup location * show backup directory * Use the correct server * Correct the if statement * Move INI generation into the install block * Register BoM in all cases * Run az login earlier in the pipeline * Script updates * Show disk space requirement * Only check size of /usr/sap if it exists * Check if usr_sap is defined * Disk size calculation * missing line feed * Add support for providing ORACLE-ASM * Oracle ASM ports * Oracle - ASM support * Add support for Oracle ASM * Add ORACLE-ASM to playbooks * Oracle ASM support * change UIDs * move the check * calculate scs_virtual_hostname * remove extra part from tag * become for profile * use become for profile * remove duplicates * remove duplicates * Update parameters to accommodate JAVA installations * set become * invoke cluster commands as root * include_tasks instead of import_tasks * test ACSS registration * ACSS variable definitions and echo * Improve echo :-) * indentation * Add the missing call * pipeline updates * Enable SLES 15 SP4 * quote the secret when passing from pipeline and in set_secrets.sh * Disable Private FW * Registery Configuration - Ciphers and Protocols * Add memory dump configuration * Move domain join to roles-os * Add new OS configurations * troubleshooting BoM * Change the failed_when condition * remove duplicate code * debugging * Ansible Lint * troubleshooting * Linting * Linting * Removed the --- * Moved the tags * Debugging * Check directory exists * Create tmp directory * Fixed the Jinja * ensure directories exist * task naming * BoM tests * Linting fixes * Testing * Testing * BoM registration * Update common variable * Test * Revert download Dir * Test * Test * Test * Test * Test * Test * Updated the disks_config.yml * Playbook update - fetch the secrets * Linting * pass the secrets * Task name tweaks * Changed the directory logic * Indentation * SA tweaks * Ignore storage account download errors * Further testing * JAVA Paths for logs * Only validate BoM platform for deployment * setting storage account flag * Add the sa flag * Add platform validation * Log file paths * pass the value back to set fact * set the facts - slight modifications * align to block * align to block * duh! errors * indentation * Commenting out the JAVA ports * Removed the platform check * support redeployment * Test * add region code for wus3 * Test * Test * Test * Test * Additional instance_type's added * add the missing curly braces * SCS ERS installation logic tweaks * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * BOM updates for accommodating Revision 2.00.059.7 (SPS05) for HANA DB 2.0 * Updates to SWPM 2.0 and SWPM 1.0 * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values * Workload zone pipeline updates (#409) * Update vm-webdisp.tf * Add support for dynamiv /hana/backup location * Debugging local install volume creation * JINJA fixes * Remove the if statement * adding is defined * Add better messaging * If workload zone defined AFS use it * AFS download update * Call AFS always * Add SCS diskspace check * /hana/data/backup tests * Take the first item from the list * Show mnt size * Use index * show raw data * simplify the size calculation * show backup location * show backup directory * Use the correct server * Correct the if statement * Move INI generation into the install block * Register BoM in all cases * Run az login earlier in the pipeline * Script updates * Show disk space requirement * Only check size of /usr/sap if it exists * Check if usr_sap is defined * Disk size calculation * missing line feed * Add support for providing ORACLE-ASM * Oracle ASM ports * Oracle - ASM support * Add support for Oracle ASM * Add ORACLE-ASM to playbooks * Oracle ASM support * change UIDs * move the check * calculate scs_virtual_hostname * remove extra part from tag * become for profile * use become for profile * remove duplicates * remove duplicates * Update parameters to accommodate JAVA installations * set become * invoke cluster commands as root * include_tasks instead of import_tasks * test ACSS registration * ACSS variable definitions and echo * Improve echo :-) * indentation * Add the missing call * pipeline updates * Enable SLES 15 SP4 * quote the secret when passing from pipeline and in set_secrets.sh * Disable Private FW * Registery Configuration - Ciphers and Protocols * Add memory dump configuration * Move domain join to roles-os * Add new OS configurations * troubleshooting BoM * Change the failed_when condition * remove duplicate code * debugging * Ansible Lint * troubleshooting * Linting * Linting * Removed the --- * Moved the tags * Debugging * Check directory exists * Create tmp directory * Fixed the Jinja * ensure directories exist * task naming * BoM tests * Linting fixes * Testing * Testing * BoM registration * Update common variable * Test * Revert download Dir * Test * Test * Test * Test * Test * Test * Updated the disks_config.yml * Playbook update - fetch the secrets * Linting * pass the secrets * Task name tweaks * Changed the directory logic * Indentation * SA tweaks * Ignore storage account download errors * Further testing * JAVA Paths for logs * Only validate BoM platform for deployment * setting storage account flag * Add the sa flag * Add platform validation * Log file paths * pass the value back to set fact * set the facts - slight modifications * align to block * align to block * duh! errors * indentation * Commenting out the JAVA ports * Removed the platform check * support redeployment * Test * add region code for wus3 * Test * Test * Test * Test * Additional instance_type's added * add the missing curly braces * SCS ERS installation logic tweaks * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * SAP software provisioning manager (sapinst) should be run with umask 022 (#402) The custom_umask variable allowes overrides of this default setting (cherry picked from commit d0b41974c92582e7c38f21a2c490b615448f1b61) * fix typo in commit #794b912 * Test * NW on Windows Enhancement (#410) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Test * Test * Test * Test * Test * Test * Export the Ansible collections to the correct path * Add tags for disk checking * Set the collection path * Comment out Tests * Comment out Tests * Test * Test * Provide the Ansible collection environment * Update helper scripts * BOM for DB2-11.1 * Windows clustering initial seed. * add quorum part * update pipelines to support NW750SPS20_DB2_11-1_v0001ms * removing unrar as a package for now as it is not directly available from native repos or epel. * handle python interpreter version * validate python interpreter version and logic improvement * need to check logic * missed python_version for the startup scripts * set python version when determining ensa versions * add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines * Remove the -ms from the new BoM * Patch 8 for SOFTWARE UPDATE MANAGER 2.0 SP15 * DevOps creation updates * Cleanup and logging for script * Fix the use_custom_dns_a_registration errors * Add validation for the name components in the tfvars file * Use the correct parameter for awk * Correct the switch * remove whitespace * awk fixes * Move the dos2unix earlier * Move dos2unix * whitespace * indentation * Update the case statement * syntax error * Quotes around the parenthesis * Syntax error for if statement * Add more verbose information * Final version for workload zone * Pipeline updates * System pipeline * Corrected the file name * Pipeline updates * Log on as SPN before ARM deployment * Key vault return values * Variable updates * Use the location code * Logout before running devops tasks * Value is always empty for secrets * Add ability to test deployment * Testing TEST_ONLY * Removed the extra quote * Perform login * Add Test only support * Logon as SPN when doing the system deployment * Show the variable * Show output for Test_Only * Show output * Better output * Fix the workload zone remover pipeline * Fix path * Path checks * Update workload zone removal * Remove control plane * Fix the parameter * ARM Password * USe the correct SPN * Debugging * password * Logon testing * Use the correct Subscription * The default is to use an external DNS registration * Use the prefix for all the templates * Include InstanceType in Jinja template * convert acss registration to playbook * Add the prefix to the BoM name * Use the BoM name * Rename the task * Update the User creation as well * BoM Fixes * Fix [BUG] Secondary IP not reachable #352 (#381) * Misc fixes * DNS storage account * Add DNS for Key Vault * Networking fro dual NICS * Get the install validations * multi-nic configuration updates * Add DNS for File Shares * Use the correct DNS names * pushing the changes * adjust permissions with leading zero * push changes to repo * debugging * Networking code updates * Win Disk configuration Jinja * Remove work in progress files * Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory * Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory * Restore code * Make the default secondary DNS different from the hostname * Return the secondary IP * Added the missing space * Add try statements * return only the first element of the array * debug, print the scs VM ids * debug, print the VM being picked up * print the VM Id of scs vm for better troubleshooting. * Get the last list item * Make the return value a list * Add App IPs to output * testing dual IPs * Temporary remove the output * Remove the unused resources * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. (cherry picked from commit 70f56738828e24a6898e2218c80f942966f6f0d0) * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. * Get the second IP if defined * IP Logic * Update the NIC * Simplify the IP passing * removed the unneeded variables * Fixing the variables * corrected variable name * Variable name * Output variable name * simplify the IP address logic * Add test option for the workload zone * Test option for workload zone * Update Experimental with the latest changes (#414) * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values * fix typo in commit #794b912 * Test * Test * Test * Test * Test * Test * Test * Export the Ansible collections to the correct path * Add tags for disk checking * Set the collection path * Comment out Tests * Comment out Tests * Test * Test * Provide the Ansible collection environment * Update helper scripts * BOM for DB2-11.1 * Windows clustering initial seed. * add quorum part * update pipelines to support NW750SPS20_DB2_11-1_v0001ms * removing unrar as a package for now as it is not directly available from native repos or epel. * handle python interpreter version * validate python interpreter version and logic improvement * need to check logic * missed python_version for the startup scripts * set python version when determining ensa versions * add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines * Remove the -ms from the new BoM * DevOps creation updates * Cleanup and logging for script * Fix the use_custom_dns_a_registration errors * Add validation for the name components in the tfvars file * Use the correct parameter for awk * Correct the switch * remove whitespace * awk fixes * Move the dos2unix earlier * Move dos2unix * whitespace * indentation * Update the case statement * syntax error * Quotes around the parenthesis * Syntax error for if statement * Add more verbose information * Final version for workload zone * Pipeline updates * System pipeline * Corrected the file name * Pipeline updates * Log on as SPN before ARM deployment * Key vault return values * Variable updates * Use the location code * Logout before running devops tasks * Value is always empty for secrets * Add ability to test deployment * Testing TEST_ONLY * Removed the extra quote * Perform login * Add Test only support * Logon as SPN when doing the system deployment * Show the variable * Show output for Test_Only * Show output * Better output * Fix the workload zone remover pipeline * Fix path * Path checks * Update workload zone removal * Remove control plane * Fix the parameter * ARM Password * USe the correct SPN * Debugging * password * Logon testing * Use the correct Subscription * The default is to use an external DNS registration * Use the prefix for all the templates * Include InstanceType in Jinja template * convert acss registration to playbook * Add the prefix to the BoM name * Use the BoM name * Rename the task * Update the User creation as well * BoM Fixes * Misc fixes * DNS storage account * Add DNS for Key Vault * Networking fro dual NICS * Get the install validations * multi-nic configuration updates * Add DNS for File Shares * Use the correct DNS names * pushing the changes * adjust permissions with leading zero * push changes to repo * debugging * Networking code updates * Win Disk configuration Jinja * Remove work in progress files * Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory * Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory * Restore code * Make the default secondary DNS different from the hostname * Return the secondary IP * Added the missing space * Add try statements * return only the first element of the array * debug, print the scs VM ids * debug, print the VM being picked up * print the VM Id of scs vm for better troubleshooting. * Get the last list item * Make the return value a list * Add App IPs to output * testing dual IPs * Temporary remove the output * Remove the unused resources * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. (cherry picked from commit 70f56738828e24a6898e2218c80f942966f6f0d0) * Get the second IP if defined * IP Logic * Update the NIC * Simplify the IP passing * removed the unneeded variables * Fixing the variables * corrected variable name * Variable name * Output variable name * simplify the IP address logic * Add test option for the workload zone * Test option for workload zone --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * Default variable updates * Add the missing variable * Add DNS registration for secondary DNS names * Use count.index * Incorrect variable used * Provide the correct defaults * SQL Disk fixes and DNS Resourcegroup name * Use the correct zone name DOH :) * add db-ha-done file * make the domain_ou_path a variable * task name quotes * Add additional configuration options * Persist the configuration settings * Remove quotes * remove encoding * Adding the Configuration parameters and the instance numbers * Add Linebreaks * become orchestration_ansible_user for the bom downloader playbook * Update the variable with the corrected value * Add a default value * Pass the DNS Resource group * Mounting logic update * Don't persist an empty collections * Added local. * Added the missing .local * Experimental tweaks from ACSS debug session (#417) * Missing variable for non AFS scenarios * Add use secondary ip flag * Add a default value * Create the temp files * Debug mounting * Install * Mounting logic * Don't mount local sapmnt * Alignment * Missing DNS resource group * Added the local. * Reboot handler * Correct the Jinja * Typo in jinja * Add the missing variable * Typo in JINJA * Remove the domain_name variable * hdbuserstore as sidadm * reboot if waconf is changed * Adding rsdb/ssfs_connect to DEFAULT.PFL * Change the failed when condition for SUSE * Adding the python version to support older distros * Add a rescue action for setting ENSA if MessageServer is down * Added logic for restarting message server for HA scenarios * Use scs_running_on is not defined instead * Add try statements * Add try statements * Change the IP for ansible * Add a rescue action for SUSEConnect * Missing region name * BoM update with same name * Provide ssfs_connect environment variable * Don't specify python for deployer * Add a wait * Update message * db_server_temp fix * Misc updates * Create users for Oracle * Don't run User creation * sa flag * Set SA Enabled * Show Debug info * DBLoad * Check storage account * Let SAP create the users * Adding more verbosity * Typo and missing variable * Set sa flag * Don't create users separately when deploying on Oracle * set allow_world_readable_tmpfiles for hdbuserstore code * and when to check for windows family * fix indentation * Addd Windows checks * Adding ORACLE-ASM as platform * Mount install on db node * add acl package to all tiers * add it for all vms * Add TF_LOG to workload and system pipelines --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * Calculate domain if not specified (#419) * Calculate domain if not specified * Missing POOL variable --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> * Release 3.7 pipeline updates (#420) * Calculate domain if not specified * Missing POOL variable * Fix the assert statements * Add the calculated domain * Download files on Windows * Set ARM_USE_MSI * Add use_msi into the provider * Use the correct backend * Adding the suffix * Change provider order * Switch provider * testing how to get MSI ID * Write the MSI Object ID * remove the sensitivity * Remove the "raw" * Show the Deployer MSI * deliberate error * Removed the error * Adding MSI client ID * Don't remove workload VNet changes * Testing jq * Removed jq * source the configuration from deployer * correct source * USE UPN for login * Fix the providers * Add domain calculation * remap providers * Use the main provider * Provide the correct provider for sapmnt * Use source for removals * Remove extra login * Rename variable * Correct the variable * Correct the parameter * Corrected the variable name * Merge branch 'experimental' of https://github.com/KimForss/sap-automation into experimental * fix typos for region code wus2 * Software download tests on Windows * whitespace removal --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * Change Oracle -> OracleLinux * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * ansible lint fixes - minor * ansible lint fixes - minor 002 * ansible lint fixes - minor 003 --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: Kimmo Forss <kimmo.forss@microsoft.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Harm Jan Stam <harmjan+git@harmjan.com> Co-authored-by: Sumit Das <sumit8das@gmail.com>
2023-02-21 19:51:15 +03:00
3.8 release (#436) * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * BOM updates for accommodating Revision 2.00.059.7 (SPS05) for HANA DB 2.0 * Updates to SWPM 2.0 and SWPM 1.0 * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values * Workload zone pipeline updates (#409) * Update vm-webdisp.tf * Add support for dynamiv /hana/backup location * Debugging local install volume creation * JINJA fixes * Remove the if statement * adding is defined * Add better messaging * If workload zone defined AFS use it * AFS download update * Call AFS always * Add SCS diskspace check * /hana/data/backup tests * Take the first item from the list * Show mnt size * Use index * show raw data * simplify the size calculation * show backup location * show backup directory * Use the correct server * Correct the if statement * Move INI generation into the install block * Register BoM in all cases * Run az login earlier in the pipeline * Script updates * Show disk space requirement * Only check size of /usr/sap if it exists * Check if usr_sap is defined * Disk size calculation * missing line feed * Add support for providing ORACLE-ASM * Oracle ASM ports * Oracle - ASM support * Add support for Oracle ASM * Add ORACLE-ASM to playbooks * Oracle ASM support * change UIDs * move the check * calculate scs_virtual_hostname * remove extra part from tag * become for profile * use become for profile * remove duplicates * remove duplicates * Update parameters to accommodate JAVA installations * set become * invoke cluster commands as root * include_tasks instead of import_tasks * test ACSS registration * ACSS variable definitions and echo * Improve echo :-) * indentation * Add the missing call * pipeline updates * Enable SLES 15 SP4 * quote the secret when passing from pipeline and in set_secrets.sh * Disable Private FW * Registery Configuration - Ciphers and Protocols * Add memory dump configuration * Move domain join to roles-os * Add new OS configurations * troubleshooting BoM * Change the failed_when condition * remove duplicate code * debugging * Ansible Lint * troubleshooting * Linting * Linting * Removed the --- * Moved the tags * Debugging * Check directory exists * Create tmp directory * Fixed the Jinja * ensure directories exist * task naming * BoM tests * Linting fixes * Testing * Testing * BoM registration * Update common variable * Test * Revert download Dir * Test * Test * Test * Test * Test * Test * Updated the disks_config.yml * Playbook update - fetch the secrets * Linting * pass the secrets * Task name tweaks * Changed the directory logic * Indentation * SA tweaks * Ignore storage account download errors * Further testing * JAVA Paths for logs * Only validate BoM platform for deployment * setting storage account flag * Add the sa flag * Add platform validation * Log file paths * pass the value back to set fact * set the facts - slight modifications * align to block * align to block * duh! errors * indentation * Commenting out the JAVA ports * Removed the platform check * support redeployment * Test * add region code for wus3 * Test * Test * Test * Test * Additional instance_type's added * add the missing curly braces * SCS ERS installation logic tweaks * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * SAP software provisioning manager (sapinst) should be run with umask 022 (#402) The custom_umask variable allowes overrides of this default setting (cherry picked from commit d0b41974c92582e7c38f21a2c490b615448f1b61) * fix typo in commit #794b912 * Test * NW on Windows Enhancement (#410) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Test * Test * Test * Test * Test * Test * Export the Ansible collections to the correct path * Add tags for disk checking * Set the collection path * Comment out Tests * Comment out Tests * Test * Test * Provide the Ansible collection environment * Update helper scripts * BOM for DB2-11.1 * Windows clustering initial seed. * add quorum part * update pipelines to support NW750SPS20_DB2_11-1_v0001ms * removing unrar as a package for now as it is not directly available from native repos or epel. * handle python interpreter version * validate python interpreter version and logic improvement * need to check logic * missed python_version for the startup scripts * set python version when determining ensa versions * add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines * Remove the -ms from the new BoM * Patch 8 for SOFTWARE UPDATE MANAGER 2.0 SP15 * DevOps creation updates * Cleanup and logging for script * Fix the use_custom_dns_a_registration errors * Add validation for the name components in the tfvars file * Use the correct parameter for awk * Correct the switch * remove whitespace * awk fixes * Move the dos2unix earlier * Move dos2unix * whitespace * indentation * Update the case statement * syntax error * Quotes around the parenthesis * Syntax error for if statement * Add more verbose information * Final version for workload zone * Pipeline updates * System pipeline * Corrected the file name * Pipeline updates * Log on as SPN before ARM deployment * Key vault return values * Variable updates * Use the location code * Logout before running devops tasks * Value is always empty for secrets * Add ability to test deployment * Testing TEST_ONLY * Removed the extra quote * Perform login * Add Test only support * Logon as SPN when doing the system deployment * Show the variable * Show output for Test_Only * Show output * Better output * Fix the workload zone remover pipeline * Fix path * Path checks * Update workload zone removal * Remove control plane * Fix the parameter * ARM Password * USe the correct SPN * Debugging * password * Logon testing * Use the correct Subscription * The default is to use an external DNS registration * Use the prefix for all the templates * Include InstanceType in Jinja template * convert acss registration to playbook * Add the prefix to the BoM name * Use the BoM name * Rename the task * Update the User creation as well * BoM Fixes * Fix [BUG] Secondary IP not reachable #352 (#381) * Misc fixes * DNS storage account * Add DNS for Key Vault * Networking fro dual NICS * Get the install validations * multi-nic configuration updates * Add DNS for File Shares * Use the correct DNS names * pushing the changes * adjust permissions with leading zero * push changes to repo * debugging * Networking code updates * Win Disk configuration Jinja * Remove work in progress files * Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory * Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory * Restore code * Make the default secondary DNS different from the hostname * Return the secondary IP * Added the missing space * Add try statements * return only the first element of the array * debug, print the scs VM ids * debug, print the VM being picked up * print the VM Id of scs vm for better troubleshooting. * Get the last list item * Make the return value a list * Add App IPs to output * testing dual IPs * Temporary remove the output * Remove the unused resources * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. (cherry picked from commit 70f56738828e24a6898e2218c80f942966f6f0d0) * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. * Get the second IP if defined * IP Logic * Update the NIC * Simplify the IP passing * removed the unneeded variables * Fixing the variables * corrected variable name * Variable name * Output variable name * simplify the IP address logic * Add test option for the workload zone * Test option for workload zone * Update Experimental with the latest changes (#414) * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values * fix typo in commit #794b912 * Test * Test * Test * Test * Test * Test * Test * Export the Ansible collections to the correct path * Add tags for disk checking * Set the collection path * Comment out Tests * Comment out Tests * Test * Test * Provide the Ansible collection environment * Update helper scripts * BOM for DB2-11.1 * Windows clustering initial seed. * add quorum part * update pipelines to support NW750SPS20_DB2_11-1_v0001ms * removing unrar as a package for now as it is not directly available from native repos or epel. * handle python interpreter version * validate python interpreter version and logic improvement * need to check logic * missed python_version for the startup scripts * set python version when determining ensa versions * add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines * Remove the -ms from the new BoM * DevOps creation updates * Cleanup and logging for script * Fix the use_custom_dns_a_registration errors * Add validation for the name components in the tfvars file * Use the correct parameter for awk * Correct the switch * remove whitespace * awk fixes * Move the dos2unix earlier * Move dos2unix * whitespace * indentation * Update the case statement * syntax error * Quotes around the parenthesis * Syntax error for if statement * Add more verbose information * Final version for workload zone * Pipeline updates * System pipeline * Corrected the file name * Pipeline updates * Log on as SPN before ARM deployment * Key vault return values * Variable updates * Use the location code * Logout before running devops tasks * Value is always empty for secrets * Add ability to test deployment * Testing TEST_ONLY * Removed the extra quote * Perform login * Add Test only support * Logon as SPN when doing the system deployment * Show the variable * Show output for Test_Only * Show output * Better output * Fix the workload zone remover pipeline * Fix path * Path checks * Update workload zone removal * Remove control plane * Fix the parameter * ARM Password * USe the correct SPN * Debugging * password * Logon testing * Use the correct Subscription * The default is to use an external DNS registration * Use the prefix for all the templates * Include InstanceType in Jinja template * convert acss registration to playbook * Add the prefix to the BoM name * Use the BoM name * Rename the task * Update the User creation as well * BoM Fixes * Misc fixes * DNS storage account * Add DNS for Key Vault * Networking fro dual NICS * Get the install validations * multi-nic configuration updates * Add DNS for File Shares * Use the correct DNS names * pushing the changes * adjust permissions with leading zero * push changes to repo * debugging * Networking code updates * Win Disk configuration Jinja * Remove work in progress files * Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory * Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory * Restore code * Make the default secondary DNS different from the hostname * Return the secondary IP * Added the missing space * Add try statements * return only the first element of the array * debug, print the scs VM ids * debug, print the VM being picked up * print the VM Id of scs vm for better troubleshooting. * Get the last list item * Make the return value a list * Add App IPs to output * testing dual IPs * Temporary remove the output * Remove the unused resources * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. (cherry picked from commit 70f56738828e24a6898e2218c80f942966f6f0d0) * Get the second IP if defined * IP Logic * Update the NIC * Simplify the IP passing * removed the unneeded variables * Fixing the variables * corrected variable name * Variable name * Output variable name * simplify the IP address logic * Add test option for the workload zone * Test option for workload zone --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * Default variable updates * Add the missing variable * Add DNS registration for secondary DNS names * Use count.index * Incorrect variable used * Provide the correct defaults * SQL Disk fixes and DNS Resourcegroup name * Use the correct zone name DOH :) * add db-ha-done file * make the domain_ou_path a variable * task name quotes * Add additional configuration options * Persist the configuration settings * Remove quotes * remove encoding * Adding the Configuration parameters and the instance numbers * Add Linebreaks * become orchestration_ansible_user for the bom downloader playbook * Update the variable with the corrected value * Add a default value * Pass the DNS Resource group * Mounting logic update * Don't persist an empty collections * Added local. * Added the missing .local * Experimental tweaks from ACSS debug session (#417) * Missing variable for non AFS scenarios * Add use secondary ip flag * Add a default value * Create the temp files * Debug mounting * Install * Mounting logic * Don't mount local sapmnt * Alignment * Missing DNS resource group * Added the local. * Reboot handler * Correct the Jinja * Typo in jinja * Add the missing variable * Typo in JINJA * Remove the domain_name variable * hdbuserstore as sidadm * reboot if waconf is changed * Adding rsdb/ssfs_connect to DEFAULT.PFL * Change the failed when condition for SUSE * Adding the python version to support older distros * Add a rescue action for setting ENSA if MessageServer is down * Added logic for restarting message server for HA scenarios * Use scs_running_on is not defined instead * Add try statements * Add try statements * Change the IP for ansible * Add a rescue action for SUSEConnect * Missing region name * BoM update with same name * Provide ssfs_connect environment variable * Don't specify python for deployer * Add a wait * Update message * db_server_temp fix * Misc updates * Create users for Oracle * Don't run User creation * sa flag * Set SA Enabled * Show Debug info * DBLoad * Check storage account * Let SAP create the users * Adding more verbosity * Typo and missing variable * Set sa flag * Don't create users separately when deploying on Oracle * set allow_world_readable_tmpfiles for hdbuserstore code * and when to check for windows family * fix indentation * Addd Windows checks * Adding ORACLE-ASM as platform * Mount install on db node * add acl package to all tiers * add it for all vms * Add TF_LOG to workload and system pipelines --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * Calculate domain if not specified (#419) * Calculate domain if not specified * Missing POOL variable --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> * Release 3.7 pipeline updates (#420) * Calculate domain if not specified * Missing POOL variable * Fix the assert statements * Add the calculated domain * Download files on Windows * Set ARM_USE_MSI * Add use_msi into the provider * Use the correct backend * Adding the suffix * Change provider order * Switch provider * testing how to get MSI ID * Write the MSI Object ID * remove the sensitivity * Remove the "raw" * Show the Deployer MSI * deliberate error * Removed the error * Adding MSI client ID * Don't remove workload VNet changes * Testing jq * Removed jq * source the configuration from deployer * correct source * USE UPN for login * Fix the providers * Add domain calculation * remap providers * Use the main provider * Provide the correct provider for sapmnt * Use source for removals * Remove extra login * Rename variable * Correct the variable * Correct the parameter * Corrected the variable name * Merge branch 'experimental' of https://github.com/KimForss/sap-automation into experimental * fix typos for region code wus2 * Software download tests on Windows * whitespace removal --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * Change Oracle -> OracleLinux * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * ansible lint fixes - minor * ansible lint fixes - minor 002 * ansible lint fixes - minor 003 * Set the Terraform environment variables for non MSFT created deployers * Add Shared Disk for Windows clusters * linting * Added the missing counter * Change download directory to be Agent.TempDirectory * Add SCSHA and ERS inifile for HA deployments of S4HANA_2021_FP01 BOM (#430) * Fix hardcoded HANA port in hdbuserstore list (#435) HANA port in hdbuserstore is hardcoded to 30313 for App and PAS install tasks. Fixed to correctly generate correct port for deployed HANA instances. * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * Pre 3.8 release (#434) * update NSG name * resource_name * Resource name * ConnectivityToSAPApplicationSubnetFromControlPlane-ssh-rdp-winrm * admin subnet * Fix Rescue task for ERS * Use the first item * Use the correct plan * Add the plan details * Add dictionary object type to transform enable Plan * debug plan * debug: plan * Populate source_image_reference even if plan is defined * Remove whitespace * Add more ensa1/ensa2 logic * Add the ability to override ensa1/ensa2 * Add ensa1 for JAVA * Use scs_bom_instance_type * debug - change the resource attribute * Show Ensa1 & Ensa2 * Testing permission setting * test permission DSC * Test SqlPermission * pass necessary variables to the sap specific os configuration * try credssp * further complicate life * CNO needs to be disabled. Reverting credssp changes for now. * checking if we really need the become * enable credssp and try again * remove the becomes * give relative path * changes required for enabling credssp and relative paths for tasks inside blocks. * fixing typos-001 * debug for SQL Server service status * change to using split instead of cidrnetmask * become a domain user * correct plan disctioanry * add a random string to cluster name * shared disk resources * type was defined twice * debug * change names * add clarity in task names * correct the windows cluster svc account name * ensure create cluster is adding the cluster disks * typos in output name * make some changes to the db ha playbook * tier as a set fact persists and overrides the var passed to the role. So change tier to config_tier * the sql server installation tasks are being called. Need to investigate. * small adjustments * small changes * another set of small changes * add a few debugs * commit some small changes * switch to include tasks and include role so that the role/tasks are included as they are encountered. * rename tasks etc * do the installation validation * reorder tasks * missing dsc modules * correct casing for the agent account name * typos in dsc resource names * generic mistakes * parameter names * Test to run without PsDscRunAsCredential_username * make serverpermission a dictionary * pass on permissions * should they be passed liek this * pass the other two states * become true for setting permissions * fix typo again * calculate ag name * calculate ag listener name * hardcoded backup path for now * calculate subnet prefix * debug statements * sql server dsc modules call subnet prefix, unlike the cluster ones. * removed plan * subnet prefixes not available in same set fact * Install CLI the long way * Add support for providing the password for the SPNs * save and push changes before re-run * check if the backup path string is the problem * change the backup path back * Add debug info * support re-run * delegate the add db to ag task to the primary node * The sqlagdatabase as the last task on each node * Add RHEL support * package manager init * correct distro * Add RHEL support * add samples directory * use interactive variables * remove the double $ * Move lsb_release inside of case statement * Azure CLI install * Add the silent flag * show distro * remove the when condition * add config_tier * pass scs servername and add the domain service access to the SAP share * create directories that are needed for restore. * jinja changes * more jinja good ness * change the location from where we call jinja and set fact for disks. * Use the list * More jinja * More jinja * remove the double backslashes * rmove the SLES packages * backslashes * testing * remove the second backslash * remove the replace * fixes * testing * indentation * format * virtualenv * remove curlies * remove local * remove backslashes * Debug * debug * split to list * debugging * Testing directory creation * test the quotes * reduced the output * change quotes to see if regex escaping works differently * Path formatting for windows-test001 * convert it to a list * see if we can assign a var before * let's give it one more shot * more debug * flatten before calling to mimic with_items * add flattened list to debug * set probe port as well * print with loop_control * check what index is being used * modifications to use with_indexed_items * get ip of host * push with_indexed_items * removed the hard coded * probe port * rename probe port script to use ps1 extension * remove spaces between curlies * start ag resource along with ip address * sleep for a minute * Fix the hdbuserstore command * uncomment the sqlagdatabase * give permissions to the domain account * pass netbios domain name * trying something by adding the machine accounts * fixes to sqlpermissions * become * use only become and no dsc credentials * switch to using sidadm account * revert and give db_backupoperator * service accounts * add the user rights properly * set them correctly * fix params for SqlServiceAccount * set dummy pass for gMSA accounts * add a when clause * assign spns * change how dummy pass is encrypted * create spns * maybe we are passing the password wrong * set the correct service account for the sql agent service. * dsc seems to be throwing errors. switch to using win_service * change the ordering. * additional task to start agent service account and remove becomes for the adding database to AG * use sid_for_disks to calculate the sid to use. use sap_sid if db_sid is not defined. * final set of changes. * some more changes * pass in the variables needed * add logic for reboot immediately after the updates. * adding back the domain service account to sql logins * Add a try statement * add endpoint permissions on the second node * Get passwords from key vault * Get the credentials from key vault * update probe port, and its configuration. Add accounts to sysadmin role. * pass in the required variables. * removed curlies * pass in the domain name and the service accounts with the domain\accountname format * Corrected the task name * Set accounts for exports * Do another restart * change listener port * try waiting for the secondary creation * changes not pushed? * check if DB is added to primary and secondary * pass primary node to server name * pass teh correct account name * debug account names * pass domain_sqlsvc_account * remove the extra account calculation step * convert domain name to upper * caching facts leads to weird behaviour * push changes * profile changes etc. * missing curly * simplify the profile updates * update task description * Don't add the same sid multiple times * Centralize the component installation * Move packages call to run after domain join * set tier * Only check the DSC modules once * move the call to playbooks * change the rescue action for scs ha install to use builtin.shell instead of builtin.command * Update Terraform version * Test if the filter fixes disks_facts * Testing if Volumes fixes it * reverse the selection * removed the typo * update path * update the community.windows from the palybook to fix the win_disk_facts module * use builtin.raw with become * pass bash as the executable to use * Use correct venv * Troubleshooting * don't download module * test without rejectattr * Linting changes and removal of BOM-Catalog folder * lint fixes - 0001 --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * simplify the code * add network rules * Fix typos * restore the code * Changed the workload zone SPN naming logic * use DNS if private endpoint * lowercase DNS * DNS and NSG * Add DNS record * Add DNS records * deployer already has the packages * Bump up the version * rename sap_search.yamp file * install Ansible * removed the duplicate * update SQL probe port to handle other cluster parameters as well. * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * try with a linter file in another directory * Update github-actions-ansible-lint.yml * use the older lint-action plugin * add ansible lint badge and fix markdown issues * put all badges on the same line * calculate the path fact for HDB using the db_instance_number * Add SLES as supported deployer --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> Co-authored-by: Harm Jan Stam <harmjan+git@harmjan.com> Co-authored-by: Sumit Das <sumit8das@gmail.com> Co-authored-by: Shekhar Sorot ( MSFT ) <shekharssorot2002@gmail.com>
2023-03-31 16:36:08 +03:00
![Ansible Lint](https://github.com/Azure/sap-automation/workflows/Ansible%20Lint/badge.svg) [![Average time to resolve an issue](http://isitmaintained.com/badge/resolution/azure/sap-automation.svg)](http://isitmaintained.com/project/azure/sap-automation "Average time to resolve an issue") [![Percentage of issues still open](http://isitmaintained.com/badge/open/azure/sap-automation.svg)](http://isitmaintained.com/project/azure/sap-automation "Percentage of issues still open")
Create PR for release v 3.7.0.0 (#421) * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * Fix external support for key vaults * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * Cluster resources control & Terraform formatting (#408) * Use jinja * Add fail condition * add correct comparison * show disk free in GB * select first node * query for inode_available * select only first node * use json query * correct the query * don't convert * Add the disk space assert * make assert jinja * correct the calculation * convert to GB * Fix calculation * set the deployer free disk space threshhold * make free space a parameter * Add a dependency on the disk attachment resource * remove the defaults * Update vm-webdisp.tf * Add support for dynamiv /hana/backup location * Debugging local install volume creation * JINJA fixes * Remove the if statement * adding is defined * Add better messaging * If workload zone defined AFS use it * AFS download update * Call AFS always * Add SCS diskspace check * /hana/data/backup tests * Take the first item from the list * Show mnt size * Use index * show raw data * simplify the size calculation * show backup location * show backup directory * Use the correct server * Correct the if statement * Move INI generation into the install block * Register BoM in all cases * Run az login earlier in the pipeline * Script updates * Show disk space requirement * Only check size of /usr/sap if it exists * Check if usr_sap is defined * Disk size calculation * missing line feed * Add support for providing ORACLE-ASM * Oracle ASM ports * Oracle - ASM support * Add support for Oracle ASM * Add ORACLE-ASM to playbooks * Oracle ASM support * change UIDs * move the check * calculate scs_virtual_hostname * remove extra part from tag * become for profile * use become for profile * remove duplicates * remove duplicates * Update parameters to accommodate JAVA installations * set become * invoke cluster commands as root * include_tasks instead of import_tasks * test ACSS registration * ACSS variable definitions and echo * Improve echo :-) * indentation * Add the missing call * pipeline updates * Enable SLES 15 SP4 * quote the secret when passing from pipeline and in set_secrets.sh * Disable Private FW * Registery Configuration - Ciphers and Protocols * Add memory dump configuration * Move domain join to roles-os * Add new OS configurations * troubleshooting BoM * Change the failed_when condition * remove duplicate code * debugging * Ansible Lint * troubleshooting * Linting * Linting * Removed the --- * Moved the tags * Debugging * Check directory exists * Create tmp directory * Fixed the Jinja * ensure directories exist * task naming * BoM tests * Linting fixes * Testing * Testing * BoM registration * Update common variable * Test * Revert download Dir * Test * Test * Test * Test * Test * Test * Updated the disks_config.yml * Playbook update - fetch the secrets * Linting * pass the secrets * Task name tweaks * Changed the directory logic * Indentation * SA tweaks * Ignore storage account download errors * Further testing * JAVA Paths for logs * Only validate BoM platform for deployment * setting storage account flag * Add the sa flag * Add platform validation * Log file paths * pass the value back to set fact * set the facts - slight modifications * align to block * align to block * duh! errors * indentation * Commenting out the JAVA ports * Removed the platform check * support redeployment * Test * add region code for wus3 * Test * Test * Test * Test * Additional instance_type's added * add the missing curly braces * SCS ERS installation logic tweaks * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * BOM updates for accommodating Revision 2.00.059.7 (SPS05) for HANA DB 2.0 * Updates to SWPM 2.0 and SWPM 1.0 * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values * Workload zone pipeline updates (#409) * Update vm-webdisp.tf * Add support for dynamiv /hana/backup location * Debugging local install volume creation * JINJA fixes * Remove the if statement * adding is defined * Add better messaging * If workload zone defined AFS use it * AFS download update * Call AFS always * Add SCS diskspace check * /hana/data/backup tests * Take the first item from the list * Show mnt size * Use index * show raw data * simplify the size calculation * show backup location * show backup directory * Use the correct server * Correct the if statement * Move INI generation into the install block * Register BoM in all cases * Run az login earlier in the pipeline * Script updates * Show disk space requirement * Only check size of /usr/sap if it exists * Check if usr_sap is defined * Disk size calculation * missing line feed * Add support for providing ORACLE-ASM * Oracle ASM ports * Oracle - ASM support * Add support for Oracle ASM * Add ORACLE-ASM to playbooks * Oracle ASM support * change UIDs * move the check * calculate scs_virtual_hostname * remove extra part from tag * become for profile * use become for profile * remove duplicates * remove duplicates * Update parameters to accommodate JAVA installations * set become * invoke cluster commands as root * include_tasks instead of import_tasks * test ACSS registration * ACSS variable definitions and echo * Improve echo :-) * indentation * Add the missing call * pipeline updates * Enable SLES 15 SP4 * quote the secret when passing from pipeline and in set_secrets.sh * Disable Private FW * Registery Configuration - Ciphers and Protocols * Add memory dump configuration * Move domain join to roles-os * Add new OS configurations * troubleshooting BoM * Change the failed_when condition * remove duplicate code * debugging * Ansible Lint * troubleshooting * Linting * Linting * Removed the --- * Moved the tags * Debugging * Check directory exists * Create tmp directory * Fixed the Jinja * ensure directories exist * task naming * BoM tests * Linting fixes * Testing * Testing * BoM registration * Update common variable * Test * Revert download Dir * Test * Test * Test * Test * Test * Test * Updated the disks_config.yml * Playbook update - fetch the secrets * Linting * pass the secrets * Task name tweaks * Changed the directory logic * Indentation * SA tweaks * Ignore storage account download errors * Further testing * JAVA Paths for logs * Only validate BoM platform for deployment * setting storage account flag * Add the sa flag * Add platform validation * Log file paths * pass the value back to set fact * set the facts - slight modifications * align to block * align to block * duh! errors * indentation * Commenting out the JAVA ports * Removed the platform check * support redeployment * Test * add region code for wus3 * Test * Test * Test * Test * Additional instance_type's added * add the missing curly braces * SCS ERS installation logic tweaks * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * SAP software provisioning manager (sapinst) should be run with umask 022 (#402) The custom_umask variable allowes overrides of this default setting (cherry picked from commit d0b41974c92582e7c38f21a2c490b615448f1b61) * fix typo in commit #794b912 * Test * NW on Windows Enhancement (#410) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Test * Test * Test * Test * Test * Test * Export the Ansible collections to the correct path * Add tags for disk checking * Set the collection path * Comment out Tests * Comment out Tests * Test * Test * Provide the Ansible collection environment * Update helper scripts * BOM for DB2-11.1 * Windows clustering initial seed. * add quorum part * update pipelines to support NW750SPS20_DB2_11-1_v0001ms * removing unrar as a package for now as it is not directly available from native repos or epel. * handle python interpreter version * validate python interpreter version and logic improvement * need to check logic * missed python_version for the startup scripts * set python version when determining ensa versions * add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines * Remove the -ms from the new BoM * Patch 8 for SOFTWARE UPDATE MANAGER 2.0 SP15 * DevOps creation updates * Cleanup and logging for script * Fix the use_custom_dns_a_registration errors * Add validation for the name components in the tfvars file * Use the correct parameter for awk * Correct the switch * remove whitespace * awk fixes * Move the dos2unix earlier * Move dos2unix * whitespace * indentation * Update the case statement * syntax error * Quotes around the parenthesis * Syntax error for if statement * Add more verbose information * Final version for workload zone * Pipeline updates * System pipeline * Corrected the file name * Pipeline updates * Log on as SPN before ARM deployment * Key vault return values * Variable updates * Use the location code * Logout before running devops tasks * Value is always empty for secrets * Add ability to test deployment * Testing TEST_ONLY * Removed the extra quote * Perform login * Add Test only support * Logon as SPN when doing the system deployment * Show the variable * Show output for Test_Only * Show output * Better output * Fix the workload zone remover pipeline * Fix path * Path checks * Update workload zone removal * Remove control plane * Fix the parameter * ARM Password * USe the correct SPN * Debugging * password * Logon testing * Use the correct Subscription * The default is to use an external DNS registration * Use the prefix for all the templates * Include InstanceType in Jinja template * convert acss registration to playbook * Add the prefix to the BoM name * Use the BoM name * Rename the task * Update the User creation as well * BoM Fixes * Fix [BUG] Secondary IP not reachable #352 (#381) * Misc fixes * DNS storage account * Add DNS for Key Vault * Networking fro dual NICS * Get the install validations * multi-nic configuration updates * Add DNS for File Shares * Use the correct DNS names * pushing the changes * adjust permissions with leading zero * push changes to repo * debugging * Networking code updates * Win Disk configuration Jinja * Remove work in progress files * Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory * Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory * Restore code * Make the default secondary DNS different from the hostname * Return the secondary IP * Added the missing space * Add try statements * return only the first element of the array * debug, print the scs VM ids * debug, print the VM being picked up * print the VM Id of scs vm for better troubleshooting. * Get the last list item * Make the return value a list * Add App IPs to output * testing dual IPs * Temporary remove the output * Remove the unused resources * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. (cherry picked from commit 70f56738828e24a6898e2218c80f942966f6f0d0) * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. * Get the second IP if defined * IP Logic * Update the NIC * Simplify the IP passing * removed the unneeded variables * Fixing the variables * corrected variable name * Variable name * Output variable name * simplify the IP address logic * Add test option for the workload zone * Test option for workload zone * Update Experimental with the latest changes (#414) * Calculate the second port * format * formatting woes * check SCS & ERS creation * Add better validation * append to group * adding limits for app tier * remove sudoers * block ERS install if SCS fails * Test * Test * Adding OracleLinux8 * set sa_enabled flag * Add default for instance_type * Add BoM support to Web App * Adding the insance type * introduce dependency on disk attachment for extension * don't check /usr/sap on Windows * Windows fixes * add code, need to refactor later, for JAVA HA profile updates before PAS installation * determine ensa1 for java * add backupdba group * Logging & windows * dgdba_gid * Added dgdba_gid * PAS log updates * Added kmdba, racdba * Add instance type to DBLoad * Count the db virtual host name for all cases * observer fixes * added backupdba * remove the /PD * add racdba * Moved variable definition * Tweaks for InstanceType * Don't use the download variable * Linting * Testing extraction * Update NW_MSSQL_v0001ms-dbload-inifile-param.j2 * Update NW_MSSQL_v0001ms.yaml Update the product ID for the DBLoad, SUM version, add SAPCAR * update to use ansible.utils and changes to mss dbload jinja * fix templating error in db2 mounts created during java deployments * Wait for the processes to end * pick up the right tasks * Cluster checks * Find sapcontrol * changes to BOM and validation * First edit of the cluster validation play * Change directory name * LD_LIBRARY_PATH update * Vault DNS * updates to cluster validation * follow symlinks for find * templating fixes for isntance type * cut option typo * become root for cluster commands * missing ';' * failed_when * failed_when conditions * sleep for 60 second * cleanup the provisioning. * simplify the code * Change the download directory * Revert * home directory * Add a fix for the unbound variable * download paths * comment out serialization * remove the unneeded no_logs * Set the unbound variables * Add support for creating fileshares in existing storage accounts * Terraform fmt for all files * Test * Test * add westus3 * add WUS3 to boilerplate * add WUS3 to boilerplate * Logon as SPN before creating deployment * Save installation media storage account name * Fix the ACSS registration * Increment the version * Add SLES 15 SP4 support to the Web App * Move the git pull later * resource group for ANF calculation * comment out az sub in install_workloadzone and quote variable in workloadzone pipeline * few quoting and space issues * Ansible Linting * Don't use the sapmnt nic datasource for non AFS deployments * calculate private link only for AFS * Add support for existing sapmnt * Create SAP ERP 6.0 for Windows on MSSQL * Add the throughput values * fix typo in commit #794b912 * Test * Test * Test * Test * Test * Test * Test * Export the Ansible collections to the correct path * Add tags for disk checking * Set the collection path * Comment out Tests * Comment out Tests * Test * Test * Provide the Ansible collection environment * Update helper scripts * BOM for DB2-11.1 * Windows clustering initial seed. * add quorum part * update pipelines to support NW750SPS20_DB2_11-1_v0001ms * removing unrar as a package for now as it is not directly available from native repos or epel. * handle python interpreter version * validate python interpreter version and logic improvement * need to check logic * missed python_version for the startup scripts * set python version when determining ensa versions * add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines * Remove the -ms from the new BoM * DevOps creation updates * Cleanup and logging for script * Fix the use_custom_dns_a_registration errors * Add validation for the name components in the tfvars file * Use the correct parameter for awk * Correct the switch * remove whitespace * awk fixes * Move the dos2unix earlier * Move dos2unix * whitespace * indentation * Update the case statement * syntax error * Quotes around the parenthesis * Syntax error for if statement * Add more verbose information * Final version for workload zone * Pipeline updates * System pipeline * Corrected the file name * Pipeline updates * Log on as SPN before ARM deployment * Key vault return values * Variable updates * Use the location code * Logout before running devops tasks * Value is always empty for secrets * Add ability to test deployment * Testing TEST_ONLY * Removed the extra quote * Perform login * Add Test only support * Logon as SPN when doing the system deployment * Show the variable * Show output for Test_Only * Show output * Better output * Fix the workload zone remover pipeline * Fix path * Path checks * Update workload zone removal * Remove control plane * Fix the parameter * ARM Password * USe the correct SPN * Debugging * password * Logon testing * Use the correct Subscription * The default is to use an external DNS registration * Use the prefix for all the templates * Include InstanceType in Jinja template * convert acss registration to playbook * Add the prefix to the BoM name * Use the BoM name * Rename the task * Update the User creation as well * BoM Fixes * Misc fixes * DNS storage account * Add DNS for Key Vault * Networking fro dual NICS * Get the install validations * multi-nic configuration updates * Add DNS for File Shares * Use the correct DNS names * pushing the changes * adjust permissions with leading zero * push changes to repo * debugging * Networking code updates * Win Disk configuration Jinja * Remove work in progress files * Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory * Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory * Restore code * Make the default secondary DNS different from the hostname * Return the secondary IP * Added the missing space * Add try statements * return only the first element of the array * debug, print the scs VM ids * debug, print the VM being picked up * print the VM Id of scs vm for better troubleshooting. * Get the last list item * Make the return value a list * Add App IPs to output * testing dual IPs * Temporary remove the output * Remove the unused resources * Enhance extracting SAP .exe files for Windows (#412) * Update the NW on MSSQL related BOM * Update the sidadm password * Create SAP ERP 6.0 for Windows on MSSQL * Update the APP VirtualHostname Variable * Fix Visual C++ realted issues * Enhance extracting SAP .exe files for Windows * Upgade ansible.windows collection * Revert "Upgade ansible.windows collection" This reverts commit b7c73562ee66545de142e0eb1fbe4b35d183ae39. (cherry picked from commit 70f56738828e24a6898e2218c80f942966f6f0d0) * Get the second IP if defined * IP Logic * Update the NIC * Simplify the IP passing * removed the unneeded variables * Fixing the variables * corrected variable name * Variable name * Output variable name * simplify the IP address logic * Add test option for the workload zone * Test option for workload zone --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com> * Default variable updates * Add the missing variable * Add DNS registration for secondary DNS names * Use count.index * Incorrect variable used * Provide the correct defaults * SQL Disk fixes and DNS Resourcegroup name * Use the correct zone name DOH :) * add db-ha-done file * make the domain_ou_path a variable * task name quotes * Add additional configuration options * Persist the configuration settings * Remove quotes * remove encoding * Adding the Configuration parameters and the instance numbers * Add Linebreaks * become orchestration_ansible_user for the bom downloader playbook * Update the variable with the corrected value * Add a default value * Pass the DNS Resource group * Mounting logic update * Don't persist an empty collections * Added local. * Added the missing .local * Experimental tweaks from ACSS debug session (#417) * Missing variable for non AFS scenarios * Add use secondary ip flag * Add a default value * Create the temp files * Debug mounting * Install * Mounting logic * Don't mount local sapmnt * Alignment * Missing DNS resource group * Added the local. * Reboot handler * Correct the Jinja * Typo in jinja * Add the missing variable * Typo in JINJA * Remove the domain_name variable * hdbuserstore as sidadm * reboot if waconf is changed * Adding rsdb/ssfs_connect to DEFAULT.PFL * Change the failed when condition for SUSE * Adding the python version to support older distros * Add a rescue action for setting ENSA if MessageServer is down * Added logic for restarting message server for HA scenarios * Use scs_running_on is not defined instead * Add try statements * Add try statements * Change the IP for ansible * Add a rescue action for SUSEConnect * Missing region name * BoM update with same name * Provide ssfs_connect environment variable * Don't specify python for deployer * Add a wait * Update message * db_server_temp fix * Misc updates * Create users for Oracle * Don't run User creation * sa flag * Set SA Enabled * Show Debug info * DBLoad * Check storage account * Let SAP create the users * Adding more verbosity * Typo and missing variable * Set sa flag * Don't create users separately when deploying on Oracle * set allow_world_readable_tmpfiles for hdbuserstore code * and when to check for windows family * fix indentation * Addd Windows checks * Adding ORACLE-ASM as platform * Mount install on db node * add acl package to all tiers * add it for all vms * Add TF_LOG to workload and system pipelines --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * Calculate domain if not specified (#419) * Calculate domain if not specified * Missing POOL variable --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> * Release 3.7 pipeline updates (#420) * Calculate domain if not specified * Missing POOL variable * Fix the assert statements * Add the calculated domain * Download files on Windows * Set ARM_USE_MSI * Add use_msi into the provider * Use the correct backend * Adding the suffix * Change provider order * Switch provider * testing how to get MSI ID * Write the MSI Object ID * remove the sensitivity * Remove the "raw" * Show the Deployer MSI * deliberate error * Removed the error * Adding MSI client ID * Don't remove workload VNet changes * Testing jq * Removed jq * source the configuration from deployer * correct source * USE UPN for login * Fix the providers * Add domain calculation * remap providers * Use the main provider * Provide the correct provider for sapmnt * Use source for removals * Remove extra login * Rename variable * Correct the variable * Correct the parameter * Corrected the variable name * Merge branch 'experimental' of https://github.com/KimForss/sap-automation into experimental * fix typos for region code wus2 * Software download tests on Windows * whitespace removal --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: hdamecharla <hdamecharla@microsoft.com> * Change Oracle -> OracleLinux * Update github-actions-ansible-lint.yml * Update github-actions-ansible-lint.yml * ansible lint fixes - minor * ansible lint fixes - minor 002 * ansible lint fixes - minor 003 --------- Co-authored-by: Kimmo Forss <kimforss@microsoft.com> Co-authored-by: Morgan Deegan <morgan@unicorn.town> Co-authored-by: Kimmo Forss <kimmo.forss@microsoft.com> Co-authored-by: Robert Biro <Robert.Biro@microsoft.com> Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com> Co-authored-by: Harm Jan Stam <harmjan+git@harmjan.com> Co-authored-by: Sumit Das <sumit8das@gmail.com>
2023-02-21 19:51:15 +03:00
2021-11-17 20:29:07 +03:00
## Partnership
The project is being build in partnership with [SUSE](https://www.suse.com/) and [Red Hat](https://www.redhat.com/)
2021-11-16 21:43:15 +03:00
2021-11-17 21:20:32 +03:00
## Documentation
The user guidance can be located here [SAP deployment automation framework](https://docs.microsoft.com/azure/virtual-machines/workloads/sap/automation-deployment-framework)
2021-11-16 21:43:15 +03:00
## Contributing
2021-11-17 20:29:07 +03:00
If you want to contribute to our project, be sure to review the [contributing guidelines](/CONTRIBUTING.md).
We use [GitHub issues](https://github.com/Azure/sap-automation/issues/) for feature requests and bugs.
2021-11-16 21:43:15 +03:00
This project welcomes contributions and suggestions. Most contributions require you to agree to a
Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us
2021-11-17 20:29:07 +03:00
the rights to use your contribution. For details, visit <https://cla.opensource.microsoft.com>.
2021-11-16 21:43:15 +03:00
When you submit a pull request, a CLA bot will automatically determine whether you need to provide
a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions
provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/).
For more information see the [Code of Conduct FAQ](https://opensource.microsoft.com/codeofconduct/faq/) or
contact [opencode@microsoft.com](mailto:opencode@microsoft.com) with any additional questions or comments.
## Trademarks
2021-11-17 20:29:07 +03:00
This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft
trademarks or logos is subject to and must follow
2021-11-16 21:43:15 +03:00
[Microsoft's Trademark & Brand Guidelines](https://www.microsoft.com/en-us/legal/intellectualproperty/trademarks/usage/general).
Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship.
Any use of third-party trademarks or logos are subject to those third-party's policies.