Граф коммитов

6 Коммитов

Автор SHA1 Сообщение Дата
Kimmo Forss ae3d7c3b26
3.8 release (#436)
* Save installation media storage account name

* Fix the ACSS registration

* Increment the version

* Add SLES 15 SP4 support to the Web App

* Move the git pull later

* Don't use the sapmnt nic datasource for non AFS deployments

* calculate private link only for AFS

* Add support for existing sapmnt

* BOM updates for accommodating Revision 2.00.059.7 (SPS05) for HANA DB 2.0

* Updates to SWPM 2.0 and SWPM 1.0

* Create SAP ERP 6.0 for Windows on MSSQL

* Add the throughput values

* Workload zone pipeline updates (#409)

* Update vm-webdisp.tf

* Add support for dynamiv /hana/backup location

* Debugging local install volume creation

* JINJA fixes

* Remove the if statement

* adding is defined

* Add better messaging

* If workload zone defined AFS use it

* AFS download update

* Call AFS always

* Add SCS diskspace check

* /hana/data/backup tests

* Take the first item from the list

* Show mnt size

* Use index

* show raw data

* simplify the size calculation

* show backup location

* show backup directory

* Use the correct server

* Correct the if statement

* Move INI generation into the install block

* Register BoM in all cases

* Run az login earlier in the pipeline

* Script updates

* Show disk space requirement

* Only check size of /usr/sap if it exists

* Check if usr_sap is defined

* Disk size calculation

* missing line feed

* Add support for providing ORACLE-ASM

* Oracle ASM ports

* Oracle - ASM support

* Add support for Oracle ASM

* Add ORACLE-ASM to playbooks

* Oracle ASM support

* change UIDs

* move the check

* calculate scs_virtual_hostname

* remove extra part from tag

* become for profile

* use become for profile

* remove duplicates

* remove duplicates

* Update parameters to accommodate JAVA installations

* set become

* invoke cluster commands as root

* include_tasks instead of import_tasks

* test ACSS registration

* ACSS variable definitions and echo

* Improve echo :-)

* indentation

* Add the missing call

* pipeline updates

* Enable SLES 15 SP4

* quote the secret when passing from pipeline and in set_secrets.sh

* Disable Private FW

* Registery Configuration - Ciphers and Protocols

* Add memory dump configuration

* Move domain join to roles-os

* Add new OS configurations

* troubleshooting BoM

* Change the failed_when condition

* remove duplicate code

* debugging

* Ansible Lint

* troubleshooting

* Linting

* Linting

* Removed the ---

* Moved the tags

* Debugging

* Check directory exists

* Create tmp directory

* Fixed the Jinja

* ensure directories exist

* task naming

* BoM tests

* Linting fixes

* Testing

* Testing

* BoM registration

* Update common variable

* Test

* Revert download Dir

* Test

* Test

* Test

* Test

* Test

* Test

* Updated the disks_config.yml

* Playbook update - fetch the secrets

* Linting

* pass the secrets

* Task name tweaks

* Changed the directory logic

* Indentation

* SA tweaks

* Ignore storage account download errors

* Further testing

* JAVA Paths for logs

* Only validate BoM platform for deployment

* setting storage account flag

* Add the sa flag

* Add platform validation

* Log file paths

* pass the value back to set fact

* set the facts - slight modifications

* align to block

* align to block

* duh! errors

* indentation

* Commenting out the JAVA ports

* Removed the platform check

* support redeployment

* Test

* add region code for wus3

* Test

* Test

* Test

* Test

* Additional instance_type's added

* add the missing curly braces

* SCS ERS installation logic tweaks

* Calculate the second port

* format

* formatting woes

* check SCS & ERS creation

* Add better validation

* append to group

* adding limits for app tier

* remove sudoers

* block ERS install if SCS fails

* Test

* Test

* Adding OracleLinux8

* set sa_enabled flag

* Add default for instance_type

* Add BoM support to Web App

* Adding the insance type

* introduce dependency on disk attachment for extension

* don't check /usr/sap on Windows

* Windows fixes

* add code, need to refactor later, for JAVA HA profile updates before PAS installation

* determine ensa1 for java

* add backupdba group

* Logging & windows

* dgdba_gid

* Added dgdba_gid

* PAS log updates

* Added kmdba, racdba

* Add instance type to DBLoad

* Count the db virtual host name for all cases

* observer fixes

* added backupdba

* remove the /PD

* add racdba

* Moved variable definition

* Tweaks for InstanceType

* Don't use the download variable

* Linting

* Testing extraction

* Update NW_MSSQL_v0001ms-dbload-inifile-param.j2

* Update NW_MSSQL_v0001ms.yaml

Update the product ID for the DBLoad, SUM version, add SAPCAR

* update to use ansible.utils and changes to mss dbload jinja

* fix templating error in db2 mounts created during java deployments

* Wait for the processes to end

* pick up the right tasks

* Cluster checks

* Find sapcontrol

* changes to BOM and validation

* First edit of the cluster validation play

* Change directory name

* LD_LIBRARY_PATH update

* Vault DNS

* updates to cluster validation

* follow symlinks for find

* templating fixes for isntance type

* cut option typo

* become root for cluster commands

* missing ';'

* failed_when

* failed_when conditions

* sleep for 60 second

* cleanup the provisioning.

* simplify the code

* Change the download directory

* Revert

* home directory

* Add a fix for the unbound variable

* download paths

* comment out serialization

* remove the unneeded no_logs

* Set the unbound variables

* Add support for creating fileshares in existing storage accounts

* Terraform fmt for all files

* Test

* Test

* add westus3

* add WUS3 to boilerplate

* add WUS3 to boilerplate

* Logon as SPN before creating deployment

* Save installation media storage account name

* Fix the ACSS registration

* Increment the version

* Add SLES 15 SP4 support to the Web App

* Move the git pull later

* resource group for ANF calculation

* comment out az sub in install_workloadzone and quote variable in workloadzone pipeline

* few quoting and space issues

* Ansible Linting

* Don't use the sapmnt nic datasource for non AFS deployments

* calculate private link only for AFS

* Add support for existing sapmnt

* Create SAP ERP 6.0 for Windows on MSSQL

* Add the throughput values

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>
Co-authored-by: Robert Biro <Robert.Biro@microsoft.com>
Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com>
Co-authored-by: Morgan Deegan <morgan@unicorn.town>
Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com>

* SAP software provisioning manager (sapinst) should be run with umask 022 (#402)

The custom_umask variable allowes overrides of this default setting

(cherry picked from commit d0b41974c9)

* fix typo in commit #794b912

* Test

* NW on Windows Enhancement (#410)

* Update the NW on MSSQL related BOM

* Update the sidadm password

* Create SAP ERP 6.0 for Windows on MSSQL

* Update the APP VirtualHostname Variable

* Fix Visual C++ realted issues

* Test

* Test

* Test

* Test

* Test

* Test

* Export the Ansible collections to the correct path

* Add tags for disk checking

* Set the collection path

* Comment out Tests

* Comment out Tests

* Test

* Test

* Provide the Ansible collection environment

* Update helper scripts

* BOM for DB2-11.1

* Windows clustering initial seed.

* add quorum part

* update pipelines to support NW750SPS20_DB2_11-1_v0001ms

* removing unrar as a package for now as it is not directly available from native repos or epel.

* handle python interpreter version

* validate python interpreter version and logic improvement

* need to check logic

* missed python_version for the startup scripts

* set python version when determining ensa versions

* add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines

* Remove the -ms from the new BoM

* Patch 8 for SOFTWARE UPDATE MANAGER 2.0 SP15

* DevOps creation updates

* Cleanup and logging for script

* Fix the use_custom_dns_a_registration errors

* Add validation for the name components in the tfvars file

* Use the correct parameter for awk

* Correct the switch

* remove whitespace

* awk fixes

* Move  the dos2unix earlier

* Move dos2unix

* whitespace

* indentation

* Update the case statement

* syntax error

* Quotes around the parenthesis

* Syntax error for if statement

* Add more verbose information

* Final version for workload zone

* Pipeline updates

* System pipeline

* Corrected the file name

* Pipeline updates

* Log on as SPN before ARM deployment

* Key vault return values

* Variable updates

* Use the location code

* Logout before running devops tasks

* Value is always empty for secrets

* Add ability to test deployment

* Testing TEST_ONLY

* Removed the extra quote

* Perform login

* Add Test only support

* Logon as SPN when doing the system deployment

* Show the variable

* Show output for Test_Only

* Show output

* Better output

* Fix the workload zone remover pipeline

* Fix path

* Path checks

* Update workload zone removal

* Remove control plane

* Fix the parameter

* ARM Password

* USe the correct SPN

* Debugging

* password

* Logon testing

* Use the correct Subscription

* The default is to use an external DNS registration

* Use the prefix for all the templates

* Include InstanceType in Jinja template

* convert acss registration to playbook

* Add the prefix to the BoM name

* Use the BoM name

* Rename the task

* Update the User creation as well

* BoM Fixes

* Fix [BUG] Secondary IP not reachable #352 (#381)

* Misc fixes

* DNS storage account

* Add DNS for Key Vault

* Networking fro dual NICS

* Get the install validations

* multi-nic configuration updates

* Add DNS for File Shares

* Use the correct DNS names

* pushing the changes

* adjust permissions with leading zero

* push changes to repo

* debugging

* Networking code updates

* Win Disk configuration Jinja

* Remove work in progress files

* Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory

* Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory

* Restore code

* Make the default secondary DNS different from the hostname

* Return the secondary IP

* Added the missing space

* Add try statements

* return only the first element of the array

* debug, print the scs VM ids

* debug, print the VM being picked up

* print the VM Id of scs vm for better troubleshooting.

* Get the last list item

* Make the return value a list

* Add App IPs to output

* testing dual IPs

* Temporary remove the output

* Remove the unused resources

* Enhance extracting SAP .exe files for Windows (#412)

* Update the NW on MSSQL related BOM

* Update the sidadm password

* Create SAP ERP 6.0 for Windows on MSSQL

* Update the APP VirtualHostname Variable

* Fix Visual C++ realted issues

* Enhance extracting SAP .exe files for Windows

* Upgade ansible.windows collection

* Revert "Upgade ansible.windows collection"

This reverts commit b7c73562ee.

(cherry picked from commit 70f5673882)

* Enhance extracting SAP .exe files for Windows (#412)

* Update the NW on MSSQL related BOM

* Update the sidadm password

* Create SAP ERP 6.0 for Windows on MSSQL

* Update the APP VirtualHostname Variable

* Fix Visual C++ realted issues

* Enhance extracting SAP .exe files for Windows

* Upgade ansible.windows collection

* Revert "Upgade ansible.windows collection"

This reverts commit b7c73562ee.

* Get the second IP if defined

* IP Logic

* Update the NIC

* Simplify the IP passing

* removed the unneeded variables

* Fixing the variables

* corrected variable name

* Variable name

* Output variable name

* simplify the IP address logic

* Add test option for the workload zone

* Test option for workload zone

* Update Experimental with the latest changes (#414)

* Calculate the second port

* format

* formatting woes

* check SCS & ERS creation

* Add better validation

* append to group

* adding limits for app tier

* remove sudoers

* block ERS install if SCS fails

* Test

* Test

* Adding OracleLinux8

* set sa_enabled flag

* Add default for instance_type

* Add BoM support to Web App

* Adding the insance type

* introduce dependency on disk attachment for extension

* don't check /usr/sap on Windows

* Windows fixes

* add code, need to refactor later, for JAVA HA profile updates before PAS installation

* determine ensa1 for java

* add backupdba group

* Logging & windows

* dgdba_gid

* Added dgdba_gid

* PAS log updates

* Added kmdba, racdba

* Add instance type to DBLoad

* Count the db virtual host name for all cases

* observer fixes

* added backupdba

* remove the /PD

* add racdba

* Moved variable definition

* Tweaks for InstanceType

* Don't use the download variable

* Linting

* Testing extraction

* Update NW_MSSQL_v0001ms-dbload-inifile-param.j2

* Update NW_MSSQL_v0001ms.yaml

Update the product ID for the DBLoad, SUM version, add SAPCAR

* update to use ansible.utils and changes to mss dbload jinja

* fix templating error in db2 mounts created during java deployments

* Wait for the processes to end

* pick up the right tasks

* Cluster checks

* Find sapcontrol

* changes to BOM and validation

* First edit of the cluster validation play

* Change directory name

* LD_LIBRARY_PATH update

* Vault DNS

* updates to cluster validation

* follow symlinks for find

* templating fixes for isntance type

* cut option typo

* become root for cluster commands

* missing ';'

* failed_when

* failed_when conditions

* sleep for 60 second

* cleanup the provisioning.

* simplify the code

* Change the download directory

* Revert

* home directory

* Add a fix for the unbound variable

* download paths

* comment out serialization

* remove the unneeded no_logs

* Set the unbound variables

* Add support for creating fileshares in existing storage accounts

* Terraform fmt for all files

* Test

* Test

* add westus3

* add WUS3 to boilerplate

* add WUS3 to boilerplate

* Logon as SPN before creating deployment

* Save installation media storage account name

* Fix the ACSS registration

* Increment the version

* Add SLES 15 SP4 support to the Web App

* Move the git pull later

* resource group for ANF calculation

* comment out az sub in install_workloadzone and quote variable in workloadzone pipeline

* few quoting and space issues

* Ansible Linting

* Don't use the sapmnt nic datasource for non AFS deployments

* calculate private link only for AFS

* Add support for existing sapmnt

* Create SAP ERP 6.0 for Windows on MSSQL

* Add the throughput values

* fix typo in commit #794b912

* Test

* Test

* Test

* Test

* Test

* Test

* Test

* Export the Ansible collections to the correct path

* Add tags for disk checking

* Set the collection path

* Comment out Tests

* Comment out Tests

* Test

* Test

* Provide the Ansible collection environment

* Update helper scripts

* BOM for DB2-11.1

* Windows clustering initial seed.

* add quorum part

* update pipelines to support NW750SPS20_DB2_11-1_v0001ms

* removing unrar as a package for now as it is not directly available from native repos or epel.

* handle python interpreter version

* validate python interpreter version and logic improvement

* need to check logic

* missed python_version for the startup scripts

* set python version when determining ensa versions

* add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines

* Remove the -ms from the new BoM

* DevOps creation updates

* Cleanup and logging for script

* Fix the use_custom_dns_a_registration errors

* Add validation for the name components in the tfvars file

* Use the correct parameter for awk

* Correct the switch

* remove whitespace

* awk fixes

* Move  the dos2unix earlier

* Move dos2unix

* whitespace

* indentation

* Update the case statement

* syntax error

* Quotes around the parenthesis

* Syntax error for if statement

* Add more verbose information

* Final version for workload zone

* Pipeline updates

* System pipeline

* Corrected the file name

* Pipeline updates

* Log on as SPN before ARM deployment

* Key vault return values

* Variable updates

* Use the location code

* Logout before running devops tasks

* Value is always empty for secrets

* Add ability to test deployment

* Testing TEST_ONLY

* Removed the extra quote

* Perform login

* Add Test only support

* Logon as SPN when doing the system deployment

* Show the variable

* Show output for Test_Only

* Show output

* Better output

* Fix the workload zone remover pipeline

* Fix path

* Path checks

* Update workload zone removal

* Remove control plane

* Fix the parameter

* ARM Password

* USe the correct SPN

* Debugging

* password

* Logon testing

* Use the correct Subscription

* The default is to use an external DNS registration

* Use the prefix for all the templates

* Include InstanceType in Jinja template

* convert acss registration to playbook

* Add the prefix to the BoM name

* Use the BoM name

* Rename the task

* Update the User creation as well

* BoM Fixes

* Misc fixes

* DNS storage account

* Add DNS for Key Vault

* Networking fro dual NICS

* Get the install validations

* multi-nic configuration updates

* Add DNS for File Shares

* Use the correct DNS names

* pushing the changes

* adjust permissions with leading zero

* push changes to repo

* debugging

* Networking code updates

* Win Disk configuration Jinja

* Remove work in progress files

* Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory

* Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory

* Restore code

* Make the default secondary DNS different from the hostname

* Return the secondary IP

* Added the missing space

* Add try statements

* return only the first element of the array

* debug, print the scs VM ids

* debug, print the VM being picked up

* print the VM Id of scs vm for better troubleshooting.

* Get the last list item

* Make the return value a list

* Add App IPs to output

* testing dual IPs

* Temporary remove the output

* Remove the unused resources

* Enhance extracting SAP .exe files for Windows (#412)

* Update the NW on MSSQL related BOM

* Update the sidadm password

* Create SAP ERP 6.0 for Windows on MSSQL

* Update the APP VirtualHostname Variable

* Fix Visual C++ realted issues

* Enhance extracting SAP .exe files for Windows

* Upgade ansible.windows collection

* Revert "Upgade ansible.windows collection"

This reverts commit b7c73562ee.

(cherry picked from commit 70f5673882)

* Get the second IP if defined

* IP Logic

* Update the NIC

* Simplify the IP passing

* removed the unneeded variables

* Fixing the variables

* corrected variable name

* Variable name

* Output variable name

* simplify the IP address logic

* Add test option for the workload zone

* Test option for workload zone

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>
Co-authored-by: Morgan Deegan <morgan@unicorn.town>
Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com>
Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com>

* Default variable updates

* Add the missing variable

* Add DNS registration for secondary DNS names

* Use count.index

* Incorrect variable used

* Provide the correct defaults

* SQL Disk fixes and DNS Resourcegroup name

* Use the correct zone name DOH :)

* add db-ha-done file

* make the domain_ou_path a variable

* task name quotes

* Add additional configuration options

* Persist the configuration settings

* Remove quotes

* remove encoding

* Adding the Configuration parameters and the instance numbers

* Add Linebreaks

* become orchestration_ansible_user for the bom downloader playbook

* Update the variable with the corrected value

* Add a default value

* Pass the DNS Resource group

* Mounting logic update

* Don't persist an empty collections

* Added local.

* Added the missing .local

* Experimental tweaks from ACSS debug session (#417)

* Missing variable for non AFS scenarios

* Add use secondary ip flag

* Add a default value

* Create the temp files

* Debug mounting

* Install

* Mounting logic

* Don't mount local sapmnt

* Alignment

* Missing DNS resource group

* Added the local.

* Reboot handler

* Correct the Jinja

* Typo in jinja

* Add the missing variable

* Typo in JINJA

* Remove the domain_name variable

* hdbuserstore as sidadm

* reboot if waconf is changed

* Adding rsdb/ssfs_connect to DEFAULT.PFL

* Change the failed when condition for SUSE

* Adding the python version to support older distros

* Add a rescue action for setting ENSA if MessageServer is down

* Added logic for restarting message server for HA scenarios

* Use scs_running_on is not defined instead

* Add try statements

* Add try statements

* Change the IP for ansible

* Add a rescue action for SUSEConnect

* Missing region name

* BoM update with same name

* Provide ssfs_connect environment variable

* Don't specify python for deployer

* Add a wait

* Update message

* db_server_temp fix

* Misc updates

* Create users for Oracle

* Don't run User creation

* sa flag

* Set SA Enabled

* Show Debug info

* DBLoad

* Check storage account

* Let SAP create the users

* Adding more verbosity

* Typo and missing variable

* Set sa flag

* Don't create users separately when deploying on Oracle

* set allow_world_readable_tmpfiles for hdbuserstore code

* and when to check for windows family

* fix indentation

* Addd Windows checks

* Adding ORACLE-ASM as platform

* Mount install on db node

* add acl package to all tiers

* add it for all vms

* Add TF_LOG to workload and system pipelines

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>

* Calculate domain if not specified (#419)

* Calculate domain if not specified

* Missing POOL variable

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>

* Release 3.7 pipeline updates (#420)

* Calculate domain if not specified

* Missing POOL variable

* Fix the assert statements

* Add the calculated domain

* Download files on Windows

* Set ARM_USE_MSI

* Add use_msi into the provider

* Use the correct backend

* Adding the suffix

* Change provider order

* Switch provider

* testing how to get MSI ID

* Write the MSI Object ID

* remove the sensitivity

* Remove the "raw"

* Show the Deployer MSI

* deliberate error

* Removed the error

* Adding MSI client ID

* Don't remove workload VNet changes

* Testing jq

* Removed jq

* source the configuration from deployer

* correct source

* USE UPN for login

* Fix the providers

* Add domain calculation

* remap providers

* Use the main provider

* Provide the correct provider for sapmnt

* Use source for removals

* Remove extra login

* Rename variable

* Correct the variable

* Correct the parameter

* Corrected the variable name

* Merge branch 'experimental' of https://github.com/KimForss/sap-automation into experimental

* fix typos for region code wus2

* Software download tests on Windows

* whitespace removal

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>

* Change Oracle -> OracleLinux

* Update github-actions-ansible-lint.yml

* Update github-actions-ansible-lint.yml

* ansible lint fixes - minor

* ansible lint fixes - minor 002

* ansible lint fixes - minor 003

* Set the Terraform environment variables for non MSFT created deployers

* Add Shared Disk for Windows clusters

* linting

* Added the missing counter

* Change download directory to be Agent.TempDirectory

* Add SCSHA and ERS inifile for HA deployments of S4HANA_2021_FP01 BOM (#430)

* Fix hardcoded HANA port in hdbuserstore list (#435)

HANA port in hdbuserstore is hardcoded to 30313 for App and PAS install tasks.
Fixed to correctly generate correct port for deployed HANA instances.

* Update github-actions-ansible-lint.yml

* Update github-actions-ansible-lint.yml

* Pre 3.8 release  (#434)

* update NSG name

* resource_name

* Resource name

* ConnectivityToSAPApplicationSubnetFromControlPlane-ssh-rdp-winrm

* admin subnet

* Fix Rescue task for ERS

* Use the first item

* Use the correct plan

* Add the plan details

* Add dictionary object type to transform enable Plan

* debug plan

* debug: plan

* Populate source_image_reference even if plan is defined

* Remove whitespace

* Add more ensa1/ensa2 logic

* Add the ability to override ensa1/ensa2

* Add ensa1 for JAVA

* Use scs_bom_instance_type

* debug - change the resource attribute

* Show Ensa1 & Ensa2

* Testing permission setting

* test permission DSC

* Test SqlPermission

* pass necessary variables to the sap specific os configuration

* try credssp

* further complicate life

* CNO needs to be disabled. Reverting credssp changes for now.

* checking if we really need the become

* enable credssp and try again

* remove the becomes

* give relative path

* changes required for enabling credssp and relative paths for tasks inside blocks.

* fixing typos-001

* debug for SQL Server service status

* change to using split instead of cidrnetmask

* become a domain user

* correct plan disctioanry

* add a random string to cluster name

* shared disk resources

* type was defined twice

* debug

* change names

* add clarity in task names

* correct the windows cluster svc account name

* ensure create cluster is adding the cluster disks

* typos in output name

* make some changes to the db ha playbook

* tier as a set fact persists and overrides the var passed to the role. So change tier to config_tier

* the sql server installation tasks are being called. Need to investigate.

* small adjustments

* small changes

* another set of small changes

* add a few debugs

* commit some small changes

* switch to include tasks and include role so that the role/tasks are included as they are encountered.

* rename tasks etc

* do the installation validation

* reorder tasks

* missing dsc modules

* correct casing for the agent account name

* typos in dsc resource names

* generic mistakes

* parameter names

* Test to run without PsDscRunAsCredential_username

* make serverpermission a dictionary

* pass on permissions

* should they be passed liek this

* pass the other two states

* become true for setting permissions

* fix typo again

* calculate ag name

* calculate ag listener name

* hardcoded backup path for now

* calculate subnet prefix

* debug statements

* sql server dsc modules call subnet prefix, unlike the cluster ones.

* removed plan

* subnet prefixes not available in same set fact

* Install CLI the long way

* Add support for providing the password for the SPNs

* save and push changes before re-run

* check if the backup path string is the problem

* change the backup path back

* Add debug info

* support re-run

* delegate the add db to ag task to the primary node

* The sqlagdatabase as the last task on each node

* Add RHEL support

* package manager init

* correct distro

* Add RHEL support

* add samples directory

* use interactive variables

* remove the double $

* Move lsb_release inside of case statement

* Azure CLI install

* Add the silent flag

* show distro

* remove the when condition

* add config_tier

* pass scs servername and add the domain service access to the SAP share

* create directories  that are needed for restore.

* jinja changes

* more jinja good ness

* change the location from where we call jinja and set fact for disks.

* Use the list

* More jinja

* More jinja

* remove the double backslashes

* rmove the SLES packages

* backslashes

* testing

* remove the second backslash

* remove the replace

* fixes

* testing

* indentation

* format

* virtualenv

* remove curlies

* remove local

* remove backslashes

* Debug

* debug

* split to list

* debugging

* Testing directory creation

* test the quotes

* reduced the output

* change quotes to see if regex escaping works differently

* Path formatting for windows-test001

* convert it to a list

* see if we can assign a var before

* let's give it one more shot

* more debug

* flatten before calling to mimic with_items

* add flattened list to debug

* set probe port as well

* print with loop_control

* check what index is being used

* modifications to use with_indexed_items

* get ip of host

* push with_indexed_items

* removed the hard coded

* probe port

* rename probe port script to use ps1 extension

* remove spaces between curlies

* start ag resource along with ip address

* sleep for a minute

* Fix the hdbuserstore command

* uncomment the sqlagdatabase

* give permissions to the domain account

* pass netbios domain name

* trying something by adding the machine accounts

* fixes to sqlpermissions

* become

* use only become and no dsc credentials

* switch to using sidadm account

* revert and give db_backupoperator

* service accounts

* add the user rights properly

* set them correctly

* fix params for SqlServiceAccount

* set dummy pass for gMSA accounts

* add a when clause

* assign spns

* change how dummy pass is encrypted

* create spns

* maybe we are passing the password wrong

* set the correct service account for the sql agent service.

* dsc seems to be throwing errors. switch to using win_service

* change the ordering.

* additional task to start agent service account and remove becomes for the adding database to AG

* use sid_for_disks to calculate the sid to use. use sap_sid if db_sid is not defined.

* final set of changes.

* some more changes

* pass in the variables needed

* add logic for reboot immediately after the updates.

* adding back the domain service account to sql logins

* Add a try statement

* add endpoint permissions on the second node

* Get passwords from key vault

* Get the credentials from key vault

* update probe port, and its configuration. Add accounts to sysadmin role.

* pass in the required variables.

* removed curlies

* pass in the domain name and the service accounts with the domain\accountname format

* Corrected the task name

* Set accounts for exports

* Do another restart

* change listener port

* try waiting for the secondary creation

* changes not pushed?

* check if DB is added to primary and secondary

* pass primary node to server name

* pass teh correct account name

* debug account names

* pass domain_sqlsvc_account

* remove the extra account calculation step

* convert domain name to upper

* caching facts leads to weird behaviour

* push changes

* profile changes etc.

* missing curly

* simplify the profile updates

* update task description

* Don't add the same sid multiple times

* Centralize the component installation

* Move packages call to run after domain join

* set tier

* Only check the DSC modules once

* move the call to playbooks

* change the rescue action for scs ha install to use builtin.shell instead of builtin.command

* Update Terraform version

* Test if the filter fixes disks_facts

* Testing if Volumes fixes it

* reverse the selection

* removed the typo

* update path

* update the community.windows from the palybook to fix the win_disk_facts module

* use builtin.raw with become

* pass bash as the executable to use

* Use correct venv

* Troubleshooting

* don't download module

* test without rejectattr

* Linting changes and removal of BOM-Catalog folder

* lint fixes - 0001

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>

* simplify the code

* add network rules

* Fix typos

* restore the code

* Changed the workload zone SPN naming logic

* use DNS if private endpoint

* lowercase DNS

* DNS and NSG

* Add DNS record

* Add DNS records

* deployer already has the packages

* Bump up the version

* rename sap_search.yamp file

* install Ansible

* removed the duplicate

* update SQL probe port to handle other cluster parameters as well.

* Update github-actions-ansible-lint.yml

* Update github-actions-ansible-lint.yml

* Update github-actions-ansible-lint.yml

* Update github-actions-ansible-lint.yml

* try with a linter file in another directory

* Update github-actions-ansible-lint.yml

* use the older lint-action plugin

* add ansible lint badge and fix markdown issues

* put all badges on the same line

* calculate the path fact for HDB using the db_instance_number

* Add SLES as supported deployer

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>
Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com>
Co-authored-by: Robert Biro <Robert.Biro@microsoft.com>
Co-authored-by: Morgan Deegan <morgan@unicorn.town>
Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com>
Co-authored-by: Harm Jan Stam <harmjan+git@harmjan.com>
Co-authored-by: Sumit Das <sumit8das@gmail.com>
Co-authored-by: Shekhar Sorot ( MSFT ) <shekharssorot2002@gmail.com>
2023-03-31 19:06:08 +05:30
hdamecharla 58849454ae
Create PR for release v 3.7.0.0 (#421)
* pick up the right tasks

* Cluster checks

* Find sapcontrol

* changes to BOM and validation

* First edit of the cluster validation play

* Change directory name

* LD_LIBRARY_PATH update

* Vault DNS

* updates to cluster validation

* follow symlinks for find

* templating fixes for isntance type

* cut option typo

* become root for cluster commands

* missing ';'

* failed_when

* failed_when conditions

* sleep for 60 second

* cleanup the provisioning.

* Fix external support for key vaults

* simplify the code

* Change the download directory

* Revert

* home directory

* Add a fix for the unbound variable

* download paths

* comment out serialization

* remove the unneeded no_logs

* Set the unbound variables

* Add support for creating fileshares in existing storage accounts

* Terraform fmt for all files

* Test

* Test

* Cluster resources control & Terraform formatting (#408)

* Use jinja

* Add fail condition

* add correct comparison

* show disk free in GB

* select first node

* query for inode_available

* select only first node

* use json query

* correct the query

* don't convert

* Add the disk space assert

* make assert jinja

* correct the calculation

* convert to GB

* Fix calculation

* set the deployer free disk space threshhold

* make free space a parameter

* Add a dependency on the disk attachment resource

* remove the defaults

* Update vm-webdisp.tf

* Add support for dynamiv /hana/backup location

* Debugging local install volume creation

* JINJA fixes

* Remove the if statement

* adding is defined

* Add better messaging

* If workload zone defined AFS use it

* AFS download update

* Call AFS always

* Add SCS diskspace check

* /hana/data/backup tests

* Take the first item from the list

* Show mnt size

* Use index

* show raw data

* simplify the size calculation

* show backup location

* show backup directory

* Use the correct server

* Correct the if statement

* Move INI generation into the install block

* Register BoM in all cases

* Run az login earlier in the pipeline

* Script updates

* Show disk space requirement

* Only check size of /usr/sap if it exists

* Check if usr_sap is defined

* Disk size calculation

* missing line feed

* Add support for providing ORACLE-ASM

* Oracle ASM ports

* Oracle - ASM support

* Add support for Oracle ASM

* Add ORACLE-ASM to playbooks

* Oracle ASM support

* change UIDs

* move the check

* calculate scs_virtual_hostname

* remove extra part from tag

* become for profile

* use become for profile

* remove duplicates

* remove duplicates

* Update parameters to accommodate JAVA installations

* set become

* invoke cluster commands as root

* include_tasks instead of import_tasks

* test ACSS registration

* ACSS variable definitions and echo

* Improve echo :-)

* indentation

* Add the missing call

* pipeline updates

* Enable SLES 15 SP4

* quote the secret when passing from pipeline and in set_secrets.sh

* Disable Private FW

* Registery Configuration - Ciphers and Protocols

* Add memory dump configuration

* Move domain join to roles-os

* Add new OS configurations

* troubleshooting BoM

* Change the failed_when condition

* remove duplicate code

* debugging

* Ansible Lint

* troubleshooting

* Linting

* Linting

* Removed the ---

* Moved the tags

* Debugging

* Check directory exists

* Create tmp directory

* Fixed the Jinja

* ensure directories exist

* task naming

* BoM tests

* Linting fixes

* Testing

* Testing

* BoM registration

* Update common variable

* Test

* Revert download Dir

* Test

* Test

* Test

* Test

* Test

* Test

* Updated the disks_config.yml

* Playbook update - fetch the secrets

* Linting

* pass the secrets

* Task name tweaks

* Changed the directory logic

* Indentation

* SA tweaks

* Ignore storage account download errors

* Further testing

* JAVA Paths for logs

* Only validate BoM platform for deployment

* setting storage account flag

* Add the sa flag

* Add platform validation

* Log file paths

* pass the value back to set fact

* set the facts - slight modifications

* align to block

* align to block

* duh! errors

* indentation

* Commenting out the JAVA ports

* Removed the platform check

* support redeployment

* Test

* add region code for wus3

* Test

* Test

* Test

* Test

* Additional instance_type's added

* add the missing curly braces

* SCS ERS installation logic tweaks

* Calculate the second port

* format

* formatting woes

* check SCS & ERS creation

* Add better validation

* append to group

* adding limits for app tier

* remove sudoers

* block ERS install if SCS fails

* Test

* Test

* Adding OracleLinux8

* set sa_enabled flag

* Add default for instance_type

* Add BoM support to Web App

* Adding the insance type

* introduce dependency on disk attachment for extension

* don't check /usr/sap on Windows

* Windows fixes

* add code, need to refactor later, for JAVA HA profile updates before PAS installation

* determine ensa1 for java

* add backupdba group

* Logging & windows

* dgdba_gid

* Added dgdba_gid

* PAS log updates

* Added kmdba, racdba

* Add instance type to DBLoad

* Count the db virtual host name for all cases

* observer fixes

* added backupdba

* remove the /PD

* add racdba

* Moved variable definition

* Tweaks for InstanceType

* Don't use the download variable

* Linting

* Testing extraction

* Update NW_MSSQL_v0001ms-dbload-inifile-param.j2

* Update NW_MSSQL_v0001ms.yaml

Update the product ID for the DBLoad, SUM version, add SAPCAR

* update to use ansible.utils and changes to mss dbload jinja

* fix templating error in db2 mounts created during java deployments

* Wait for the processes to end

* pick up the right tasks

* Cluster checks

* Find sapcontrol

* changes to BOM and validation

* First edit of the cluster validation play

* Change directory name

* LD_LIBRARY_PATH update

* Vault DNS

* updates to cluster validation

* follow symlinks for find

* templating fixes for isntance type

* cut option typo

* become root for cluster commands

* missing ';'

* failed_when

* failed_when conditions

* sleep for 60 second

* cleanup the provisioning.

* simplify the code

* Change the download directory

* Revert

* home directory

* Add a fix for the unbound variable

* download paths

* comment out serialization

* remove the unneeded no_logs

* Set the unbound variables

* Add support for creating fileshares in existing storage accounts

* Terraform fmt for all files

* Test

* Test

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>
Co-authored-by: Robert Biro <Robert.Biro@microsoft.com>
Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com>
Co-authored-by: Morgan Deegan <morgan@unicorn.town>
Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com>

* add westus3

* add WUS3 to boilerplate

* add WUS3 to boilerplate

* Logon as SPN before creating deployment

* Save installation media storage account name

* Fix the ACSS registration

* Increment the version

* Add SLES 15 SP4 support to the Web App

* Move the git pull later

* resource group for ANF calculation

* comment out az sub in install_workloadzone and quote variable in workloadzone pipeline

* few quoting and space issues

* Ansible Linting

* Don't use the sapmnt nic datasource for non AFS deployments

* calculate private link only for AFS

* Add support for existing sapmnt

* BOM updates for accommodating Revision 2.00.059.7 (SPS05) for HANA DB 2.0

* Updates to SWPM 2.0 and SWPM 1.0

* Create SAP ERP 6.0 for Windows on MSSQL

* Add the throughput values

* Workload zone pipeline updates (#409)

* Update vm-webdisp.tf

* Add support for dynamiv /hana/backup location

* Debugging local install volume creation

* JINJA fixes

* Remove the if statement

* adding is defined

* Add better messaging

* If workload zone defined AFS use it

* AFS download update

* Call AFS always

* Add SCS diskspace check

* /hana/data/backup tests

* Take the first item from the list

* Show mnt size

* Use index

* show raw data

* simplify the size calculation

* show backup location

* show backup directory

* Use the correct server

* Correct the if statement

* Move INI generation into the install block

* Register BoM in all cases

* Run az login earlier in the pipeline

* Script updates

* Show disk space requirement

* Only check size of /usr/sap if it exists

* Check if usr_sap is defined

* Disk size calculation

* missing line feed

* Add support for providing ORACLE-ASM

* Oracle ASM ports

* Oracle - ASM support

* Add support for Oracle ASM

* Add ORACLE-ASM to playbooks

* Oracle ASM support

* change UIDs

* move the check

* calculate scs_virtual_hostname

* remove extra part from tag

* become for profile

* use become for profile

* remove duplicates

* remove duplicates

* Update parameters to accommodate JAVA installations

* set become

* invoke cluster commands as root

* include_tasks instead of import_tasks

* test ACSS registration

* ACSS variable definitions and echo

* Improve echo :-)

* indentation

* Add the missing call

* pipeline updates

* Enable SLES 15 SP4

* quote the secret when passing from pipeline and in set_secrets.sh

* Disable Private FW

* Registery Configuration - Ciphers and Protocols

* Add memory dump configuration

* Move domain join to roles-os

* Add new OS configurations

* troubleshooting BoM

* Change the failed_when condition

* remove duplicate code

* debugging

* Ansible Lint

* troubleshooting

* Linting

* Linting

* Removed the ---

* Moved the tags

* Debugging

* Check directory exists

* Create tmp directory

* Fixed the Jinja

* ensure directories exist

* task naming

* BoM tests

* Linting fixes

* Testing

* Testing

* BoM registration

* Update common variable

* Test

* Revert download Dir

* Test

* Test

* Test

* Test

* Test

* Test

* Updated the disks_config.yml

* Playbook update - fetch the secrets

* Linting

* pass the secrets

* Task name tweaks

* Changed the directory logic

* Indentation

* SA tweaks

* Ignore storage account download errors

* Further testing

* JAVA Paths for logs

* Only validate BoM platform for deployment

* setting storage account flag

* Add the sa flag

* Add platform validation

* Log file paths

* pass the value back to set fact

* set the facts - slight modifications

* align to block

* align to block

* duh! errors

* indentation

* Commenting out the JAVA ports

* Removed the platform check

* support redeployment

* Test

* add region code for wus3

* Test

* Test

* Test

* Test

* Additional instance_type's added

* add the missing curly braces

* SCS ERS installation logic tweaks

* Calculate the second port

* format

* formatting woes

* check SCS & ERS creation

* Add better validation

* append to group

* adding limits for app tier

* remove sudoers

* block ERS install if SCS fails

* Test

* Test

* Adding OracleLinux8

* set sa_enabled flag

* Add default for instance_type

* Add BoM support to Web App

* Adding the insance type

* introduce dependency on disk attachment for extension

* don't check /usr/sap on Windows

* Windows fixes

* add code, need to refactor later, for JAVA HA profile updates before PAS installation

* determine ensa1 for java

* add backupdba group

* Logging & windows

* dgdba_gid

* Added dgdba_gid

* PAS log updates

* Added kmdba, racdba

* Add instance type to DBLoad

* Count the db virtual host name for all cases

* observer fixes

* added backupdba

* remove the /PD

* add racdba

* Moved variable definition

* Tweaks for InstanceType

* Don't use the download variable

* Linting

* Testing extraction

* Update NW_MSSQL_v0001ms-dbload-inifile-param.j2

* Update NW_MSSQL_v0001ms.yaml

Update the product ID for the DBLoad, SUM version, add SAPCAR

* update to use ansible.utils and changes to mss dbload jinja

* fix templating error in db2 mounts created during java deployments

* Wait for the processes to end

* pick up the right tasks

* Cluster checks

* Find sapcontrol

* changes to BOM and validation

* First edit of the cluster validation play

* Change directory name

* LD_LIBRARY_PATH update

* Vault DNS

* updates to cluster validation

* follow symlinks for find

* templating fixes for isntance type

* cut option typo

* become root for cluster commands

* missing ';'

* failed_when

* failed_when conditions

* sleep for 60 second

* cleanup the provisioning.

* simplify the code

* Change the download directory

* Revert

* home directory

* Add a fix for the unbound variable

* download paths

* comment out serialization

* remove the unneeded no_logs

* Set the unbound variables

* Add support for creating fileshares in existing storage accounts

* Terraform fmt for all files

* Test

* Test

* add westus3

* add WUS3 to boilerplate

* add WUS3 to boilerplate

* Logon as SPN before creating deployment

* Save installation media storage account name

* Fix the ACSS registration

* Increment the version

* Add SLES 15 SP4 support to the Web App

* Move the git pull later

* resource group for ANF calculation

* comment out az sub in install_workloadzone and quote variable in workloadzone pipeline

* few quoting and space issues

* Ansible Linting

* Don't use the sapmnt nic datasource for non AFS deployments

* calculate private link only for AFS

* Add support for existing sapmnt

* Create SAP ERP 6.0 for Windows on MSSQL

* Add the throughput values

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>
Co-authored-by: Robert Biro <Robert.Biro@microsoft.com>
Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com>
Co-authored-by: Morgan Deegan <morgan@unicorn.town>
Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com>

* SAP software provisioning manager (sapinst) should be run with umask 022 (#402)

The custom_umask variable allowes overrides of this default setting

(cherry picked from commit d0b41974c9)

* fix typo in commit #794b912

* Test

* NW on Windows Enhancement (#410)

* Update the NW on MSSQL related BOM

* Update the sidadm password

* Create SAP ERP 6.0 for Windows on MSSQL

* Update the APP VirtualHostname Variable

* Fix Visual C++ realted issues

* Test

* Test

* Test

* Test

* Test

* Test

* Export the Ansible collections to the correct path

* Add tags for disk checking

* Set the collection path

* Comment out Tests

* Comment out Tests

* Test

* Test

* Provide the Ansible collection environment

* Update helper scripts

* BOM for DB2-11.1

* Windows clustering initial seed.

* add quorum part

* update pipelines to support NW750SPS20_DB2_11-1_v0001ms

* removing unrar as a package for now as it is not directly available from native repos or epel.

* handle python interpreter version

* validate python interpreter version and logic improvement

* need to check logic

* missed python_version for the startup scripts

* set python version when determining ensa versions

* add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines

* Remove the -ms from the new BoM

* Patch 8 for SOFTWARE UPDATE MANAGER 2.0 SP15

* DevOps creation updates

* Cleanup and logging for script

* Fix the use_custom_dns_a_registration errors

* Add validation for the name components in the tfvars file

* Use the correct parameter for awk

* Correct the switch

* remove whitespace

* awk fixes

* Move  the dos2unix earlier

* Move dos2unix

* whitespace

* indentation

* Update the case statement

* syntax error

* Quotes around the parenthesis

* Syntax error for if statement

* Add more verbose information

* Final version for workload zone

* Pipeline updates

* System pipeline

* Corrected the file name

* Pipeline updates

* Log on as SPN before ARM deployment

* Key vault return values

* Variable updates

* Use the location code

* Logout before running devops tasks

* Value is always empty for secrets

* Add ability to test deployment

* Testing TEST_ONLY

* Removed the extra quote

* Perform login

* Add Test only support

* Logon as SPN when doing the system deployment

* Show the variable

* Show output for Test_Only

* Show output

* Better output

* Fix the workload zone remover pipeline

* Fix path

* Path checks

* Update workload zone removal

* Remove control plane

* Fix the parameter

* ARM Password

* USe the correct SPN

* Debugging

* password

* Logon testing

* Use the correct Subscription

* The default is to use an external DNS registration

* Use the prefix for all the templates

* Include InstanceType in Jinja template

* convert acss registration to playbook

* Add the prefix to the BoM name

* Use the BoM name

* Rename the task

* Update the User creation as well

* BoM Fixes

* Fix [BUG] Secondary IP not reachable #352 (#381)

* Misc fixes

* DNS storage account

* Add DNS for Key Vault

* Networking fro dual NICS

* Get the install validations

* multi-nic configuration updates

* Add DNS for File Shares

* Use the correct DNS names

* pushing the changes

* adjust permissions with leading zero

* push changes to repo

* debugging

* Networking code updates

* Win Disk configuration Jinja

* Remove work in progress files

* Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory

* Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory

* Restore code

* Make the default secondary DNS different from the hostname

* Return the secondary IP

* Added the missing space

* Add try statements

* return only the first element of the array

* debug, print the scs VM ids

* debug, print the VM being picked up

* print the VM Id of scs vm for better troubleshooting.

* Get the last list item

* Make the return value a list

* Add App IPs to output

* testing dual IPs

* Temporary remove the output

* Remove the unused resources

* Enhance extracting SAP .exe files for Windows (#412)

* Update the NW on MSSQL related BOM

* Update the sidadm password

* Create SAP ERP 6.0 for Windows on MSSQL

* Update the APP VirtualHostname Variable

* Fix Visual C++ realted issues

* Enhance extracting SAP .exe files for Windows

* Upgade ansible.windows collection

* Revert "Upgade ansible.windows collection"

This reverts commit b7c73562ee.

(cherry picked from commit 70f5673882)

* Enhance extracting SAP .exe files for Windows (#412)

* Update the NW on MSSQL related BOM

* Update the sidadm password

* Create SAP ERP 6.0 for Windows on MSSQL

* Update the APP VirtualHostname Variable

* Fix Visual C++ realted issues

* Enhance extracting SAP .exe files for Windows

* Upgade ansible.windows collection

* Revert "Upgade ansible.windows collection"

This reverts commit b7c73562ee.

* Get the second IP if defined

* IP Logic

* Update the NIC

* Simplify the IP passing

* removed the unneeded variables

* Fixing the variables

* corrected variable name

* Variable name

* Output variable name

* simplify the IP address logic

* Add test option for the workload zone

* Test option for workload zone

* Update Experimental with the latest changes (#414)

* Calculate the second port

* format

* formatting woes

* check SCS & ERS creation

* Add better validation

* append to group

* adding limits for app tier

* remove sudoers

* block ERS install if SCS fails

* Test

* Test

* Adding OracleLinux8

* set sa_enabled flag

* Add default for instance_type

* Add BoM support to Web App

* Adding the insance type

* introduce dependency on disk attachment for extension

* don't check /usr/sap on Windows

* Windows fixes

* add code, need to refactor later, for JAVA HA profile updates before PAS installation

* determine ensa1 for java

* add backupdba group

* Logging & windows

* dgdba_gid

* Added dgdba_gid

* PAS log updates

* Added kmdba, racdba

* Add instance type to DBLoad

* Count the db virtual host name for all cases

* observer fixes

* added backupdba

* remove the /PD

* add racdba

* Moved variable definition

* Tweaks for InstanceType

* Don't use the download variable

* Linting

* Testing extraction

* Update NW_MSSQL_v0001ms-dbload-inifile-param.j2

* Update NW_MSSQL_v0001ms.yaml

Update the product ID for the DBLoad, SUM version, add SAPCAR

* update to use ansible.utils and changes to mss dbload jinja

* fix templating error in db2 mounts created during java deployments

* Wait for the processes to end

* pick up the right tasks

* Cluster checks

* Find sapcontrol

* changes to BOM and validation

* First edit of the cluster validation play

* Change directory name

* LD_LIBRARY_PATH update

* Vault DNS

* updates to cluster validation

* follow symlinks for find

* templating fixes for isntance type

* cut option typo

* become root for cluster commands

* missing ';'

* failed_when

* failed_when conditions

* sleep for 60 second

* cleanup the provisioning.

* simplify the code

* Change the download directory

* Revert

* home directory

* Add a fix for the unbound variable

* download paths

* comment out serialization

* remove the unneeded no_logs

* Set the unbound variables

* Add support for creating fileshares in existing storage accounts

* Terraform fmt for all files

* Test

* Test

* add westus3

* add WUS3 to boilerplate

* add WUS3 to boilerplate

* Logon as SPN before creating deployment

* Save installation media storage account name

* Fix the ACSS registration

* Increment the version

* Add SLES 15 SP4 support to the Web App

* Move the git pull later

* resource group for ANF calculation

* comment out az sub in install_workloadzone and quote variable in workloadzone pipeline

* few quoting and space issues

* Ansible Linting

* Don't use the sapmnt nic datasource for non AFS deployments

* calculate private link only for AFS

* Add support for existing sapmnt

* Create SAP ERP 6.0 for Windows on MSSQL

* Add the throughput values

* fix typo in commit #794b912

* Test

* Test

* Test

* Test

* Test

* Test

* Test

* Export the Ansible collections to the correct path

* Add tags for disk checking

* Set the collection path

* Comment out Tests

* Comment out Tests

* Test

* Test

* Provide the Ansible collection environment

* Update helper scripts

* BOM for DB2-11.1

* Windows clustering initial seed.

* add quorum part

* update pipelines to support NW750SPS20_DB2_11-1_v0001ms

* removing unrar as a package for now as it is not directly available from native repos or epel.

* handle python interpreter version

* validate python interpreter version and logic improvement

* need to check logic

* missed python_version for the startup scripts

* set python version when determining ensa versions

* add environment variable ANSIBLE_COLLECTIONS_PATHS to pipelines

* Remove the -ms from the new BoM

* DevOps creation updates

* Cleanup and logging for script

* Fix the use_custom_dns_a_registration errors

* Add validation for the name components in the tfvars file

* Use the correct parameter for awk

* Correct the switch

* remove whitespace

* awk fixes

* Move  the dos2unix earlier

* Move dos2unix

* whitespace

* indentation

* Update the case statement

* syntax error

* Quotes around the parenthesis

* Syntax error for if statement

* Add more verbose information

* Final version for workload zone

* Pipeline updates

* System pipeline

* Corrected the file name

* Pipeline updates

* Log on as SPN before ARM deployment

* Key vault return values

* Variable updates

* Use the location code

* Logout before running devops tasks

* Value is always empty for secrets

* Add ability to test deployment

* Testing TEST_ONLY

* Removed the extra quote

* Perform login

* Add Test only support

* Logon as SPN when doing the system deployment

* Show the variable

* Show output for Test_Only

* Show output

* Better output

* Fix the workload zone remover pipeline

* Fix path

* Path checks

* Update workload zone removal

* Remove control plane

* Fix the parameter

* ARM Password

* USe the correct SPN

* Debugging

* password

* Logon testing

* Use the correct Subscription

* The default is to use an external DNS registration

* Use the prefix for all the templates

* Include InstanceType in Jinja template

* convert acss registration to playbook

* Add the prefix to the BoM name

* Use the BoM name

* Rename the task

* Update the User creation as well

* BoM Fixes

* Misc fixes

* DNS storage account

* Add DNS for Key Vault

* Networking fro dual NICS

* Get the install validations

* multi-nic configuration updates

* Add DNS for File Shares

* Use the correct DNS names

* pushing the changes

* adjust permissions with leading zero

* push changes to repo

* debugging

* Networking code updates

* Win Disk configuration Jinja

* Remove work in progress files

* Delete deploy/ansible/roles-misc/0.5-ACSS-registration directory

* Delete deploy/ansible/roles-os/windows/1.17-generic-wincluster directory

* Restore code

* Make the default secondary DNS different from the hostname

* Return the secondary IP

* Added the missing space

* Add try statements

* return only the first element of the array

* debug, print the scs VM ids

* debug, print the VM being picked up

* print the VM Id of scs vm for better troubleshooting.

* Get the last list item

* Make the return value a list

* Add App IPs to output

* testing dual IPs

* Temporary remove the output

* Remove the unused resources

* Enhance extracting SAP .exe files for Windows (#412)

* Update the NW on MSSQL related BOM

* Update the sidadm password

* Create SAP ERP 6.0 for Windows on MSSQL

* Update the APP VirtualHostname Variable

* Fix Visual C++ realted issues

* Enhance extracting SAP .exe files for Windows

* Upgade ansible.windows collection

* Revert "Upgade ansible.windows collection"

This reverts commit b7c73562ee.

(cherry picked from commit 70f5673882)

* Get the second IP if defined

* IP Logic

* Update the NIC

* Simplify the IP passing

* removed the unneeded variables

* Fixing the variables

* corrected variable name

* Variable name

* Output variable name

* simplify the IP address logic

* Add test option for the workload zone

* Test option for workload zone

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>
Co-authored-by: Morgan Deegan <morgan@unicorn.town>
Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com>
Co-authored-by: hdamecharla <71097261+hdamecharla@users.noreply.github.com>

* Default variable updates

* Add the missing variable

* Add DNS registration for secondary DNS names

* Use count.index

* Incorrect variable used

* Provide the correct defaults

* SQL Disk fixes and DNS Resourcegroup name

* Use the correct zone name DOH :)

* add db-ha-done file

* make the domain_ou_path a variable

* task name quotes

* Add additional configuration options

* Persist the configuration settings

* Remove quotes

* remove encoding

* Adding the Configuration parameters and the instance numbers

* Add Linebreaks

* become orchestration_ansible_user for the bom downloader playbook

* Update the variable with the corrected value

* Add a default value

* Pass the DNS Resource group

* Mounting logic update

* Don't persist an empty collections

* Added local.

* Added the missing .local

* Experimental tweaks from ACSS debug session (#417)

* Missing variable for non AFS scenarios

* Add use secondary ip flag

* Add a default value

* Create the temp files

* Debug mounting

* Install

* Mounting logic

* Don't mount local sapmnt

* Alignment

* Missing DNS resource group

* Added the local.

* Reboot handler

* Correct the Jinja

* Typo in jinja

* Add the missing variable

* Typo in JINJA

* Remove the domain_name variable

* hdbuserstore as sidadm

* reboot if waconf is changed

* Adding rsdb/ssfs_connect to DEFAULT.PFL

* Change the failed when condition for SUSE

* Adding the python version to support older distros

* Add a rescue action for setting ENSA if MessageServer is down

* Added logic for restarting message server for HA scenarios

* Use scs_running_on is not defined instead

* Add try statements

* Add try statements

* Change the IP for ansible

* Add a rescue action for SUSEConnect

* Missing region name

* BoM update with same name

* Provide ssfs_connect environment variable

* Don't specify python for deployer

* Add a wait

* Update message

* db_server_temp fix

* Misc updates

* Create users for Oracle

* Don't run User creation

* sa flag

* Set SA Enabled

* Show Debug info

* DBLoad

* Check storage account

* Let SAP create the users

* Adding more verbosity

* Typo and missing variable

* Set sa flag

* Don't create users separately when deploying on Oracle

* set allow_world_readable_tmpfiles for hdbuserstore code

* and when to check for windows family

* fix indentation

* Addd Windows checks

* Adding ORACLE-ASM as platform

* Mount install on db node

* add acl package to all tiers

* add it for all vms

* Add TF_LOG to workload and system pipelines

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>

* Calculate domain if not specified (#419)

* Calculate domain if not specified

* Missing POOL variable

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>

* Release 3.7 pipeline updates (#420)

* Calculate domain if not specified

* Missing POOL variable

* Fix the assert statements

* Add the calculated domain

* Download files on Windows

* Set ARM_USE_MSI

* Add use_msi into the provider

* Use the correct backend

* Adding the suffix

* Change provider order

* Switch provider

* testing how to get MSI ID

* Write the MSI Object ID

* remove the sensitivity

* Remove the "raw"

* Show the Deployer MSI

* deliberate error

* Removed the error

* Adding MSI client ID

* Don't remove workload VNet changes

* Testing jq

* Removed jq

* source the configuration from deployer

* correct source

* USE UPN for login

* Fix the providers

* Add domain calculation

* remap providers

* Use the main provider

* Provide the correct provider for sapmnt

* Use source for removals

* Remove extra login

* Rename variable

* Correct the variable

* Correct the parameter

* Corrected the variable name

* Merge branch 'experimental' of https://github.com/KimForss/sap-automation into experimental

* fix typos for region code wus2

* Software download tests on Windows

* whitespace removal

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: hdamecharla <hdamecharla@microsoft.com>

* Change Oracle -> OracleLinux

* Update github-actions-ansible-lint.yml

* Update github-actions-ansible-lint.yml

* ansible lint fixes - minor

* ansible lint fixes - minor 002

* ansible lint fixes - minor 003

---------

Co-authored-by: Kimmo Forss <kimforss@microsoft.com>
Co-authored-by: Morgan Deegan <morgan@unicorn.town>
Co-authored-by: Kimmo Forss <kimmo.forss@microsoft.com>
Co-authored-by: Robert Biro <Robert.Biro@microsoft.com>
Co-authored-by: Nadeen Noaman <95418928+nnoaman@users.noreply.github.com>
Co-authored-by: Harm Jan Stam <harmjan+git@harmjan.com>
Co-authored-by: Sumit Das <sumit8das@gmail.com>
2023-02-21 18:51:15 +02:00
Kimmo Forss 8c0feaeafa Repo link updates 2021-11-17 20:20:32 +02:00
Kimmo Forss 6ff0b89111 Version 3 initial commit 2021-11-17 19:29:07 +02:00
Microsoft Open Source a05ce41e13 README.md updated to template 2021-11-16 10:43:15 -08:00
Kimmo Forss 85128ce913
Initial commit 2021-11-16 20:22:10 +02:00