Граф коммитов

40 Коммитов

Автор SHA1 Сообщение Дата
Tiago Moraes d210362c3a
Updating gitversion (#66)
To avoid deployment error.
2023-03-07 14:25:28 -05:00
Fabio Padua 4180df25bb
PowerShell version changed when run pipeline (#50)
* Rebase (#2)

* chore: enviornments variables adjustment

* chore: schema update

* fix: add SP version on job variable

* chore: force powershell version

* chore: change task order to publish DB secrets

* chore: Adjustments on Databricks Secrets deploy

* chore: adjust variables info on parameter

* chore: adjustment on Databricks scripts

* chore: dataLakeName variable adjustment

* chore: dataComputeRS variable change

* chore: documentation adjustment att image

* chore: change keyvalt set permissions on SP

* chore: Databricks task order

* chore: databricks adjustments

* chore: var output display removal

* chore: databricks adjustments

* chore: documentation adjustment

* chore: documentation change

* chore: script adjustment

* chore: add command to list scope content

* chore: add SP into Admin role

* chore: adjust Administrator Role SP

* chore: add connect to AD first

* chore: Remove connection do Azure AD

* chore: documentation adjustment

* chore: fix uppercase extensions on some images (#42)

* chore: fix uppercase extensions on some images

* chore: directory changes

* chore: directory rename

* Issue 43 - Templates Changes (#44)

* chore: fix uppercase extensions on some images

* chore: directory changes

* chore: directory rename

* chore: Service Principal secrets first adjustments

* fix: adjustment of SP

* chore: save secret on output

* chore: syntax fix

* chore: token adjustment

* chore: store secret inside output hol file

* chore: put SP inside parameters

* chore: template adjustment

* chore: lower parameter for fix

* chore: syntax adjustment

* chore: Add logs

* chore: add log info

* chore: log info

* Issue #43 - Adjust the pipeline run to use first time SP secret (#45)

* chore: fix uppercase extensions on some images

* chore: directory changes

* chore: directory rename

* chore: Service Principal secrets first adjustments

* fix: adjustment of SP

* chore: save secret on output

* chore: syntax fix

* chore: token adjustment

* chore: store secret inside output hol file

* chore: put SP inside parameters

* chore: template adjustment

* chore: lower parameter for fix

* chore: syntax adjustment

* chore: Add logs

* chore: add log info

* chore: log info

* chore: pipeline execution change

* chore: documentation adjustments

* chore: sample-data upload to main-stream

* chore: unzip and upload sample-data

* fix: adjustment on pipe run

* chore: changed databrick version

* chore: changes into PS Version on Pipe execution
2022-02-18 09:44:17 -03:00
fabiohaifa 281167b94d chore: databricks adjustments 2022-02-10 09:46:45 -03:00
fabiohaifa bcf6f1fcbb chore: Databricks task order 2022-02-08 13:30:53 -03:00
fabiohaifa 83dc5f7c59 chore: Adjustments on Databricks Secrets deploy 2022-02-04 11:11:26 -03:00
fabiohaifa da622bb98c chore: change task order to publish DB secrets 2022-02-03 11:14:42 -03:00
fabiohaifa 4a397985f3 chore: force powershell version 2022-02-02 09:07:33 -03:00
fabiohaifa 1ef3b31384 fix: add SP version on job variable 2022-02-01 16:05:38 -03:00
fabiohaifa afd224c402 chore: enviornments variables adjustment 2022-02-01 13:14:16 -03:00
fabiohaifa 7cacd5e849 chore: adjustments on DatabricksSecrets process 2022-01-28 15:53:00 -03:00
Renan Vilas Novas 3afdf8392e fix: removed non-template env variables
Former-commit-id: 1686aabde4c4cbb91bb6ffedf29dc9923d739a68
2021-09-21 15:06:56 -03:00
Ana Lopez dc1612e13c Saving old versions in folder
Former-commit-id: 86ab1f1a09bbf0b400c25211c4028371a6ff1229
2021-07-27 23:45:29 +00:00
Ana Lopez fbfc25cb41 Saving name of library in variable group and mv previos version to folder oldversions
Former-commit-id: 0b051a85b3e1229cac0f2a0fcae4135d6abf65e7
2021-07-27 14:49:04 +00:00
Ana Lopez 7e7d55ed1f Add steps in quickstart and trigger develop branch in databricks CD notebooks
Former-commit-id: 62fc4d03d78f0eaac3e427a47c96b63867666e35
2021-07-22 20:56:38 +00:00
Ana Lopez a6d980f634 Automatically get the name of the library dataopslib
Former-commit-id: d22607b406c75dffd17bcd637d8365f2533d14ef
2021-07-21 22:36:56 +00:00
Marcel Aldecoa a5d14eaf8a fix databricks CD yaml.
Former-commit-id: ef3d0c868d58c1ec08e53c951cb185cb7f07661d
2021-07-09 14:17:09 -03:00
Marcel Aldecoa 8a3315acd6 fix issue with KV secret.
Former-commit-id: 2cb6b00509202644044875b32f1b0e2179b21dc7
2021-07-09 12:41:24 -03:00
Marcel Aldecoa aa88e2de41 fix deploy iac yaml.
Former-commit-id: 6d23c5a4b27a66892d280942b7fcb7a16207d505
2021-07-09 11:07:53 -03:00
Marcel Aldecoa 380fa188c1 fix: variables IaC.
Former-commit-id: 7e246ef86b257dd840879c29c792c97283da2f11
2021-07-09 09:26:23 -03:00
Ana Lopez Moreno 33c79e6a18 Merged PR 170: Solving paths pipelines and automatically modifying parameters
Solving paths pipelines  and automatically modifying parameters

Related work items: #286


Former-commit-id: 8807941944b9df8ebbd41235831ce2622b0be102
2021-07-08 14:14:56 +00:00
Marcel Aldecoa 3affe3cd3d Merge branch 'task/286/pipelines' of ssh.dev.azure.com:v3/csu-devsquad/advworks-dataops/hol into task/286/pipelines 2021-07-08 11:14:06 -03:00
Marcel Aldecoa 27ec514189 Fix pipeline trigger paths. 2021-07-08 11:13:42 -03:00
Ana Lopez 1113d4a0f1 Merge branch 'task/286/pipelines' of https://dev.azure.com/csu-devsquad/advworks-dataops/_git/hol into task/286/pipelines 2021-07-08 14:00:43 +00:00
Marcel Aldecoa a47ca8f815 Update databricks-lib-cd.yml. 2021-07-08 11:00:17 -03:00
Ana Lopez e43140acde Automatically define variables in databricks lib cd 2021-07-08 14:00:14 +00:00
Marcel Aldecoa 8e298e04f3 Update variable.environment.template.yaml. 2021-07-08 10:56:21 -03:00
Allan Targino 10635aa1cd Merged PR 172: CD Triggers
Former-commit-id: df7a00c39a1b660760d02df65ceb4bca4a9193de
2021-07-07 17:13:10 +00:00
Ana Lopez 5628cbfb98 Automatically define variables in databricks lib cd 2021-07-07 16:03:32 +00:00
Ana Lopez 59528311fd Automatically define variables in databricks lib cd 2021-07-07 15:06:25 +00:00
Marcel Aldecoa 73c8512b81 Add IaC for sample data.
Former-commit-id: 6a63b6419577c7e9328a765c0374033eb2d4e339
2021-07-05 15:23:54 -03:00
Ana Lopez be10182284 Solving paths adf 2021-06-29 18:22:58 +00:00
Ana Lopez 39b0eabfa4 solve paths library pipeline 2021-06-29 01:47:55 +00:00
Ana Lopez 3482ecca08 solve paths library pipeline 2021-06-29 01:44:16 +00:00
Ana Lopez 3340a1e594 Automatically add lib parameters 2021-06-28 20:39:41 +00:00
Ana Lopez db01e1aa32 Update paths to pipeline databricks and automatically define name of pipeline of library with the alias project 2021-06-28 15:15:59 +00:00
Ana Lopez ec2de51681 Update paths to pipeline databricks and automatically define name of pipeline of library with the alias project 2021-06-28 14:24:28 +00:00
Marcel Aldecoa 2b76cbf9f3 Change default region to East US. 2021-06-23 23:17:46 -03:00
Marcel Aldecoa 26432cf9d5 Refactor files and add missing automation parts in the quickstart. 2021-06-23 22:17:36 -03:00
Marcel Aldecoa ca48f77817 Updated IAC pipelines and script to support the new folder structure. 2021-06-23 12:52:30 -03:00
Marcel Aldecoa f9d11ea07b feat: First version of the HOL quickstart. 2021-06-22 15:12:02 -03:00