Граф коммитов

211 Коммитов

Автор SHA1 Сообщение Дата
John Rampono 061047a142
Update README.md 2021-11-22 07:13:27 +08:00
John Rampono 66ad02966e Major changes in this version including:
- Complete refactor of ADF Code Components to improve naming conventions and consistency
- Addition of Node Web App to facilitate configuration editing

 On branch development/0.1
 Changes to be committed:
	modified:   README.md
	new file:   documentation/images/DeploymentForm.png
	renamed:    solution/DataFactory/dataset/ADLSBinary_AZ_IR.json -> solution/DataFactory/ADF/dataset/ADLSBinary_IRA.json
	renamed:    solution/DataFactory/dataset/ADLSDelimitedText_SH_IR.json -> solution/DataFactory/ADF/dataset/ADLSDelimitedText_IRA.json
	renamed:    solution/DataFactory/dataset/ADLSExcel_SH_IR.json -> solution/DataFactory/ADF/dataset/ADLSExcel_IRA.json
	renamed:    solution/DataFactory/dataset/ADLSJson_SH_IR.json -> solution/DataFactory/ADF/dataset/ADLSJson_IRA.json
	renamed:    solution/DataFactory/dataset/ADLSParquet_AZ_IR.json -> solution/DataFactory/ADF/dataset/ADLSParquet_IRA.json
	renamed:    solution/DataFactory/dataset/AzureSqlTable_AZ_IR.json -> solution/DataFactory/ADF/dataset/AzureSqlTable_IRA.json
	renamed:    solution/DataFactory/dataset/BlobBinary_AZ_IR.json -> solution/DataFactory/ADF/dataset/BlobBinary_IRA.json
	renamed:    solution/DataFactory/dataset/BlobDelimitedText_SH_IR.json -> solution/DataFactory/ADF/dataset/BlobDelimitedText_IRA.json
	renamed:    solution/DataFactory/dataset/BlobExcel_SH_IR.json -> solution/DataFactory/ADF/dataset/BlobExcel_IRA.json
	renamed:    solution/DataFactory/dataset/BlobJson_SH_IR.json -> solution/DataFactory/ADF/dataset/BlobJson_IRA.json
	renamed:    solution/DataFactory/dataset/BlobParquet_AZ_IR.json -> solution/DataFactory/ADF/dataset/BlobParquet_IRA.json
	renamed:    solution/DataFactory/dataset/FileBinary_SH_IR.json -> solution/DataFactory/ADF/dataset/FileBinary_IRA.json
	renamed:    solution/DataFactory/dataset/FileParquet_SH_IR.json -> solution/DataFactory/ADF/dataset/FileParquet_IRA.json
	renamed:    solution/DataFactory/dataset/SqlServerTable_SH_IR.json -> solution/DataFactory/ADF/dataset/SqlServerTable_IRA.json
	renamed:    solution/DataFactory/factory/adsgofastdatakakeacceladf.json -> solution/DataFactory/ADF/factory/adsgofastdatakakeacceladf.json
	new file:   solution/DataFactory/ADF/integrationRuntime/IRA.json
	renamed:    solution/DataFactory/linkedService/AdsGoFastKeyVault.json -> solution/DataFactory/ADF/linkedService/AdsGoFastKeyVault.json
	renamed:    solution/DataFactory/linkedService/AzureFunctionAdsGoFastDataLakeAccelFunApp.json -> solution/DataFactory/ADF/linkedService/AzureFunctionAdsGoFastDataLakeAccelFunApp.json
	renamed:    solution/DataFactory/linkedService/GenericAzureDataLakeStorage_SH_IR.json -> solution/DataFactory/ADF/linkedService/GenericAzureDataLakeStorage_IRA.json
	renamed:    solution/DataFactory/linkedService/GenericAzureKeyVault.json -> solution/DataFactory/ADF/linkedService/GenericAzureKeyVault_IRA.json
	renamed:    solution/DataFactory/linkedService/GenericAzureSQL_SH_IR.json -> solution/DataFactory/ADF/linkedService/GenericAzureSQL_IRA.json
	renamed:    solution/DataFactory/linkedService/GenericBlobStorage_SH_IR.json -> solution/DataFactory/ADF/linkedService/GenericBlobStorage_IRA.json
	renamed:    solution/DataFactory/linkedService/GenericFileServer_SH_IR.json -> solution/DataFactory/ADF/linkedService/GenericFileServer_IRA.json
	renamed:    solution/DataFactory/linkedService/GenericMsSqlServer_SH_IR.json -> solution/DataFactory/ADF/linkedService/GenericMsSqlServer_IRA.json
	new file:   solution/DataFactory/ADF/pipeline/AZ_Function_Generic.json
	renamed:    solution/DataFactory/pipeline/AZ-SQL-AZ-Storage-Parquet-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_SQL_AZ_Storage_Parquet_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-SQL-Create-Table-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_SQL_Create_Table_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-SQL-Full-Load-Chunk-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_SQL_Full_Load_Chunk_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-SQL-Full-Load-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_SQL_Full_Load_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-SQL-Post-Copy-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_SQL_Post_Copy_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-SQL-StoredProcedure-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_SQL_StoredProcedure_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-SQL-Watermark-Chunk-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_SQL_Watermark_Chunk_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-SQL-Watermark-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_SQL_Watermark_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-Storage-Binary-AZ-Storage-Binary-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_Storage_Binary_AZ_Storage_Binary_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-Storage-CSV-AZ-SQL-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_Storage_CSV_AZ_SQL_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-Storage-Excel-AZ-SQL-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_Storage_Excel_AZ_SQL_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-Storage-Excel-AZ-Storage-CSV-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_Storage_Excel_AZ_Storage_CSV_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-Storage-JSON-AZ-SQL-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_Storage_JSON_AZ_SQL_IRA.json
	renamed:    solution/DataFactory/pipeline/AZ-Storage-Parquet-AZ-SQL-SH-IR.json -> solution/DataFactory/ADF/pipeline/AZ_Storage_Parquet_AZ_SQL_IRA.json
	renamed:    solution/DataFactory/pipeline/Create-Task-Master-AZ-SQL-SH-IR.json -> solution/DataFactory/ADF/pipeline/Create_Task_Master_AZ_SQL_IRA.json
	renamed:    solution/DataFactory/pipeline/GEN-File-Binary-AZ-Storage-Binary-SH-IR.json -> solution/DataFactory/ADF/pipeline/GEN_File_Binary_AZ_Storage_Binary_IRA.json
	renamed:    solution/DataFactory/pipeline/Master.json -> solution/DataFactory/ADF/pipeline/Master_IRA.json
	renamed:    solution/DataFactory/pipeline/SH-SQL-AZ-Storage-Parquet-SH-IR.json -> solution/DataFactory/ADF/pipeline/SH_SQL_AZ_Storage_Parquet_IRA.json
	renamed:    solution/DataFactory/pipeline/SH-SQL-Full-Load-Chunk-SH-IR.json -> solution/DataFactory/ADF/pipeline/SH_SQL_Full_Load_Chunk_IRA.json
	renamed:    solution/DataFactory/pipeline/SH-SQL-Full-Load-SH-IR.json -> solution/DataFactory/ADF/pipeline/SH_SQL_Full_Load_IRA.json
	renamed:    solution/DataFactory/pipeline/OnP-SQL-GEN-File-Parquet-OnP-SH-IR.json -> solution/DataFactory/ADF/pipeline/SH_SQL_GEN_File_Parquet_IRA.json
	renamed:    solution/DataFactory/pipeline/SH-SQL-Watermark-Chunk-SH-IR.json -> solution/DataFactory/ADF/pipeline/SH_SQL_Watermark_Chunk_IRA.json
	renamed:    solution/DataFactory/pipeline/SH-SQL-Watermark-SH-IR.json -> solution/DataFactory/ADF/pipeline/SH_SQL_Watermark_IRA.json
	renamed:    solution/DataFactory/trigger/Trigger on File End.json -> solution/DataFactory/ADF/trigger/Trigger on File End.json
	new file:   solution/DataFactory/GenerateADFArtefacts.ps1
	new file:   solution/DataFactory/IRConfig.json
	renamed:    solution/DataFactory/dataset/ADLSBinary_SH_IR.json -> solution/DataFactory/Templates/dataset/ADLSBinary_{IR}.json
	new file:   solution/DataFactory/Templates/dataset/ADLSDelimitedText_{IR}.json
	new file:   solution/DataFactory/Templates/dataset/ADLSExcel_{IR}.json
	new file:   solution/DataFactory/Templates/dataset/ADLSJson_{IR}.json
	renamed:    solution/DataFactory/dataset/ADLSParquet_SH_IR.json -> solution/DataFactory/Templates/dataset/ADLSParquet_{IR}.json
	renamed:    solution/DataFactory/dataset/AzureSqlTable_SH_IR.json -> solution/DataFactory/Templates/dataset/AzureSqlTable_{IR}.json
	renamed:    solution/DataFactory/dataset/BlobBinary_SH_IR.json -> solution/DataFactory/Templates/dataset/BlobBinary_{IR}.json
	new file:   solution/DataFactory/Templates/dataset/BlobDelimitedText_{IR}.json
	new file:   solution/DataFactory/Templates/dataset/BlobExcel_{IR}.json
	new file:   solution/DataFactory/Templates/dataset/BlobJson_{IR}.json
	renamed:    solution/DataFactory/dataset/BlobParquet_SH_IR.json -> solution/DataFactory/Templates/dataset/BlobParquet_{IR}.json
	renamed:    solution/DataFactory/dataset/FileBinary_OnPrem_SH_IR.json -> solution/DataFactory/Templates/dataset/FileBinary_{IR}.json
	renamed:    solution/DataFactory/dataset/FileParquet_OnPrem_SH_IR.json -> solution/DataFactory/Templates/dataset/FileParquet_{IR}.json
	renamed:    solution/DataFactory/dataset/SqlServerTable_OnPrem_SH_IR.json -> solution/DataFactory/Templates/dataset/SqlServerTable_{IR}.json
	new file:   solution/DataFactory/Templates/factory/adsgofastdatakakeacceladf.json
	new file:   solution/DataFactory/Templates/integrationRuntime/IRA.json
	new file:   solution/DataFactory/Templates/integrationRuntime/IRB.json
	renamed:    solution/DataFactory/linkedService/GenericAzureDataLakeStorage_OnPrem_Net.json -> solution/DataFactory/Templates/linkedService/GenericAzureDataLakeStorage_{IR}.json
	new file:   solution/DataFactory/Templates/linkedService/GenericAzureKeyVault_{IR}.json
	renamed:    solution/DataFactory/linkedService/GenericAzureSQL.json -> solution/DataFactory/Templates/linkedService/GenericAzureSQL_{IR}.json
	renamed:    solution/DataFactory/linkedService/GenericBlobStorage_OnPrem_Net.json -> solution/DataFactory/Templates/linkedService/GenericBlobStorage_{IR}.json
	renamed:    solution/DataFactory/linkedService/GenericFileServer_OnPrem_Net.json -> solution/DataFactory/Templates/linkedService/GenericFileServer_{IR}.json
	renamed:    solution/DataFactory/linkedService/GenericMsSqlServer_OnPrem_Net.json -> solution/DataFactory/Templates/linkedService/GenericMsSqlServer_{IR}.json
	new file:   solution/DataFactory/Templates/linkedService/NamingConventions.md
	renamed:    solution/DataFactory/pipeline/AZ-Function-Generic.json -> solution/DataFactory/Templates/pipeline/AZ_Function_Generic.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_SQL_AZ_Storage_Parquet_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_SQL_Create_Table_{IR}.json
	renamed:    solution/DataFactory/pipeline/OnP-SQL-Full-Load-Chunk-OnP-SH-IR.json -> solution/DataFactory/Templates/pipeline/AZ_SQL_Full_Load_Chunk_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_SQL_Full_Load_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_SQL_Post_Copy_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_SQL_StoredProcedure_{IR}.json
	renamed:    solution/DataFactory/pipeline/OnP-SQL-Watermark-Chunk-OnP-SH-IR.json -> solution/DataFactory/Templates/pipeline/AZ_SQL_Watermark_Chunk_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_SQL_Watermark_{IR}.json
	renamed:    solution/DataFactory/pipeline/AZ-Storage-Binary-AZ-Storage-Binary-AZ-IR.json -> solution/DataFactory/Templates/pipeline/AZ_Storage_Binary_AZ_Storage_Binary_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_Storage_CSV_AZ_SQL_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_Storage_Excel_AZ_SQL_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_Storage_Excel_AZ_Storage_CSV_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_Storage_JSON_AZ_SQL_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/AZ_Storage_Parquet_AZ_SQL_{IR}.json
	renamed:    solution/DataFactory/pipeline/Create-Task-Master-AZ-SQL-OnP-SH-IR.json -> solution/DataFactory/Templates/pipeline/Create_Task_Master_AZ_SQL_{IR}.json
	renamed:    solution/DataFactory/pipeline/GEN-File-Binary-AZ-Storage-Binary-OnP-SH-IR.json -> solution/DataFactory/Templates/pipeline/GEN_File_Binary_AZ_Storage_Binary_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/Master_{IR}.json
	renamed:    solution/DataFactory/pipeline/OnP-SQL-AZ-Storage-Parquet-OnP-SH-IR.json -> solution/DataFactory/Templates/pipeline/SH_SQL_AZ_Storage_Parquet_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/SH_SQL_Full_Load_Chunk_{IR}.json
	renamed:    solution/DataFactory/pipeline/OnP-SQL-Full-Load-OnP-SH-IR.json -> solution/DataFactory/Templates/pipeline/SH_SQL_Full_Load_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/SH_SQL_GEN_File_Parquet_{IR}.json
	new file:   solution/DataFactory/Templates/pipeline/SH_SQL_Watermark_Chunk_{IR}.json
	renamed:    solution/DataFactory/pipeline/OnP-SQL-Watermark-OnP-SH-IR.json -> solution/DataFactory/Templates/pipeline/SH_SQL_Watermark_{IR}.json
	new file:   solution/DataFactory/Templates/trigger/Trigger on File End.json
	deleted:    solution/DataFactory/dataset/ADLSBinary_OnPrem_SH_IR.json
	deleted:    solution/DataFactory/dataset/ADLSParquet_OnPrem_SH_IR.json
	deleted:    solution/DataFactory/dataset/BlobBinary_OnPrem_SH_IR.json
	deleted:    solution/DataFactory/dataset/BlobParquet_OnPrem_SH_IR.json
	deleted:    solution/DataFactory/integrationRuntime/SelfHostedIntegrationRuntime-Azure-VNET.json
	deleted:    solution/DataFactory/integrationRuntime/SelfHostedIntegrationRuntime-OnPem-Net.json
	deleted:    solution/DataFactory/linkedService/GenericAzureDataLakeStorage.json
	deleted:    solution/DataFactory/linkedService/GenericBlobStorage.json
	deleted:    solution/DataFactory/pipeline/AZ-SQL-AZ-Storage-Parquet-AZ-IR.json
	deleted:    solution/DataFactory/pipeline/AZ-Storage-Parquet-AZ-SQL-AZ-IR.json
	modified:   solution/Database/ADSGoFastDbUp/AdsGoFastDbUp/0-1-0-beta/A-Journaled/006-SampleTasks_TaskMaster.sql
	modified:   solution/Database/ADSGoFastDbUp/AdsGoFastDbUp/0-1-0-beta/A-Journaled/008-SampleTasks_SourceAndTargetSystems.sql
	new file:   solution/Database/ADSGoFastDbUp/AdsGoFastDbUp/0-1-0-beta/A-Journaled/010-TaskTypeMapping_Update.sql
	modified:   solution/Deployment/.devcontainer/devcontainer.json
	new file:   solution/Deployment/arm/AppService_Func.bicep
	new file:   solution/Deployment/arm/AppService_Web.bicep
	new file:   solution/Deployment/arm/ApplicationInsights.bicep
	modified:   solution/Deployment/arm/AzureSQLServer.json
	new file:   solution/Deployment/arm/AzureSqlServer.bicep
	new file:   solution/Deployment/arm/DataFactory.bicep
	new file:   solution/Deployment/arm/FunctionApp.bicep
	new file:   solution/Deployment/arm/KeyVault.bicep
	new file:   solution/Deployment/arm/LogAnalytics.bicep
	new file:   solution/Deployment/arm/Networking.bicep
	new file:   solution/Deployment/arm/Storage_ADLS.bicep
	new file:   solution/Deployment/arm/Storage_Blob.bicep
	new file:   solution/Deployment/arm/Storage_Logging.bicep
	new file:   solution/Deployment/arm/VirtualMachine.bicep
	new file:   solution/Deployment/arm/WebApp.bicep
	modified:   solution/Deployment/arm/WebApp.json
	new file:   solution/Deployment/environments/EditSettings.html
	new file:   solution/Deployment/environments/Node/package-lock.json
	new file:   solution/Deployment/environments/Node/package.json
	new file:   solution/Deployment/environments/Node/server.js
	modified:   solution/Deployment/environments/development.json
	new file:   solution/Deployment/environments/development_bak.json
	new file:   solution/Deployment/environments/development_test.json
	modified:   solution/Deployment/environments/environment.schema.json
	modified:   solution/Deployment/workflows/CD_0a_CreateServicePrincipals_AAD_Elevated.ps1
	modified:   solution/Deployment/workflows/CD_1a_DeployServices.ps1
	modified:   solution/Deployment/workflows/CD_2a_CreateMSIs_AAD_Elevated.ps1
	modified:   solution/Deployment/workflows/CD_2b_ConfigureServices.ps1
	modified:   solution/Deployment/workflows/LocalDevOnly_EnvironmentSetUp.ps1
	modified:   solution/Deployment/workflows/Steps/CD_ConfigureADF.ps1
	modified:   solution/Deployment/workflows/Steps/CD_ConfigureAzureSQLServer.ps1
	modified:   solution/Deployment/workflows/Steps/CD_ConfigureAzureSqlServer_UpdateTaskTypeMappingJson.ps1
	modified:   solution/Deployment/workflows/Steps/CD_ConfigureFunctionApp.ps1
	modified:   solution/Deployment/workflows/Steps/CD_ConfigureKeyVault.ps1
	new file:   solution/Deployment/workflows/Steps/CD_ConfigureSampleData.ps1
	modified:   solution/Deployment/workflows/Steps/CD_ConfigureVnet.ps1
	modified:   solution/Deployment/workflows/Steps/CD_ConfigureWebApp.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployADF.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployADFOnPremSHIR.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployAppInsights.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployAppService.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployAzureSqlServer.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployFunctionApp.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployKeyVault.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployLogAnalytics.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployResourceGroup.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployStorageADLS.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployStorageBlob.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployStorageForLogging.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployVnet.ps1
	modified:   solution/Deployment/workflows/Steps/CD_DeployWebSite.ps1
	modified:   solution/Deployment/workflows/Steps/CD_GrantRBAC.ps1
	modified:   solution/Deployment/workflows/Steps/CD_SetResourceGroupHash.ps1
	modified:   solution/Deployment/workflows/Steps/CI_BuildDataFactory.ps1
	modified:   solution/Deployment/workflows/Steps/InstallGatewayFunctions.ps1
	modified:   solution/Deployment/workflows/Steps/PushEnvFileIntoVariables.ps1
	modified:   solution/FunctionApp/FunctionApp.csproj
	modified:   solution/FunctionApp/Startup.cs
	modified:   solution/FunctionApp/TaskMetaData/TaskInstance.cs
	new file:   solution/SampleFiles/yellow_tripdata_2017-03.csv
	new file:   solution/SampleFiles/yellow_tripdata_2017-03.xlsx
	renamed:    solution/TaskTypeJson/AZ-SQL-AZ-Storage-Parquet-SH-IR.json -> solution/TaskTypeJson/AZ_SQL_AZ_Storage_Parquet_IRA.json
	renamed:    solution/TaskTypeJson/AZ-SQL-StoredProcedure-SH-IR.json -> solution/TaskTypeJson/AZ_SQL_StoredProcedure_IRA.json
	renamed:    solution/TaskTypeJson/AZ-Storage-Binary-AZ-Storage-Binary-SH-IR.json -> solution/TaskTypeJson/AZ_Storage_Binary_AZ_Storage_Binary_IRA.json
	renamed:    solution/TaskTypeJson/AZ-Storage-CSV-AZ-SQL-SH-IR.json -> solution/TaskTypeJson/AZ_Storage_CSV_AZ_SQL_IRA.json
	renamed:    solution/TaskTypeJson/AZ-Storage-Excel-AZ-SQL-SH-IR.json -> solution/TaskTypeJson/AZ_Storage_Excel_AZ_SQL_IRA.json
	renamed:    solution/TaskTypeJson/AZ-Storage-Excel-AZ-Storage-CSV-SH-IR.json -> solution/TaskTypeJson/AZ_Storage_Excel_AZ_Storage_CSV_IRA.json
	renamed:    solution/TaskTypeJson/AZ-Storage-JSON-AZ-SQL-SH-IR.json -> solution/TaskTypeJson/AZ_Storage_JSON_AZ_SQL_IRA.json
	renamed:    solution/TaskTypeJson/AZ-Storage-Parquet-AZ-SQL-SH-IR.json -> solution/TaskTypeJson/AZ_Storage_Parquet_AZ_SQL_IRA.json
	renamed:    solution/TaskTypeJson/GEN-File-Binary-AZ-Storage-Binary-OnP-SH-IR.json -> solution/TaskTypeJson/GEN_File_Binary_AZ_Storage_Binary_IRA.json
	renamed:    solution/TaskTypeJson/GEN-File-Binary-AZ-Storage-Binary-SH-IR.json -> solution/TaskTypeJson/GEN_File_Binary_AZ_Storage_Binary_IRB.json
	renamed:    solution/TaskTypeJson/OnP-SQL-GEN-File-Parquet-OnP-SH-IR.json -> solution/TaskTypeJson/OnP_SQL_AZ_Storage_Parquet_IRB.json
	renamed:    solution/TaskTypeJson/OnP-SQL-AZ-Storage-Parquet-OnP-SH-IR.json -> solution/TaskTypeJson/OnP_SQL_GEN_File_Parquet_IRB.json
	modified:   solution/WebApplication/WebApplication/Controllers/TaskMasterController.cs
	modified:   solution/WebApplication/WebApplication/Startup.cs
	modified:   solution/WebApplication/WebApplication/WebApplication.csproj
2021-11-21 19:55:34 +08:00
John Rampono 9f5aad425e Added all TaskMasterJson schemas 2021-11-16 19:49:38 +08:00
John Rampono 2abbbe420d
Update README.md 2021-10-22 08:24:37 +08:00
John Rampono b6103ccc6f
Update README.md 2021-10-22 08:15:00 +08:00
John Rampono edd046e260
Merge pull request #37 from microsoft/development/0.1
Development/0.1
2021-10-22 07:34:44 +08:00
John Rampono 4a99f0c62e
Merge pull request #36 from MaheshSQL/development/0.1
Development/0.1
2021-10-13 11:34:30 +08:00
Mahesh Kandhare 2d7d9c866a Added vNet integration and Private Endpoint connections. 2021-10-12 14:00:40 +08:00
Mahesh Kandhare 8e2a714def Added vNet integration and Private Endpoint connections. 2021-10-12 13:50:48 +08:00
John Rampono faf8908d6f
Merge pull request #34 from MaheshSQL/development/0.1
Transient ADLS Gen2 Storage
2021-10-04 10:10:00 +08:00
Mahesh Kandhare ee46c76cdd Adding PS1 script to grant Web APP UI access for aditional user/s 2021-10-02 00:42:36 +08:00
Mahesh Kandhare f2974a6f56 Deployment of and RBAC on OPTIONAL Transient ADLS Gen2 Storage. Can be Enabled via JSON config. 2021-10-02 00:34:41 +08:00
John Rampono 8683d558e1
Merge pull request #28 from MaheshSQL/development/0.1
Development/0.1
2021-09-17 10:54:56 +08:00
Mahesh Kandhare d5dc22c634 Updated to deploy SHIR instead of Managed IR, when SHIR is enabled in development config. 2021-09-15 16:44:15 +08:00
Mahesh Kandhare 47c3a7d3dd Now using (Resource Group Name + TenantId) to make RG hash more unique. 2021-09-15 16:43:27 +08:00
John Rampono 50150c294f
Merge pull request #27 from MaheshSQL/development/0.1
Development/0.1
2021-09-14 11:49:49 +08:00
John Rampono dbcd204abe
Merge pull request #26 from andreas-empired/fix/TaskInstance/chunklogic
Fix for chunk batching logic
2021-09-14 11:48:43 +08:00
Mahesh Kandhare 02ebb7e6bc Adding file 2021-09-09 12:22:29 +08:00
Mahesh Kandhare 9755c8e848 Added config entries for SHIR install scripts 2021-09-09 12:13:28 +08:00
Mahesh Kandhare 05efcf79d6 Adding file 2021-09-09 11:37:44 +08:00
Mahesh Kandhare e0e5f9845d Adding file 2021-09-09 11:23:03 +08:00
Andreas Nerlich 92b54a555a Reverted accidental ps1 script change 2021-09-02 14:57:31 +08:00
John Rampono 111d025a0f Merge branch 'development/0.1' of https://github.com/microsoft/azure-data-services-go-fast-codebase into development/0.1 2021-09-01 17:05:36 +08:00
John Rampono 39a3c16845 Updated ADF Configure 2021-09-01 17:05:31 +08:00
John Rampono 57337abe25
Merge pull request #25 from andreas-empired/fix/CD_ConfigureADF/copyJson
Added missing copy-item for *chunk* pipelines
2021-09-01 16:40:05 +08:00
Andreas Nerlich 3b0bd4618e Avoiding encoding issue - using startswith instead 2021-09-01 15:14:28 +08:00
Andreas Nerlich 59e8e29e93 Fix for chunk batching logic 2021-09-01 14:56:51 +08:00
Andreas Nerlich 660fe791a1 Added missing copy-item for *chunk* pipelines 2021-09-01 14:17:42 +08:00
John Rampono b7959a7174 Updated SP Deployments 2021-08-26 11:17:44 +08:00
John Rampono 8b39d5fe6e Added docker based deployment 2021-08-24 15:26:31 +08:00
John Rampono b92194ab75 Added missing RBAC to allow ADF access to Blob storage 2021-08-23 10:50:37 +08:00
John Rampono 11393a666c Corrected Cross Platform Issue with Configure ADF. JSON Payloads now moved to file reference 2021-08-20 17:03:09 +08:00
John Rampono 056132d539 Merge branch 'development/0.1' of https://github.com/microsoft/azure-data-services-go-fast-codebase into development/0.1 2021-08-20 15:54:23 +08:00
John Rampono 0c31135b1e
Update Build_Development.yml 2021-08-20 15:53:52 +08:00
John Rampono d34e36a038 Small deployment fixes 2021-08-20 15:52:20 +08:00
John Rampono 605771f2b0 Added Key Vault Access Policy to allow ADF MSI to access Key Vault 2021-08-19 19:30:22 +08:00
John Rampono e3300c6425 Added TaskMasterWaterMarks to sample tasks 2021-08-18 21:30:04 +08:00
John Rampono 3b3b38ae76 Fixed Issue with Git Action deployment caused by WebApp Test project appsettings. 2021-08-18 19:56:17 +08:00
John Rampono 3e044994a8 Testing WebApp configure 2021-08-18 16:55:07 +08:00
John Rampono bedf969994 Testing WebApp configure 2021-08-18 16:38:01 +08:00
John Rampono 508e3ba1a1 Testing WebApp configure 2021-08-18 16:30:43 +08:00
John Rampono 407bbba757 Testing WebApp configure 2021-08-18 16:06:35 +08:00
John Rampono 4e85ba46ba Testing WebApp configure 2021-08-18 16:01:38 +08:00
John Rampono cd4035262e Testing WebApp configure 2021-08-18 15:38:19 +08:00
John Rampono 03fb8cf40d Added output supression to keyvault 2021-08-18 15:24:39 +08:00
John Rampono ce0e55f538 Fixing issue with WebApp Build relating to old appsettings template 2021-08-05 21:44:21 +08:00
John Rampono 7d878b3841 Fixing issue with password generator 2021-08-04 13:39:36 +08:00
John Rampono dfc641d0a5 Fixing issue with password generator 2021-08-04 13:31:13 +08:00
John Rampono 6504d5ef48 Altered Development Environment to exclude build 2021-08-04 12:56:52 +08:00
John Rampono 7ffa0aea06 Altered Development Environment to exclude build 2021-08-04 12:52:22 +08:00