Update DMA to Cloud-scale analytics (#98)
* update DMA to cloud-scale analytics * Update README.md * Update docs/reference/portal.dataProduct.json * Update README.md * Update README.md Co-authored-by: Marvin Buss <34542414+marvinbuss@users.noreply.github.com>
This commit is contained in:
Mike Boswell
GitHub
Родитель
4c713e3ce2
Коммит
943efad20f
|
|
@ -4,7 +4,7 @@ This project welcomes community contributions in the form of [Issues](#issue-rep
|
|||
|
||||
> If you have a question, have discovered an issue or perhaps you would like to propose an enhancement or idea, please file an issue report **BEFORE** commencing work on it.
|
||||
|
||||
## Contribution scope for Data Management & Analytics Scenario
|
||||
## Contribution scope for Cloud-scale Analytics Scenario
|
||||
|
||||
The following is the scope of contributions to this repository:
|
||||
|
||||
|
|
@ -90,7 +90,7 @@ After the pull request has been reviewed and approved, the feature branch will b
|
|||
|
||||
## Stewardship of the code repository
|
||||
|
||||
The Data Management & Analytics Scenario code repository are maintained by the code owners. The repository including language, design, policy oversight, and reference implementations. Elevated privileges will be solely based on active contributions in the project repository.
|
||||
The Cloud-scale Analytics Scenario code repository are maintained by the code owners. The repository including language, design, policy oversight, and reference implementations. Elevated privileges will be solely based on active contributions in the project repository.
|
||||
|
||||
User may be given elevated privileges once approved by the currents members. All members abide by all organizational polices, including the code of conduct. Elevated privileges can be withdrawn in the case of written notice of resignation or if the member is unreachable or unresponsive for extended time.
|
||||
|
||||
|
|
|
|||
20
README.md
20
README.md
|
|
@ -1,21 +1,21 @@
|
|||
# Data Management & Analytics Scenario - Data Product Streaming
|
||||
# Cloud-scale Analytics Scenario - Data Product Streaming
|
||||
|
||||
## Objective
|
||||
|
||||
The [Data Management & Analytics Scenario](https://aka.ms/adopt/datamanagement) provides a prescriptive data platform design coupled with Azure best practices and design principles. These principles serve as a compass for subsequent design decisions across critical technical domains. The architecture will continue to evolve alongside the Azure platform and is ultimately driven by the various design decisions that organizations must make to define their Azure data journey.
|
||||
The [Cloud-scale Analytics Scenario](https://aka.ms/adopt/cloudscaleanalytics) provides a prescriptive data platform design coupled with Azure best practices and design principles. These principles serve as a compass for subsequent design decisions across critical technical domains. The architecture will continue to evolve alongside the Azure platform and is ultimately driven by the various design decisions that organizations must make to define their Azure data journey.
|
||||
|
||||
The Data Management & Analytics architecture consists of two core building blocks:
|
||||
The Cloud-scale Analytics architecture consists of two core building blocks:
|
||||
|
||||
1. *Data Management Landing Zone* which provides all data management and data governance capabilities for the data platform of an organization.
|
||||
1. *Data Landing Zone* which is a logical construct and a unit of scale in the Data Management & Analytics architecture that enables data retention and execution of data workloads for generating insights and value with data.
|
||||
1. *Data Landing Zone* which is a logical construct and a unit of scale in the Cloud-scale Analytics architecture that enables data retention and execution of data workloads for generating insights and value with data.
|
||||
|
||||
The architecture is modular by design and allows organizations to start small with a single Data Management Landing Zone and Data Landing Zone, but also allows to scale to a multi-subscription data platform environment by adding more Data Landing Zones to the architecture. Thereby, the reference design allows to implement different modern data platform patterns like data-mesh, data-fabric as well as traditional datalake architectures. Data Management & Analytics Scenario has been very well aligned with the data-mesh approach, and is ideally suited to help organizations build data products and share these across business units of an organization. If core recommendations are followed, the resulting target architecture will put the customer on a path to sustainable scale.
|
||||
The architecture is modular by design and allows organizations to start small with a single Data Management Landing Zone and Data Landing Zone, but also allows to scale to a multi-subscription data platform environment by adding more Data Landing Zones to the architecture. Thereby, the reference design allows to implement different modern data platform patterns like data-mesh, data-fabric as well as traditional datalake architectures. Cloud-scale Analytics Scenario has been very well aligned with the data-mesh approach, and is ideally suited to help organizations build data products and share these across business units of an organization. If core recommendations are followed, the resulting target architecture will put the customer on a path to sustainable scale.
|
||||
|
||||
|
||||
|
||||
|
||||
---
|
||||
|
||||
_The Data Management & Analytics architecture represents the strategic design path and target technical state for your Azure data platform._
|
||||
*The Cloud-scale Analytics architecture represents the strategic design path and target technical state for your Azure data platform.*
|
||||
|
||||
---
|
||||
|
||||
|
|
@ -23,13 +23,13 @@ This repository describes a Data Product template for Data Streaming that can al
|
|||
|
||||
> **Note:** Before getting started with the deployment, please make sure you are familiar with the [complementary documentation in the Cloud Adoption Framework](https://aka.ms/adopt/datamanagement). Also, before deploying your first Data Product, please make sure that you have deployed a [Data Management Landing Zone](https://github.com/Azure/data-management-zone) and at least one [Data Landing Zone](https://github.com/Azure/data-landing-zone). The minimal recommended setup consists of a single [Data Management Landing Zone](https://github.com/Azure/data-management-zone) and a single [Data Landing Zone](https://github.com/Azure/data-landing-zone).
|
||||
|
||||
## Deploy Data Management & Analytics Scenario
|
||||
## Deploy Cloud-scale Analytics Scenario
|
||||
|
||||
The Data Management & Analytics architecture is modular by design and allows customers to start with a small footprint and grow over time. In order to not end up in a migration project, customers should decide upfront how they want to organize data domains across Data Landing Zones. All Data Management & Analytics architecture building blocks can be deployed through the Azure Portal as well as through GitHub Actions workflows and Azure DevOps Pipelines. The template repositories contain sample YAML pipelines to more quickly get started with the setup of the environments.
|
||||
The Cloud-scale Analytics architecture is modular by design and allows customers to start with a small footprint and grow over time. In order to not end up in a migration project, customers should decide upfront how they want to organize data domains across Data Landing Zones. All Cloud-scale Analytics architecture building blocks can be deployed through the Azure Portal as well as through GitHub Actions workflows and Azure DevOps Pipelines. The template repositories contain sample YAML pipelines to more quickly get started with the setup of the environments.
|
||||
|
||||
| Reference implementation | Description | Deploy to Azure | Link |
|
||||
|:---------------------------|:------------|:----------------|------|
|
||||
| Data Management & Analytics Scenario | Deploys a [Data Management Landing Zone](https://github.com/Azure/data-management-zone) and one or multiple Data Landing Zones all at once. Provides less options than the the individual Data Management Landing Zone and Data Landing Zone deployment options. Helps you to quickly get started and make yourself familiar with the reference design. For more advanced scenarios, please deploy the artifacts individually. |[](https://portal.azure.com/#blade/Microsoft_Azure_CreateUIDef/CustomDeploymentBlade/uri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-management-zone%2Fmain%2Fdocs%2Freference%2FdataManagementAnalytics.json/uiFormDefinitionUri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-management-zone%2Fmain%2Fdocs%2Freference%2Fportal.dataManagementAnalytics.json) | |
|
||||
| Cloud-scale Analytics Scenario | Deploys a [Data Management Landing Zone](https://github.com/Azure/data-management-zone) and one or multiple Data Landing Zones all at once. Provides less options than the the individual Data Management Landing Zone and Data Landing Zone deployment options. Helps you to quickly get started and make yourself familiar with the reference design. For more advanced scenarios, please deploy the artifacts individually. |[](https://portal.azure.com/#blade/Microsoft_Azure_CreateUIDef/CustomDeploymentBlade/uri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-management-zone%2Fmain%2Fdocs%2Freference%2FdataManagementAnalytics.json/uiFormDefinitionUri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-management-zone%2Fmain%2Fdocs%2Freference%2Fportal.dataManagementAnalytics.json) | |
|
||||
| Data Management Landing Zone | Deploys a single Data Management Landing Zone to a subscription. |[](https://portal.azure.com/#blade/Microsoft_Azure_CreateUIDef/CustomDeploymentBlade/uri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-management-zone%2Fmain%2Finfra%2Fmain.json/uiFormDefinitionUri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-management-zone%2Fmain%2Fdocs%2Freference%2Fportal.dataManagementZone.json) | [Repository](https://github.com/Azure/data-management-zone) |
|
||||
| Data Landing Zone | Deploys a single Data Landing Zone to a subscription. Please deploy a [Data Management Landing Zone](https://github.com/Azure/data-management-zone) first. |[](https://portal.azure.com/#blade/Microsoft_Azure_CreateUIDef/CustomDeploymentBlade/uri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-landing-zone%2Fmain%2Finfra%2Fmain.json/uiFormDefinitionUri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-landing-zone%2Fmain%2Fdocs%2Freference%2Fportal.dataLandingZone.json) | [Repository](https://github.com/Azure/data-landing-zone) |
|
||||
| Data Product Batch | Deploys a Data Workload template for Data Batch Analysis to a resource group inside a Data Landing Zone. Please deploy a [Data Management Landing Zone](https://github.com/Azure/data-management-zone) and [Data Landing Zone](https://github.com/Azure/data-landing-zone) first. |[](https://portal.azure.com/#blade/Microsoft_Azure_CreateUIDef/CustomDeploymentBlade/uri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-product-batch%2Fmain%2Finfra%2Fmain.json/uiFormDefinitionUri/https%3A%2F%2Fraw.githubusercontent.com%2FAzure%2Fdata-product-batch%2Fmain%2Fdocs%2Freference%2Fportal.dataProduct.json) | [Repository](https://github.com/Azure/data-product-batch) |
|
||||
|
|
|
|||
|
|
@ -1,6 +1,6 @@
|
|||
# Data Product Streaming - Prerequisites
|
||||
|
||||
This template repository contains all templates to deploy a Data Product for real-time data processing inside a Data Landing Zone of the Data Management & Analytics Scenario. Data Products are another unit of scale inside a Data Landing Zone and provide environments to cross-functional teams to work on individual data use-cases. This template can also be used for data integration into the platform. The fundamental difference would be that these teams are then connecting to data sources outside of the Data Landing Zones. Hence, this template qualifies for the following usage:
|
||||
This template repository contains all templates to deploy a Data Product for real-time data processing inside a Data Landing Zone of the Cloud-scale Analytics Scenario. Data Products are another unit of scale inside a Data Landing Zone and provide environments to cross-functional teams to work on individual data use-cases. This template can also be used for data integration into the platform. The fundamental difference would be that these teams are then connecting to data sources outside of the Data Landing Zones. Hence, this template qualifies for the following usage:
|
||||
|
||||
| Scenario | Applicability |
|
||||
|:-----------------|:-------------------|
|
||||
|
|
|
|||
|
|
@ -3,7 +3,7 @@
|
|||
"view": {
|
||||
"kind": "Form",
|
||||
"properties": {
|
||||
"title": "Data Management & Analytics Scenario - Data Product Streaming",
|
||||
"title": "Cloud-scale Analytics Scenario - Data Product Streaming",
|
||||
"steps": [
|
||||
{
|
||||
"name": "basics",
|
||||
|
|
@ -14,9 +14,9 @@
|
|||
"type": "Microsoft.Common.InfoBox",
|
||||
"visible": true,
|
||||
"options": {
|
||||
"text": "Data Management & Analytics Scenario is a prescriptive reference architecture for data with reference implementation provided by Microsoft. Visit 'aka.ms/adopt/datamanagement' for more details about the solution pattern.",
|
||||
"text": "Cloud-scale Analytics Scenario is a prescriptive reference architecture for data with reference implementation provided by Microsoft. Visit 'aka.ms/adopt/datamanagement' for more details about the solution pattern.",
|
||||
"style": "Info",
|
||||
"uri": "https://aka.ms/adopt/datamanagement"
|
||||
"uri": "https://aka.ms/adopt/cloudscaleanalytics"
|
||||
}
|
||||
},
|
||||
{
|
||||
|
|
|
|||
Загрузка…
Ссылка в новой задаче