Azure
/
azure-event-hubs-spark
зеркало из https://github.com/Azure/azure-event-hubs-spark.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность

Update documentation for the current release (2.3.17) (#530)

This commit is contained in:
SJ 2020-08-07 12:25:11 -07:00 коммит произвёл GitHub
Родитель b349217d50
Коммит 90d70928d9
Не найден ключ, соответствующий данной подписи
Идентификатор ключа GPG: 4AEE18F83AFDEB23
5 изменённых файлов: 24 добавлений и 22 удалений
Показать статистику Скачать Patch файл Скачать Diff файл Показать все файлы Свернуть все файлы

2
.github/CONTRIBUTING.md поставляемый
Просмотреть файл

@ -18,7 +18,7 @@ run all unit/integration tests and build a JAR.
### SBT Dependency ### SBT Dependency
libraryDependencies += "com.microsoft.azure" %% "azure-eventhubs-spark" %% "2.3.16" libraryDependencies += "com.microsoft.azure" %% "azure-eventhubs-spark" %% "2.3.17"
## Filing Issues ## Filing Issues

24
README.md
Просмотреть файл

@ -30,21 +30,23 @@ By making Event Hubs and Spark easier to use together, we hope this connector ma
#### Spark #### Spark
|Spark Version|Package Name|Package Version| |Spark Version|Package Name|Package Version|
|-------------|------------|----------------| |-------------|------------|----------------|
|Spark 2.4|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.16-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.16%7Cjar)| |Spark 3.0|azure-eventhubs-spark_2.12|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.12%7C2.3.17%7Cjar)|
|Spark 2.4|azure-eventhubs-spark_2.12|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.16-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.12%7C2.3.16%7Cjar)| |Spark 2.4|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.17%7Cjar)|
|Spark 2.3|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.16-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.16%7Cjar)| |Spark 2.4|azure-eventhubs-spark_2.12|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.12%7C2.3.17%7Cjar)|
|Spark 2.3|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.17%7Cjar)|
|Spark 2.2|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.2.10-blue.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.2.10%7Cjar)| |Spark 2.2|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.2.10-blue.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.2.10%7Cjar)|
|Spark 2.1|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.2.10-blue.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.2.10%7Cjar)| |Spark 2.1|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.2.10-blue.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.2.10%7Cjar)|
#### Databricks #### Databricks
|Databricks Runtime Version|Artifact Id|Package Version| |Databricks Runtime Version|Artifact Id|Package Version|
|-------------|------------|----------------| |-------------|------------|----------------|
|Databricks Runtime 6.X|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.16-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.16%7Cjar)| |Databricks Runtime 7.X|azure-eventhubs-spark_2.12|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.12%7C2.3.17%7Cjar)|
|Databricks Runtime 6.X|azure-eventhubs-spark_2.12|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.16-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.12%7C2.3.16%7Cjar)| |Databricks Runtime 6.X|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.17%7Cjar)|
|Databricks Runtime 5.X|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.16-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.16%7Cjar)| |Databricks Runtime 6.X|azure-eventhubs-spark_2.12|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.12%7C2.3.17%7Cjar)|
|Databricks Runtime 5.X|azure-eventhubs-spark_2.12|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.16-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.12%7C2.3.16%7Cjar)| |Databricks Runtime 5.X|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.17%7Cjar)|
|Databricks Runtime 4.X|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.16-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.16%7Cjar)| |Databricks Runtime 5.X|azure-eventhubs-spark_2.12|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.12%7C2.3.17%7Cjar)|
|Databricks Runtime 3.5|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.16-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.16%7Cjar)| |Databricks Runtime 4.X|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.17%7Cjar)|
|Databricks Runtime 3.5|azure-eventhubs-spark_2.11|[![Maven Central](https://img.shields.io/badge/maven%20central-2.3.17-brightgreen.svg)](https://search.maven.org/#artifactdetails%7Ccom.microsoft.azure%7Cazure-eventhubs-spark_2.11%7C2.3.17%7Cjar)|
#### Roadmap #### Roadmap
@ -59,13 +61,13 @@ For Scala/Java applications using SBT/Maven project definitions, link your appli
groupId = com.microsoft.azure groupId = com.microsoft.azure
artifactId = azure-eventhubs-spark_2.11 artifactId = azure-eventhubs-spark_2.11
version = 2.3.16 version = 2.3.17
or or
groupId = com.microsoft.azure groupId = com.microsoft.azure
artifactId = azure-eventhubs-spark_2.12 artifactId = azure-eventhubs-spark_2.12
version = 2.3.16 version = 2.3.17
### Documentation ### Documentation

8
docs/PySpark/structured-streaming-pyspark.md
Просмотреть файл

@ -23,13 +23,13 @@ Structured streaming integration for Azure Event Hubs is ultimately run on the J
``` ```
groupId = com.microsoft.azure groupId = com.microsoft.azure
artifactId = azure-eventhubs-spark_2.11 artifactId = azure-eventhubs-spark_2.11
version = 2.3.16 version = 2.3.17
or or
groupId = com.microsoft.azure groupId = com.microsoft.azure
artifactId = azure-eventhubs-spark_2.12 artifactId = azure-eventhubs-spark_2.12
version = 2.3.16 version = 2.3.17
``` ```
For Python applications, you need to add this above library and its dependencies when deploying your application. For Python applications, you need to add this above library and its dependencies when deploying your application.
@ -397,11 +397,11 @@ AMQP types need to be handled explicitly by the connector. Below we list the AMQ
As with any Spark applications, `spark-submit` is used to launch your application. `azure-eventhubs-spark_2.11` As with any Spark applications, `spark-submit` is used to launch your application. `azure-eventhubs-spark_2.11`
and its dependencies can be directly added to `spark-submit` using `--packages`, such as, and its dependencies can be directly added to `spark-submit` using `--packages`, such as,
./bin/spark-submit --packages com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.16 ... ./bin/spark-submit --packages com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.17 ...
For experimenting on `spark-shell`, you can also use `--packages` to add `azure-eventhubs-spark_2.11` and its dependencies directly, For experimenting on `spark-shell`, you can also use `--packages` to add `azure-eventhubs-spark_2.11` and its dependencies directly,
./bin/spark-shell --packages com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.16 ... ./bin/spark-shell --packages com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.17 ...
See [Application Submission Guide](https://spark.apache.org/docs/latest/submitting-applications.html) for more details about submitting See [Application Submission Guide](https://spark.apache.org/docs/latest/submitting-applications.html) for more details about submitting
applications with external dependencies. applications with external dependencies.

4
docs/spark-streaming-eventhubs-integration.md
Просмотреть файл

@ -23,13 +23,13 @@ For Scala/Java applications using SBT/Maven project definitions, link your appli
``` ```
groupId = com.microsoft.azure groupId = com.microsoft.azure
artifactId = azure-eventhubs-spark_2.11 artifactId = azure-eventhubs-spark_2.11
version = 2.3.16 version = 2.3.17
or or
groupId = com.microsoft.azure groupId = com.microsoft.azure
artifactId = azure-eventhubs-spark_2.12 artifactId = azure-eventhubs-spark_2.12
version = 2.3.16 version = 2.3.17
``` ```
For Python applications, you need to add this above library and its dependencies when deploying your application. For Python applications, you need to add this above library and its dependencies when deploying your application.

8
docs/structured-streaming-eventhubs-integration.md
Просмотреть файл

@ -23,13 +23,13 @@ For Scala/Java applications using SBT/Maven project definitions, link your appli
``` ```
groupId = com.microsoft.azure groupId = com.microsoft.azure
artifactId = azure-eventhubs-spark_2.11 artifactId = azure-eventhubs-spark_2.11
version = 2.3.16 version = 2.3.17
or or
groupId = com.microsoft.azure groupId = com.microsoft.azure
artifactId = azure-eventhubs-spark_2.12 artifactId = azure-eventhubs-spark_2.12
version = 2.3.16 version = 2.3.17
``` ```
For Python applications, you need to add this above library and its dependencies when deploying your application. For Python applications, you need to add this above library and its dependencies when deploying your application.
@ -397,11 +397,11 @@ AMQP types need to be handled explicitly by the connector. Below we list the AMQ
As with any Spark applications, `spark-submit` is used to launch your application. `azure-eventhubs-spark_2.11` As with any Spark applications, `spark-submit` is used to launch your application. `azure-eventhubs-spark_2.11`
and its dependencies can be directly added to `spark-submit` using `--packages`, such as, and its dependencies can be directly added to `spark-submit` using `--packages`, such as,
./bin/spark-submit --packages com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.16 ... ./bin/spark-submit --packages com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.17 ...
For experimenting on `spark-shell`, you can also use `--packages` to add `azure-eventhubs-spark_2.11` and its dependencies directly, For experimenting on `spark-shell`, you can also use `--packages` to add `azure-eventhubs-spark_2.11` and its dependencies directly,
./bin/spark-shell --packages com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.16 ... ./bin/spark-shell --packages com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.17 ...
See [Application Submission Guide](https://spark.apache.org/docs/latest/submitting-applications.html) for more details about submitting See [Application Submission Guide](https://spark.apache.org/docs/latest/submitting-applications.html) for more details about submitting
applications with external dependencies. applications with external dependencies.