54c2bd4955
Spark3 compatibility ( #520 )
2020-07-14 12:56:06 -07:00
dfb2c91d99
Update documentation for the current release (2.3.16) ( #519 )
2020-06-25 20:32:20 -07:00
34eeed9f4f
Make spark-sql provided ( #508 )
2020-06-25 18:41:58 -07:00
c5593fc295
Update version number for new release (2.3.16) ( #518 )
2020-06-25 16:23:56 -07:00
4e86e1df26
fix added quotes to string property values ( #516 )
2020-06-25 16:14:59 -07:00
a543019715
add receive watchdog ( #517 )
...
Add a watchdog to the receive so that receivers can be recreated if there is no traffic for a user-specified period.
2020-06-25 15:39:22 -07:00
d096e298e6
EventHubs write - allow Properties map to be non-nullable or nullable column ( #507 )
2020-04-24 15:13:30 -07:00
99a0852a3d
Update documentation for the current release (2.3.15) ( #505 )
2020-04-18 01:51:19 -07:00
5fa3f25d74
Retry on send failures, improve logging and metrics ( #504 )
2020-04-18 00:52:33 -07:00
ad3f8403da
Merge pull request #501 from nyaghma/handlingKafkaKey
...
Handling kafka key in SystemProperties and a sample user code
2020-04-14 09:13:13 -05:00
a50e0c98c2
Read a batch in the example instead of a stream
2020-04-13 13:12:20 -05:00
32a67fbc5f
add a guide and smaple code for extracting the kafka key from system properties
2020-04-13 12:48:23 -05:00
e2c03adab0
Add SimpleLogMetricPlugin class ( #499 )
2020-04-11 03:01:15 -07:00
e976aefa2f
Fix a few issues for Scala 2.12 and code clean-up ( #498 )
2020-04-10 22:53:13 -07:00
0d6205a65d
Add receive, send listener for getting performance metrics ( #473 )
...
Co-authored-by: Lucas Yang <luyan@microsoft.com>
2020-04-10 19:36:07 -07:00
d90bc73303
Update version number for new release (2.3.15) ( #497 )
2020-04-09 09:52:30 -07:00
bda705a13f
Couple of fixes related to configuration and improve logging. ( #493 )
...
* several minor fixes
* add a check for operation timeout
2020-04-08 15:13:56 -07:00
fbc606f0fd
Use receiver timeout for underlying API calls to Event Hubs so that the connector can retry on failures ( #492 )
2020-04-05 03:17:00 -07:00
244613f4b1
encrypt connection string in eventhub conf ( #491 )
2020-04-04 02:00:59 -07:00
4527425369
Fix IllegalStateException issue and recreate a receiver if the receiver was closed ( #490 )
...
* fix IllegalState error caused by data expiration and recreate a receiver if the receiver was closed
* update adjustment logic
2020-04-03 15:16:31 -07:00
7a8e7bc889
Don't close a receiver for epoch receiver case ( #486 )
2020-04-01 17:54:29 -07:00
564267dd12
Update docs and add a Q/A in FAQ ( #481 )
...
* Update the current version in the README
* Add a question-answer to FAQ
* update version and default starting position in docs
2020-03-31 15:03:11 -07:00
6640dfe273
add null check for properties key-value and a test case ( #483 )
...
* add null check for properties key-value and a testcase
* remove the commented old code
Co-authored-by: Navid Yaghmazadeh <navid@Navids-Personal-MacBook-Pro.local>
2020-03-31 13:45:43 -07:00
fa3fcd6a7d
Add support for different partitioning strategies to deal with executor ( #478 )
2020-03-06 22:35:55 -08:00
40eabb0cd0
Update run_tests.sh
2020-03-06 15:59:06 -08:00
51f70789ad
Update .travis.yml
2020-03-06 15:39:41 -08:00
5c31041b6a
Fix a configuration bug (useExclusiveReceiver otpion) ( #466 )
2019-10-23 22:40:17 -07:00
33ee66e23a
Several bug fixes and improvements for 2.3.14 release ( #465 )
...
* [Bug fix] fix IO pipe issue that causes a blocking issue on send calls
* [Bug fix] fix broken TCP connection issue that causes prolonged delay in receiving events
* [Configuration] provide a configuration knob to specify whether an epoch receiver should be used. Default value is true.
* [Tracing] add a Spark task ID to log messages and emit latency data for receive calls
2019-10-23 09:44:13 -07:00
d5ad0d6caa
Update version number for new release (2.3.13) ( #451 )
2019-07-26 13:29:19 -07:00
f10a85f03e
add event hub name to the OffsetRange toString function so that it is present in the spark metadata. add simple unit test for validation of the string ( #450 )
2019-06-27 08:41:01 -07:00
64d3fb5eca
small misstype in EventPosition ( #449 )
2019-06-05 22:51:46 -07:00
1ad742d461
Update version number for new release (2.3.12) ( #446 )
2019-05-10 15:13:49 -07:00
0e909b8cc0
Fix typo Strucutred -> Structured ( #447 )
2019-05-10 12:10:43 -07:00
081e76b0cb
Update version numbers in the document and mark 2.3.11 as Preview release ( #445 )
2019-05-02 18:08:00 -07:00
d368d7c6b0
Update version numbers for new release (2.3.11 & 2.2.11) ( #443 )
2019-05-01 21:45:19 -07:00
d9f4fe02e5
performance improvement for EventHubs writer ( #441 )
2019-04-12 09:30:45 -07:00
d5e2734c47
Updated the doc - new settings (prefetchCount & threadPoolSize) ( #439 )
2019-04-08 17:43:46 -07:00
f5fe40d994
Prepare 2.3.10 & 2.2.10 release ( #438 )
2019-04-08 14:52:51 -07:00
08c0c58650
Update dpendency - Event Hubs client SDK (2.2.0 --> 2.3.0) ( #437 )
2019-04-08 09:36:54 -07:00
90bd0e8608
Update maximum prefetch count setting and improve logging ( #436 )
2019-04-01 19:58:28 -07:00
2a6a5b9f28
Update README.md ( #434 )
2019-03-19 17:30:32 -07:00
3986bae133
Update README.md ( #429 )
2019-01-28 10:58:18 -08:00
420e4bd2a2
Prepare 2.3.9 & 2.2.9 release ( #427 )
2019-01-18 15:53:32 -08:00
9f7c9d0818
Handle a case where messages in an offet range were already expired ( #426 )
2019-01-18 13:31:51 -08:00
cdea9ae746
Prepare 2.3.8 & 2.2.8 release and update Java client SDK dependency ( #425 )
2019-01-15 19:47:23 -08:00
0a59666dda
Provide a knob to specify the size of thread pool and recreate a receiver if receive call fails for an extended period of time ( #423 )
2019-01-14 09:47:44 -08:00
6932f56d0a
Release 2.2.7 for spark runtime 2.1 and 2.2 ( #421 )
2019-01-05 22:07:40 -08:00
86fb6db24d
Prepare for 2.3.7 release ( #420 )
...
* Prepare for 2.3.7 release
* Enable ReceiverTimeout and PrefetchCount configuraion
* Update Java client dependency
2019-01-05 18:25:23 -08:00
498746f308
Fix future timeout issue ( #419 )
2019-01-02 17:45:34 -08:00
53c1d79433
Provide a knob to specify prefetch count for the underlying receiver. ( #417 )
...
* Provide a knob to specify prefetch count for the underlying receiver
2018-12-11 18:08:26 -08:00
nyaghma
SJ
Fokko Driesprong
Wesley Hoffman
nayaghma
Lucas Yang
Dan Mace
jgiardin
Dirceu Semighini Filho
gison93