Граф коммитов

334 Коммитов

Автор SHA1 Сообщение Дата
fahad f73579d75c Fixed unit and E2E tests 2020-06-21 21:50:05 +05:30
fahad e1d51cb195 resolve merge conflicts | fix for missing dlq recods 2020-06-21 21:11:19 +05:30
hasher 1b02308297 clean the code 2020-06-21 16:01:24 +05:30
hasher 696f63f37c Added struct support for json 2020-06-21 15:42:40 +05:30
hasher ea6417f7a9 Added different formatters and integeration test 2020-06-19 21:39:19 +05:30
ohad bitton 938873e780
Merge pull request #29 from gholliday/gholliday/fixes
Fixes for temp directory null error and kusto.auth.authority not found
2020-06-19 18:38:43 +03:00
ohad bitton 03a9d6d994
Merge branch 'master' into gholliday/fixes 2020-06-19 18:38:32 +03:00
ohad bitton cb3c4b9517
Fix config 2020-06-19 12:07:06 +03:00
Fahad Sheikh 40c1b3d8db
Merge pull request #7 from SanchayGupta1197/error-handling-dlq-kusto-sdk-upgrade
Updated Kusto SDK version from 1.4.2 to 2.1.0
2020-06-18 14:49:58 +05:30
SanchayGupta1197 44f6a698c4 Changed error message for DataServiceException 2020-06-18 14:47:13 +05:30
SanchayGupta1197 f787444b89 Updated Kusto SDK version from 1.4.2 to 2.1.0 2020-06-18 14:25:32 +05:30
fahad 9c1f74f777 changing errorTolerance -> BehaviorOnError 2020-06-18 14:23:03 +05:30
fahad 8b68c2af84 connectexception when retries fail 2020-06-18 13:27:43 +05:30
fahad ab7d88c97f handling service exception for retries 2020-06-18 13:13:49 +05:30
Grant Holliday 1c2d3e22de Fix other configuration getters to use correct names 2020-06-18 17:28:29 +10:00
Grant Holliday b4fc2173ca s/java.io.tempdir/java.io.tmpdir 2020-06-18 16:00:52 +10:00
Grant Holliday a29b2593d9 rename java.io.tempdir to the correct property java.io.tmpdir 2020-06-18 15:45:37 +10:00
Grant Holliday 8e04bc2d63 README typos and formatting 2020-06-18 15:44:22 +10:00
Fahad Sheikh b777c6847d
Merge pull request #6 from SanchayGupta1197/error-handling-dlq-retries-test-fix
fixed test cases
2020-06-16 15:57:16 +05:30
SanchayGupta1197 b0d7d52237 Added Ignore to E2E 2020-06-16 15:54:37 +05:30
SanchayGupta1197 bd78f5f56f fixed test cases 2020-06-16 15:43:03 +05:30
ohad bitton c64647242e
Merge pull request #26 from Azure/fix-config-secrets
Fix secrets config
2020-06-16 11:43:14 +03:00
fahad 3c2b7e6c56 added config tests | minor fixes 2020-06-16 12:04:03 +05:30
Ohad Bitton 9e3e35acf9 shouldnt hide appId 2020-06-15 22:16:19 +03:00
Ohad Bitton 67413055cd no need 2020-06-15 22:08:24 +03:00
Ohad Bitton e5ec114092 fix config 2020-06-15 22:03:20 +03:00
Fahad Sheikh e4b0bac612
Merge branch 'master' into error-handling-dlq-retries 2020-06-15 17:51:00 +05:30
fahad 5d81e76ced PR comments addressed | improvements 2020-06-15 16:26:38 +05:30
ohad bitton 820f95cc1d
Merge pull request #24 from Azure/fixOffset
Fix test
2020-06-15 09:40:54 +03:00
Ohad Bitton 964a3f32cc fix test 2020-06-15 09:39:44 +03:00
fahad 9ec83807fd error tolerance improvements 2020-06-15 03:17:18 +05:30
fahad 28d8705da3 added retryUtil for exponential backoff 2020-06-15 01:53:11 +05:30
fahad 4d6474c66a added retries and dlq for failed records 2020-06-15 01:49:16 +05:30
Ohad Bitton e039c29ed4 Merge branch 'hashedin-error-handling' and use newer Java version which now has apacheAvro format support
# Conflicts:
#	src/main/java/com/microsoft/azure/kusto/kafka/connect/sink/KustoSinkConfig.java
#	src/main/java/com/microsoft/azure/kusto/kafka/connect/sink/KustoSinkTask.java
#	src/test/java/com/microsoft/azure/kusto/kafka/connect/sink/KustoSinkTaskTest.java
2020-06-14 13:40:24 +03:00
Ohad Bitton 71b690d9b5 Merge branch 'hashedin-error-handling' and use newer Java version which now has apacheAvro format support
# Conflicts:
#	src/main/java/com/microsoft/azure/kusto/kafka/connect/sink/KustoSinkConfig.java
#	src/main/java/com/microsoft/azure/kusto/kafka/connect/sink/KustoSinkTask.java
#	src/test/java/com/microsoft/azure/kusto/kafka/connect/sink/KustoSinkTaskTest.java
2020-06-14 13:40:07 +03:00
Fahad Sheikh b59ff42443
Table access validation at ConnectorTask start (#23)
* Added Read/Write Validation for Tables

* minor fix

* resolves review changes

* Refactor ValidateTableAccess

* Connector.class cleanup

* Config.class - Cleanup, improvements, added error tolerance and retries
configs

* Config improvement(unit test might fail)

* Added Ingestion URL

* resolved PR comments

* Added test for Sink Connecter Config

* Refactored Validate Table

* resolved PR comments

* Refactored code to handle NullPointer Exceptions on ConnectException

* Improved TableMapping validation message

* Minor refactor to validateTableAccess

* added deprecated configs and cleanup

* minor getter naming improvement

* fixing config class unit tests

* Addressed config documentation comments and removed unwanted tests

* fixed KustoSinkTaskTest

* Resolved PR Changes

* unrolling and removing unwanted imports

* using query principal roles

Co-authored-by: SanchayGupta1197 <sanchay.gupta@hashedin.com>
Co-authored-by: fahad <hasher@localhost>
2020-06-12 11:52:47 -05:00
fahad 96dc07bea8 using query principal roles 2020-06-11 18:50:38 +05:30
fahad f7c5a8b6af unrolling and removing unwanted imports 2020-06-11 18:02:42 +05:30
fahad 0e650d6415 Merge branch 'table-access-validation' of git@github.com:hashedin/kafka-sink-azure-kusto.git into table-access-validation 2020-06-11 17:08:01 +05:30
fahad 11cadcd508 Resolved conflicts | Ignoring E2E tests 2020-06-11 17:03:40 +05:30
ohad bitton 240f14d9cd
Merge pull request #22 from Azure/lockOnFlush
Lock on flush
2020-06-11 12:26:20 +03:00
Ohad Bitton deb26d5288 version 2020-06-11 12:25:51 +03:00
Fahad Sheikh 6dca39dbaa
Merge pull request #4 from SanchayGupta1197/fix_kusto_sink_test
fixed KustoSinkTaskTest
2020-06-11 14:24:09 +05:30
SanchayGupta1197 c55b6f2ad4 Resolved PR Changes 2020-06-11 14:19:03 +05:30
SanchayGupta1197 497598c2a1 fixed KustoSinkTaskTest 2020-06-11 13:50:01 +05:30
fahad 112c1cb2ea Addressed config documentation comments and removed unwanted tests 2020-06-11 13:49:00 +05:30
fahad 18620016ce fixing config class unit tests 2020-06-11 02:00:41 +05:30
fahad c536d47270 minor getter naming improvement 2020-06-11 01:41:16 +05:30
fahad a26a2ce111 added deprecated configs and cleanup 2020-06-11 01:14:31 +05:30
Fahad Sheikh fe992a784b
Merge pull request #3 from SanchayGupta1197/table_access_validation
Table access validation
2020-06-10 23:29:35 +05:30