* stream source info size
* some good code, unfished
* manaed streaming queuing policy per format
* ser raw size for stream
* remove todo
* format
* fix test
* print exception message on last retry
* used undeclared jackson dep
* format
* add comment
* good comments
* better
* changelog
* format
* comments - E2E
* changelog
* comments
* comment
* fix
* last comments
---------
Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
* Introduces KustoQuery wrapper object
* working on async client
* updating client with KustoQuery object
* updating client with KustoQuery object
* updating client with KustoQuery object
* will simplify later.
* will simplify later.
* will simplify later.
* ran formatter, fixed test, fixed bad merge
* AtomicBooleans in already modified test. Save some lines, might as well.
* hide KustoQuery object
* rename and hide KustoRequest
* adding E2ETests for async queries
* ran formatter
* no complete in sink
* move blocking operations off the io thread
* run formatter
* replace execute utilization
* fixes teardown. async still doesn't work yet.
* fixes msal4j issue
* build.yaml
* Introduces KustoQuery wrapper object
* working on async client
* updating client with KustoQuery object
* updating client with KustoQuery object
* updating client with KustoQuery object
* will simplify later.
* will simplify later.
* will simplify later.
* ran formatter, fixed test, fixed bad merge
* AtomicBooleans in already modified test. Save some lines, might as well.
* hide KustoQuery object
* rename and hide KustoRequest
* adding E2ETests for async queries
* ran formatter
* no complete in sink
* move blocking operations off the io thread
* run formatter
* replace execute utilization
* fixes teardown. async still doesn't work yet.
* fixes msal4j issue
* rebased
* rework azure branch
* remove unused dependencies
* fix some more issues with imports
* add default timeout 10 min
* re-add readme
* modified changelog
* modified changelog
* removes krL
* remove async test file
* remove closeable from query clients
* fixes pom version change and removes unused reactor property
* CI_EXECUTION
* storageaccountset guard clause
* close clients in E2ETest
* remove extra assertions from teardown
* remove reactor step verifiers for now
* readd deflate to cloudinfo
* renoved reactor test library for now
* run formatter
* added fixme
* move URIBuilder to further facilitate removal of Apache
* add more detail to assertion failure
* Made InvalidConnectionString extend DataClientException so users can optionally catch the more specific exception
* commenting everything async until implementation works
* commenting everything async until implementation works
* ran formatter
* remove unused Apache classes
* removed commented code
* move message to appropriate assertion
* removed last of the commented code and ran formatter
* readd the auto-delete policy
* make request object usage private
* put back more Apache things.
* renove trailing space
* Update BaseClient.java
---------
Co-authored-by: cole <cole.snyder@gmork.tech>
Co-authored-by: asafmahlev <asafmahlev@microsoft.com>
Co-authored-by: ohad bitton <32278684+ohadbitt@users.noreply.github.com>
* initial commit removing apache http libraries
* updated MSAL wrapper class to include headers in response
* Added TestHttpResponse class to replace BasicHttpResponse in Tests
* Added KustoParseException to replace ParseException from old Apache Client.
* removed todo regarding ParseException
* removed EofSensorInputStream
* added fixme to replace EofSensorInputStream
* Return of the Apache
* Fixed UtilitiesTest
Removed cast to Closeable in CloudInfo
* return UriBuilder to UriUtils
* add proxy options back to HttpClientFactory
* ran formatter
* closeable and fix build
* fix test
* format
* removed extra throws
* Per Ohad review comments:
-Adds custom HTTP status codes
-Integrates status codes
-Uses Context.NONE static factory
* removed caught exceptions that were rethrown with no changes/side effects in QueuedIngestClientImpl per review comments
* removes block on body by using BinaryData
removes Entity references
* ran formatter
* added Tracing object and builder to shorten method signatures
added HttpRequestBuilder to separate request building logic from execute methods in the client, providing better testability
Created BaseClient class to host the inner httpClient
Put post methods on BaseClient so no need for utils class
removed HttpPostUtils.java
updated impacted tests
left notes on Keep-Alive header in ClientFactory
ran formatter
* puts old URIBuilder back in place
* update readme with ProxyOptions
* aligns with PR 342
* fix issue with Closeable
* ran formatter
* Fix sync HttpWrapper implementation
* fix build
* format
* build
* Few bug fixes
Build works also with OKHttp providers
* readd the exclusion of commons-codec for security posture
* adds response timeout and client provider to the client properties wrapper
* removes references to Netty
* removes extra comment
* adds Keep-Alive back to prevent breaking change for users of Keep-Alive. updates CHANGELOG.md
ran formatter.
* removes deflate algorithm from encoding header
* revert removing Apache core (URIBuilder depends on utilities in core)
* remove netty from client factory
* fix
* removes CloseParentResourcesStream.java
* reusable Gzip logic
* factory now uses azure-core default http client options
* I always forget the formatter
* fix test
---------
Co-authored-by: cole <cole.snyder@gmork.tech>
Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
Co-authored-by: ohad bitton <32278684+ohadbitt@users.noreply.github.com>
* transient IOError
* transient IOError
* move getObjectMapper back to utils
* revert unrelated
* revert unrelated
* fix warning
* revert HttpClientProperties move to http folder
* try again
* format
* disable managed streamign test
* timeout test
* t
* dis q t
* redo test
* redo test
* no retry in cloud test
* no retry in cloud test
* fix vavr not used
* stop it !
* stop it !
* stop it !
* queuedClient test again?
* no managed , queuedClienttest minus ingestFromBlob_IngestionReportMethodIsNotTable_EmptyIngestionStatus
* format
* add again ingestFromBlob_IngestionReportMethodIsNotTable_EmptyIngestionStatus
* now with retries?
* retries not vavr?
* f
* nicer
* nicer
* nicer
---------
Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
* working and nice
* fix tests
* format
* revert samples
* test streaming from blob
* revert revert test
* test
* format
* fix test
* revert
---------
Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
* Added formatter plugin, right now only starting
* Put config on main file
* Updated style to match ours better.
* Added declaration.
* edit build.yml
* Update style and apply formatting
* Update style and apply formatting
* Tweaked settings again
* Replace with session because that might be the correct path.
* Try formatting
* line endings
* renormalize new lines
* csluuid
* new lines
* new lines
* Run again with clean
* fixed build.yml
* Changed style to be better
* Added some docs
* Fix enum nomenclature
* Fix enum nomenclature
* Fix IngestionBlobInfo to use the String versions of the enums
* Add KustoValue to IngestionReportLevel and IngestionReportMethod enums
* From code review
* Rearchitect the AAD authentication code to be object oriented and follow best-practices (Java and otherwise)
* Rearchitect the AAD authentication code to be object oriented and follow best-practices (Java and otherwise)
* Code review comments:
- Rename to CallbackTokenProvider
- Remove 2 unnecessarily-passed authorityIds
* Add another layer of abstraction (MsalTokenProvider)
* Add another layer of abstraction (MsalTokenProvider)
* Add Override annotation per code review comment
Introducing Streaming Ingest Client which performs ingest operations, of relatively small volume data for each table, directly to the engine over a special endpoint.
The streaming ingest client is recommended when there is a requirement for low latency queries, but it is not recommended for bulk ingestion.
* Update POMs for publish (#79)
* Adding an example of using CompletableFuture with the ingestFromFile() (#75)
* update readme with how to install from maven (#81)
* reportStatusWithoutSecrets (#83)
* ingestWithTagsPropeties (#82)
* aadAuthencticatorLocksFix (#84)
* throw-full-exceptions (#85)
* Ingestion properties: add setAdditionalProperties (#86)
* Reorg dependencies (#87)
* Flatten child poms to remove the need to publish the parent pom
* Add surefire plugin to kusto-data to run unit-tests
* change key file to 128bit to avoid the need for JCE
* Adding Ingestion Tests
* Adding argument validation
* Changes and fixes to make the code be more testable
* Adding Javadocs
* Renaming AzureStorageHelper -> AzureStorageClient
* Add ReadWriteLocks to make the Resource Manager thread safe
* Remove String formatting from logs.
* Use concurrent HashMap for ingestion resources map.
* pom changes: move common jar versions to parent, update minor version of libs
* updated readme fixes#17
* updated file ingest sample
* fixes#9, fix null string check in authentication
* add example of how to do a query
ohad bitton
Cole
AsafMah
Welton Rodrigo Torres Nascimento
Tanmaya Panda
breriksenms
Larisa Andreea Danaila
Yihezkel Schoenbrun
ohbitton
Ohad Bitton
vladikbr
Ariel Yehezkely
Tomer Shetah
Tamir Kamara
Rabeea Abu-Saleh
Daniel Dubovski
Liza Shakury