Граф коммитов

79 Коммитов

Автор SHA1 Сообщение Дата
ohad bitton e908bff85f
Guess who's back - Java 8 is back again - tell a friend (#307)
* java 8 and new bom

* changelog and version

* fix

* fix

* comments

---------

Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
2023-06-15 18:08:00 +03:00
Cole f841a7f91a
Dependency bumps, jackson, commons features, httpclient, and msal4j (#295)
* minor dependency bumps
jackson security bump

* added dependency alignment comment

---------

Co-authored-by: cole <colesnyder@jlg.com>
Co-authored-by: ohad bitton <32278684+ohadbitt@users.noreply.github.com>
2023-04-19 10:55:22 +03:00
AsafMah eb30dfe270
Bump to 4.0.4 + new release method (#290) 2023-03-20 17:10:26 +02:00
AsafMah e69725d042
Bump to 4.0.3 2023-02-14 08:36:05 +02:00
AsafMah 31c603082f
Added props (#281)
* Revert "Revert "Added props""

This reverts commit f40ad30d39.

* Fixed NPE

* Added tests

* Formatting

* Tests again

* Fixed NRE

* Upgrade mockito to fix tests

* Added according to spec

* Fallback to env

* Align name

* format

* format

* format

* Fixed tests

* Some comments

* Moved header logic away.

* Formatter

* Fixed null

* Removed append method

* FFormat

* remove unrelated test

* Optimize imports

* Align param order with .net

* format

* Naming

* Use real url

* PR fixes

* public

* format

* Update Utils.java
2023-02-12 14:01:05 +02:00
asaharn 4e588debb6
IngestionStatusInTableDescription to support serialization (#287)
* TableClient as transient to support serialization
*Rebuilding TableClient in case of deserialization
* version change to 4.0.2
2023-02-10 14:06:16 +05:30
AsafMah cdfae86c57
Test + version bump 2022-12-15 16:21:32 +02:00
ohad bitton 1b233a68c0
Java 11 and extract Process name (#260)
Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
2022-11-27 11:10:54 +02:00
AsafMah 847898d096
Upgrade apache.common.text (#277) 2022-11-27 09:08:39 +02:00
ohad bitton 6147035e83
Move to Blob Storage v12 and azure bom versioning (#240)
* storage v12

* storage v12

* complete - working

* STORAGE v12

* STORAGE v12 works and tested

* tests revert

* tests revert

* try pom

* try bom 1.0.6 - fails for reactor netty http

* bom 1.0.5 fails for netty for unknown reason - version match!

* bom 1.0.5 fails for netty for unknown reason - version match!

* revert me

* better

* merge it better

* merge better

* cleaner

* should work

* fix bom

* bom 1.2.4

* closeable clients

* merge with master, format and clean

* merge with master, format and clean

* test

* fix tests

* fix tests

* fix not working from stream

* work with older bom as well

* format

* fix verify

* fix ingest

* fix comments

* merge

* merge

* Fix ingestion status

* Fix e2e

* Fix ResourceManagerTest bug

* fix unused ependency

* revert

* format

* comments

* format

Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
Co-authored-by: AsafMah <asafmahlev@microsoft.com>
2022-11-03 18:18:18 +02:00
Tanmaya Panda c3bc04358d
Switch to jackson library from org.json (#272)
* switch to jackson for json

* added formatter

* fixed failing test cases

* fixed testcases

* ran formatter

* added jackson-core to pom

* fixed json string

* fixed string conversion

* bumped release version

* bumped up release version

* addressed Ram's review comments

* formatter changes

* refactored object mapper

* addressed Ram's review comments

* formatter changes

* changes done as per Ohad's comments

* added exception testcase for ResultSetTest

* added bigdecimal for precision in decimal values

* added comment for bigdecimal deserilaization

* made options and parameters mandatory in tojson

* fixed test case

* accept cla

* added formatter

* commit for cla

Co-authored-by: AsafMah <asafmahlev@microsoft.com>
2022-10-27 12:56:38 +05:30
Yihezkel Schoenbrun cd8ff13b8f
Upgrade to v3.2.0 for release (#273) 2022-10-09 14:47:24 +03:00
ohad bitton a66e8bef26
Verify endpoints (#263)
* start

* matcher

* clean

* matcher

* dragt

* not work

* Tests and all works well

* Tests and all works well

* clean all dirt

* fix format

* fix formatClientImpl

* databind conflict

* Formatting

* fix NPE
comments

* comment

* revert e2e

* fix NPEs !!

* format

Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
Co-authored-by: AsafMah <asafmahlev@microsoft.com>
2022-08-11 15:42:33 +03:00
ohad bitton 1bfd98ae4c
3.1.3 2022-07-11 15:47:29 +03:00
ohad bitton 7e62bf7346
Serializeable crp (#250)
* serializeable crp

* Update pom.xml

Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
2022-06-20 15:46:23 +03:00
AsafMah cc67280746
Bump to 3.1.1 2022-05-29 13:23:10 +03:00
alonadam 2847786036
Add retry mechanism for potentiality throttled operations. (#237) 2022-04-06 17:03:18 +03:00
AsafMah f23b0780ca
Add formatter plugin (#231)
* Added formatter plugin, right now only starting

* Put config on main file

* Updated style to match ours better.

* Added declaration.

* edit build.yml

* Update style and apply formatting

* Update style and apply formatting

* Tweaked settings again

* Replace with session because that might be the correct path.

* Try formatting

* line endings

* renormalize new lines

* csluuid

* new lines

* new lines

* Run again with clean

* fixed build.yml

* Changed style to be better

* Added some docs
2022-03-29 15:40:49 +03:00
AsafMah 97fa3a719a
bump main version 2022-03-20 08:29:20 +02:00
Yihezkel Schoenbrun e2475a4cd2
Remove Quickstart dependency on parent pom (#212) 2022-01-17 16:10:45 +02:00
AsafMah e85db5514b
Coverage test (#206)
* Coverage test

* attempt 2

* Fixed pom

* Different combination

* Try without e2e

* Try without e2e

* Fixed paths

* Fixed paths

* Added thread id to avoid collisions

* Add random component to table name to avoid collisions

* Make sure number is not negative

Co-authored-by: Yihezkel Schoenbrun <yihezkel@schoenbrun.net>
2022-01-11 16:58:12 +02:00
Yihezkel Schoenbrun c2263cb915
Offer typed parameterized query helpers (#204)
* Offer typed parameterized query helpers

* Offer typed parameterized query helpers

* Improve TimeToString and add E2E test

* Fix PATTERN name

* Update Time datatype to be called Timespan
Implement better parity parsing of datetime from String

* Remove wildcard imports and add regex explanation

* Change single line if/else to ternary
2022-01-06 16:21:06 +02:00
AsafMah 873e0198d1
Upgrade dependencies + silence warnings (#203)
* Upgrade dependencies + silence warnings

* Upgraded tests

Co-authored-by: Yihezkel Schoenbrun <yihezkel@schoenbrun.net>
2021-12-27 14:24:19 +02:00
ohad bitton a779473d90
Reactivate tests and fix non passed tests (#191)
* E2e

* E2e

* fix tests

* fix tests

* fix tests

* disable prompt

* disable prompt

* e2e

* Fixed test

* Removed not needed dependency

* Quotes

* Revert "Removed not needed dependency"

This reverts commit a7de79e8aa.

* Leave only api

* Fixed test

* Added doc

* Fixed NRE

* Fixed implicit dependency

* Clean up some unnecessary changes

* Ensure DataFormat always exists (defaults to CSV)

* CloudInfo won't have the same values as the default for all connection strings

Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
Co-authored-by: Yihezkel Schoenbrun <yihezkel@schoenbrun.net>
Co-authored-by: Asaf Mahlev <asafmahlev@microsoft.com>
Co-authored-by: Yihezkel Schoenbrun <yischoen@microsoft.com>
2021-12-23 15:31:52 +02:00
Yihezkel Schoenbrun 438ec1397f
Quickstart Application (#195)
* Initial commit.
The intent is to review this in its current feature-complete state, so I can also commit the equivalent changes in the Python SDK.
Then, in the next PR (or before merging this PR), I will make some additional improvements as discussed, including break main into individual methods and refactor this "query-ingest-query" approach into an additional "query-only" mode.

* Remove comment

* Optimize if/else

* Minor verbiage changes

* Minor verbiage changes

* Minor verbiage changes

* Update README.md

Co-authored-by: Yochai Gilad <yogilad@microsoft.com>

* - Break main up into methods
- Consider new parameters
- Few code review changes, like consistent periods at end of sentences and filename consistency with Python

* Only alter batching policy if !useExistingTable

* - Pass filesize of 0 for autodetection
- Do not create a File object to get its path; just pass along the provided path
- Move alterBatchingPolicy to within createNewTable, and wrap it in if(false) so it won't run
- Add comment explaining that we generally wouldn't print the output of a control command

* - Improve README text
- Change .alter command to .alter-merge command

* - Change filename kusto-sample-config.json to kusto_sample_config.json to be consistent with Python

* - Fix reference to Python
- Aad a comment for AppCertificate auth

Co-authored-by: Yochai Gilad <yogilad@microsoft.com>
2021-12-05 10:39:22 +02:00
AsafMah afb1ad8142
Updated surefire version to make tests run (#197)
Breaking Changes:

Reverted mandatory DataFormat
Features:

Added github actions for running builds
Fixes:

Fixed pipeline to run and test
Fixed failing tests and other minor fixes
2021-12-05 09:50:49 +02:00
Yihezkel Schoenbrun c37107754d
Support AAD Managed Identity authentication (#194)
* Support AAD Managed Identity authentication

* Update data/src/main/java/com/microsoft/azure/kusto/data/auth/ManagedIdentityTokenProvider.java

Co-authored-by: AsafMah <asafmahlev@microsoft.com>

* Fix scope

* Fix space

* Downgrade azure-identity package to avoid showstopper bug causing ManagedIdentity auth to fail.

Note that there still remains 1 change to be made in this PR - to set the scope based on the Kusto Service Resource ID from CloudInfo. In support of this, I have a 22-file change to broadly improve how the TokenProviders consume from CloudInfo, but am hesitating to push that before understanding the initial CloudInfo design decisions.

At a high level, I would like to change the throws list when creating a client. It currently throws URISyntaxException, because it only uses CloudInfo when a token is requested. However, I don't see why we don't make use of CloudInfo when creating the client, in which case we should return a DataClientException/DataServiceException. This is a breaking change and a non-trivial paradigm shift, so it's worth discussing first.

I will begin discussing this with Asaf tomorrow.

* Resolve dependency conflicts

* Reorganize CloudInfo code

* Fix compilatino error

* Remove superfluous method (determineAadAuthorityUrl)

* Remove duplicate line

* Fix cloudinfo initialization

* Fix E2E tests (have been broken for a while)

* Switch order of clientUrl to be first

Co-authored-by: AsafMah <asafmahlev@microsoft.com>
2021-11-25 08:31:52 +02:00
ohad bitton 7309936724
Fix closeable order (#190)
Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
2021-10-24 15:26:09 +03:00
ohad bitton 0a2e3c63d1
v3.0.0 (#187) 2021-10-17 11:43:01 +03:00
Yihezkel Schoenbrun cde2361654
Implement MSAL Subject Name Issuer authentication (#165)
* Implement MSAL Subject Name Issuer authentication

* Update ConnectionStringBuilder.java

* Update ConnectionStringBuilder.java

* Fix build failure after OnCloudInit() was added to abstract parent

* Ensure we send the public certificate when using SNI

Co-authored-by: ohad bitton <32278684+ohadbitt@users.noreply.github.com>
2021-08-23 15:37:56 +03:00
ohad bitton d6075a252e
Update pom.xml 2021-07-04 16:17:55 +03:00
AsafMah d5de3419b6
Made url join more robust (#179) 2021-07-01 18:03:39 +03:00
AsafMah e2bbcd11d2
Bump to 2.8.0 2021-06-30 18:33:03 +03:00
KustoIbizaExtension Build f70cf8b8c0 2.7.1 2021-06-29 15:49:20 +03:00
ohad bitton 03aabae864
Exceptions handling (#174)
* exception handling

* nicer errors

* permanency

* is permanent exceptions

* isPermanent as triState

* enum triState

* enum triState

* better errors

* nit

* naming - KustoServiceQueryError

Co-authored-by: KustoIbizaExtension Build <kustodev@microsoft.com>
2021-05-25 15:54:20 +03:00
Yihezkel Schoenbrun 2bb0d1b8b8
Upgrade version from 2.6.0 to 2.7.0 (#172) 2021-04-11 21:30:29 +03:00
ohad bitton 133b5e254f
Device authentication (#169)
* device authentication

* revert device E2E

* comments

* make base class protected

* make base class protected
2021-03-22 18:31:14 +02:00
Yihezkel Schoenbrun 97ae1807cb
Upgrade version to 2.5.1 (#168) 2021-03-11 12:08:33 +02:00
Yihezkel Schoenbrun 9a5976860c
Add new API to query returning a json result (#166)
* Add new API to query so that the result is a json. When the caller doesn't need the Java object, this saves time converting to a Java object in the SDK and from the caller converting from the Java object.

* - Split input variables validation
- trim() command

* Rename from executeForJsonResult to executeToJsonResult

* Rename from executeForJsonResult to executeToJsonResult

* Streaming endpoint is always v1
2021-03-09 12:39:38 +02:00
Yihezkel Schoenbrun ce1a716062
Optimize and upgrade dependency versions (#167)
* - Optimize and upgrade dependency versions
- Remove dependency duplicates/conflicts
- Resolve mvn warnings

* - Use range to ensure specific minor version of jackson dependencies
- Upgrade flatten-maven-plugin
2021-03-08 17:31:42 +02:00
Yihezkel Schoenbrun f6c5b36cc3
Upgrade version from 2.4.2 to to 2.5.0 (#164) 2021-02-14 10:56:46 +02:00
Yihezkel Schoenbrun f4da15d312
Rearchitect the AAD authentication code to be object oriented (#160)
* Rearchitect the AAD authentication code to be object oriented and follow best-practices (Java and otherwise)

* Rearchitect the AAD authentication code to be object oriented and follow best-practices (Java and otherwise)

* Code review comments:
- Rename to CallbackTokenProvider
- Remove 2 unnecessarily-passed authorityIds

* Add another layer of abstraction (MsalTokenProvider)

* Add another layer of abstraction (MsalTokenProvider)

* Add Override annotation per code review comment
2021-01-07 13:15:08 +02:00
Yihezkel Schoenbrun 2e05191f2a
Replace ADAL authentication library with MSAL (#155)
* Convert from ADAL to MSAL (include a few questions to be resolved during code review)

* Resolve some TODOs

* Some minor changes and some changes from code review

* Incorporate most review comments

* Add '/' to authority to resolve issue.

* Per Yochai's request, first try to access the token silently, and if that fails authenticate from scratch

* Make the method determineAadAuthorityUrl() less confusing

* Fix error

* Fix test
2020-12-20 19:42:18 +02:00
Ohad Bitton 8e6e6ffe95 v2.4.2 2020-12-13 13:39:06 +02:00
ohad bitton 3e30e743e1
Better exception message in post request (#156)
* better exception message in post request

* v2.4.1

Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
2020-11-19 14:04:26 +02:00
Ohad Bitton f48266e41d v2.4.0 2020-11-18 15:37:50 +02:00
ohad bitton a1417109a2
Expose authority id for all authenticaiton methods (#153)
* Expose authority ID in all authentication methods

* version 2.3.2

* version 2.3.2
2020-09-30 17:56:36 +03:00
Ohad Bitton 2fdff9e618 version 2.3.1 2020-09-08 13:12:05 +03:00
ohad bitton 59aa42e2c5
Accept json response + fix maven build warnings (#150)
* accept application/json + use same jackson version as spark connector

* version 2.3.0

* restrain nimbus version (resolve nimbus class not found)

* Fix maven warnings

* Fix maven warnings

* Update data/pom.xml

Co-authored-by: vladikbr <31644896+vladikbr@users.noreply.github.com>

* clean

Co-authored-by: Ohad Bitton <ohbitton@microsoft.com>
Co-authored-by: vladikbr <31644896+vladikbr@users.noreply.github.com>
2020-09-07 10:00:03 +03:00
Ohad Bitton 4a64402e70 v2.2.0 2020-08-27 16:13:56 +03:00