зеркало из
1
0
Форкнуть 0
Граф коммитов

470 Коммитов

Автор SHA1 Сообщение Дата
Yihezkel Schoenbrun 4c672929bd
Fix mapping_required to _mapping_required (#369) 2022-01-16 17:28:40 +02:00
AsafMah 69a2405068
Bump to 3.0.0 (#368) 2022-01-16 13:16:53 +02:00
AsafMah aa56d1b1c8
E2E - Only clear cache once (#367)
* Only clear cache once.

* Added comment

Co-authored-by: Yihezkel Schoenbrun <yihezkel@schoenbrun.net>
2022-01-16 12:30:23 +02:00
AsafMah e3f852ae70
IngestionProperties Improvements (#363)
* - Renamed IngestionMappingType to IngestionMappingKind to align with other SDKs
- Added advanced checks for column mappings, see https://github.com/Azure/azure-kusto-java/pull/205
- Added missing formats and mappings
- Renamed "ingestion_mapping" parameter to "column_mappings" for clarity and alignment

* Make mapping_required private

* black

* PR comments

* PR comment - caller provides text

Co-authored-by: Yihezkel Schoenbrun <yihezkel@schoenbrun.net>
2022-01-16 12:26:38 +02:00
AsafMah 9c8816beec
Proxy support (#360)
* Proxy support - initial implementation

* Remove reference

* PR Fixes + imports

* Remodeled code + added tests

* Get token impl always returns optional[dict]

* Changed from ctor to method

* always get uts

* PR fixes

* set_proxy

* Fixed member

* black

* fixed tests

* fixed tests

* comment

* add None check

* typo
2022-01-16 12:23:02 +02:00
AsafMah 05ce08d9e8
Fixed uuid and types (#364) 2022-01-11 08:54:06 +02:00
AsafMah 406179de14
Make sure uuids are always generated, and are always the correct type (#358)
* Make sure uuids are always generated, and are always the correct type

* Added uuid tests

* Default value for blob
2022-01-05 14:08:34 +02:00
AsafMah 66f6d66a2a
Update minimum python to 3.7 (#361)
* Update python to 3.7
2022-01-05 14:02:17 +02:00
AsafMah da5da5fd5c
Cloud Info improvements (#357)
* -Don't fetch cloudinfo if not needed
-Pass correct scopes to az cli and msi

* Naming

Co-authored-by: Yihezkel Schoenbrun <yihezkel@schoenbrun.net>
2021-12-27 13:29:08 +02:00
Liam Kirton 57bf1c0954
Handle invalid datetimes in dataframe_from_result_table (#356)
* Handle invalid datetimes in dataframe_from_result_table by passing errors='coerce'

* Added tests for dataframe_from_result_table, specifically datetime error coercion

* Address code review comments

* Fix for differences in Pandas behaviour between Python3.6 and Python3.7+

Co-authored-by: AsafMah <asafmahlev@microsoft.com>
2021-12-27 09:31:24 +02:00
Yihezkel Schoenbrun 3e25fe8511
Enhance DataFormat (#354)
* Enhance DataFormat

Note: I didn't realize (until the merge conflicts now) that Asaf recently made some changes to is_mapping_required and is_binary/is_compressible. I don't think his PR affects any of my changes here, except for a decision regarding whether we want is_binary or is_compressible. I'm open to either, but prefer the former if we have any reason to care whether a format is binary other than to determine if it's compressible, and otherwise prefer the latter.

I will discuss this with relevant people.

* Satisfy black

* Changed order of import statements and renamed value_, per Asaf's comments

* Change value_ to kusto_value everywhere

* Fix merge: Newest merge with master (managed streaming) included in the ingest package imports of data_format from ingest, when this PR moves data_format to data

Now no need for the export of data_format in ingest's __init__. Though this is a breaking change, we're intending to do a major version bump soon anyway (see the recently merged managed streaming PR, referenced above).
2021-12-23 11:12:30 +02:00
Yihezkel Schoenbrun c2fef08e98
Add features and fix bugs in Quickstart for parity with Java (#353)
* Add features and fix bugs in Quickstart for parity with Java

* Black
2021-12-20 15:05:47 +02:00
Ariel Yehezkely e6754caeb4
KustoClient - enable set Http proxy
KustoClient - enable set Http proxy
2021-12-19 12:02:00 +02:00
AsafMah 97d90ba8b6
Relax azure identity version (#352) 2021-12-19 11:09:27 +02:00
AsafMah ea79960db0
Add managed streaming ingest (#344)
* Added ManagedStreamingIngestClient
* Added base class and common functionality to queued and streaming clients
* Added support for OneApiError for easier error handling
2021-12-19 10:47:22 +02:00
AsafMah a571aa790e
update README.rst (#310)
Added docs for async clients
2021-12-19 09:21:00 +02:00
Ariel Yehezkely 1b316cef1d
Fix pandas types (#349)
* fix pandas types

* Update azure-kusto-data/azure/kusto/data/helpers.py

Co-authored-by: janlugt <janlugt@gmail.com>

* Update helpers.py

* fix tests

* Update azure-kusto-data/azure/kusto/data/helpers.py

Co-authored-by: AsafMah <asafmahlev@microsoft.com>

Co-authored-by: janlugt <janlugt@gmail.com>
Co-authored-by: AsafMah <asafmahlev@microsoft.com>
2021-12-09 10:45:22 +02:00
Yihezkel Schoenbrun b83e813ee2
Add to main README link to .NET's best practices guide (#345)
* Add to main README link to .NET's best practices guide

* Remove localization from link
2021-11-09 14:29:31 +02:00
AsafMah 35e23cef5d
Add streaming query (#315)
* Added Streaming Query API
2021-11-08 12:04:58 +02:00
AsafMah e975eec401
typo 2021-11-08 11:51:29 +02:00
AsafMah 8f54ed841c
Support not passing blobs size (#343)
* Support not passing blobs size

* Added ingest blob e2e test

* -Add test blob secret
-Make e2e verbose (to see why tests are skipped)

* Also put None in Filedescriptor, more uniform types
2021-11-08 11:29:23 +02:00
Yochai Gilad d25e0b869c
Quick Start Sample App (#339)
* Checkpoint

* Auth works

* cert based auth

* split and reorder authentication
Add references to public docs

* Checkpoint - need to attempt once with OneClick

* Ready for integration with OneClick

* Set the table schema

* PR comments

* lint

* A self contained sample for download (independent of One Click)

* nit

* print sample data

* cosmetics, typing, bug fix

* read config from json

* PR comments

* checkpoint - loop over files, ingest from blob not yet supported

* Checkpoint - ingest form blob

* Rename json file

* Readme changes

* link fix

* nit changes

* checkpoint

* readme

* integrate with one click

* messages

* wait for user

* button name change

* post review

* changes after talking with Tal

* markdown highlighting

* integrate with markdown parser for function injection

* fix markdown titles

* download link place holder

* Rename README.MD to README.md
2021-11-01 11:49:19 +02:00
Daniel Dubovski ff385f8361
don't import all (#342)
* don't import all

remove import *

* Importing everything that's needed

Co-authored-by: Asaf Mahlev <asafmahlev@microsoft.com>
2021-10-24 07:58:58 +03:00
AsafMah b25b95c562
bump data to 2.3.2 2021-10-07 12:04:51 +03:00
AsafMah c1218f4ac1
bump ingest to 2.3.2 2021-10-07 12:04:22 +03:00
AsafMah 5bf73732e3
Removed NoReturn (#341)
* Removed NoReturn
2021-08-12 11:24:01 +03:00
AsafMah 052e0e1dc5
Bump ingest to 2.3.1 2021-08-01 12:30:37 +03:00
AsafMah 0bf561917d
Bump data to 2.3.1 2021-08-01 12:30:32 +03:00
AsafMah 56ff136748
Seperate Async and sync inside TokenProivders (#335)
* Restructured the code to prevent async objects from being created when not needed.

* Wider versions of dependencies
2021-08-01 12:29:42 +03:00
AsafMah 77efe0608b
Bumped data 2021-07-18 17:28:30 +03:00
AsafMah 4a90a5eb14
Bumped ingest 2021-07-18 17:28:13 +03:00
AsafMah 6c81acdc23
Added async CallbackTokenProvider and fixed locks issue
* Added Async CallbackTokenProvider that can be used via with_async_token_provider. 
* Moved locks to be inside TokenProvider class, this should ensure that the lock is created in the same event loop as the provider
2021-07-18 16:54:25 +03:00
AsafMah 4a6abde39d
Bumped data version 2021-07-15 10:53:56 +03:00
AsafMah ef192e844e
Bumped ingest version 2021-07-15 10:53:43 +03:00
AsafMah e22f246bac
Solved Async requests race condition 2021-07-15 10:51:18 +03:00
AsafMah 341099f3ff
Bumped to 220 (#328) 2021-07-01 09:44:44 +03:00
AsafMah e557bc7c9c
Add dynamic metadata fetching (#325)
* Kusto now queries the provided cluster for metadata. This fixes incompatibility issues with other clouds, or services like Synapse. The results are cached and don't require any changes to the user's code or behavior.
2021-06-30 10:42:20 +03:00
AsafMah 1384374cd0
Bump version 213 (#327)
* Fixed status addressing between async and sync

* bump-version-213
2021-06-10 09:52:51 +03:00
AsafMah b07c410fe7
Fixed status addressing between async and sync (#326) 2021-06-09 16:02:08 +03:00
AsafMah e030193d7a
Fixed wrong kwargs and bumped version for release (#324) 2021-06-01 13:06:40 +03:00
Christian Coello d2589ab94a
Fix ingestion endpoint format (#313)
Co-authored-by: Yihezkel Schoenbrun <yihezkel@schoenbrun.net>
2021-05-25 21:37:01 +03:00
Artun Duman 65d67d850b
Return awaitable object from aio client __aexit__ (#321)
Co-authored-by: Artun Duman <artun.duman@gmail.com>
Co-authored-by: AsafMah <asafmahlev@microsoft.com>
2021-05-23 16:14:23 +03:00
Yochai Gilad 6bb6afcac6
Simplify Async Class - no need for async token from cache (#320)
* Simplify Async Class - no need for async token from cache

* Fix aio tests
2021-05-23 10:56:34 +03:00
Yochai Gilad 80e8197b82
Use Azure.Identity AzCliTokenProvider to get a token from AzCli (#318)
* Use Azure.Identity AzCliTokenProvider to get a token from AzCli

* Slight error update

* lint

* lint + added lint batch script

* Exception message
2021-05-19 12:27:22 +03:00
Daniel Dubovski 9ac12bd61d
adding go sdk to other languages section 2021-04-13 17:17:33 +03:00
Asaf Mahlev 976ed2520d Merge remote-tracking branch 'origin/master' 2021-04-04 12:45:48 +03:00
Asaf Mahlev 54724e464c Bump to 2.1.1 2021-04-04 12:45:35 +03:00
AsafMah bc0e037460
Fixed import on non-async machines (#311)
* Fixed import on non-async machines
2021-04-04 11:43:04 +03:00
Yihezkel Schoenbrun c9755ef230
Bump version to 2.1.0 (last PR switched to 2.0.1, but there are new features) (#309) 2021-03-17 13:39:20 +02:00
Yihezkel Schoenbrun 888478bbe0
Bump version to 2.0.1 (#308)
Co-authored-by: Ariel Yehezkely <aryehezk@microsoft.com>
2021-03-17 13:11:55 +02:00