Граф коммитов

221 Коммитов

Автор SHA1 Сообщение Дата
Jason Wang 0610ee0453
revert DataArray to string[][] in StatementExecutionResultChunk (#247) 2024-11-18 18:52:53 -08:00
mellis-ao c70944fd6d
Add editorconfig file with some initial entries (#242)
* Added config

* C# indent style to space not tab
2024-11-18 10:54:01 -08:00
Jason Wang 9774b77338
fix: use CPM to update vulnerable dependencies (#245) 2024-11-17 23:11:23 -08:00
mellis-ao 74beafdcd2
.Net 9 target & package updates (#240)
* .Net 9 target & package updates

---------

Co-authored-by: Jason Wang <jasowang@microsoft.com>
Co-authored-by: Jason Wang <jasonwang_83@hotmail.com>
2024-11-17 21:22:43 -08:00
Jason Wang e07cfcb8b2
Install dotnet 9 for PR build (#244) 2024-11-17 21:09:16 -08:00
Jason Wang 5144a806ea
fix: adding support for deserialization for StatementExecutionResultChunk.DataArray (#238)
* fix: adding support for deserialization for StatementExecutionResultChunk.DataArray

* fix: equality check

* fix code format

* adding deserialization method
2024-11-17 20:31:27 -08:00
mellis-ao 0634c177fd
Added protected parameterless constructor to DatabricksClient (#233) 2024-11-05 23:28:19 -08:00
Jason Wang 591fd3fb2c
fix: PipelinesApiClient.ListPageable() throws when no pipelines are returned (#237) 2024-11-05 23:20:24 -08:00
Jason Wang e1a7768a34
fix: MLFlow API GetRun type error (#236) 2024-11-05 22:41:27 -08:00
Henri Tuomola 52399bd292
Include new job parameters in job run response model (#234)
* Include new job parameters in job run response model

Implement returning new job-level parameters in runs' API https://docs.databricks.com/api/workspace/jobs/getrun#job_parameters

* Fixing code format

Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>

* Fixing code format

Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>

---------

Signed-off-by: Jason Wang <jasowang@microsoft.com>
Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>
Co-authored-by: Jason Wang <jasowang@microsoft.com>
Co-authored-by: Jason Wang <jasonwang_83@hotmail.com>
2024-11-05 21:26:29 -08:00
Chris Elgin 030c4816c4
Add USER_CANCELED (#229)
* Add USER_CANCELED

* Fixing code format

Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>

---------

Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>
Co-authored-by: Jason Wang <jasonwang_83@hotmail.com>
2024-11-05 20:08:57 -08:00
mellis-ao 5a55bf6540
Update and remove unused packages (#230)
* Update and remove unused packages

* Project file whitespace fixes
2024-11-05 19:58:39 -08:00
Jason Wang 4edb2b9626
Add release notes for 2.6.0 (#225) 2024-09-24 10:47:58 -07:00
ArminVe d37cc9eb41
Update JobsApiClient.cs (#224)
Remove "await Console.Out.WriteLineAsync("Request: " + url);"

It seems to be left from some early testing. Or is there an actual reason to have it in only one RunsList function?

Signed-off-by: ArminVe <166499401+ArminVe@users.noreply.github.com>
2024-09-24 10:37:39 -07:00
JeffSBailey 32c647b054
Bailey/add data security mode support (#218)
* Add support for dat DataSecurityMode in the ClusterAttributes

* Remove unintentional using statement
2024-09-24 09:35:00 -07:00
Jason Wang f7ffd8a2b4
Remove unused dependency (#223) 2024-09-22 18:16:35 -07:00
Jason Wang 4cb830c0b1
fix documentation (#222) 2024-09-22 17:35:30 -07:00
Jason Wang 653a7c10a9
Add new trigger type (#221) 2024-09-22 17:15:11 -07:00
Niels Pilgaard Grøndahl 9ffb5fbd97
Add GenerateDocumentationFile to make summaries show up in IDEs (#220)
* Add GenerateDocumentationFile to make summaries show up in IDEs

Without `GenerateDocumentationFile` set to true, your great code summaries never make it to the developer using the nuget.

Signed-off-by: Niels Pilgaard Grøndahl <niels.pilgaard@hotmail.com>

* Update csharp/Microsoft.Azure.Databricks.Client/Microsoft.Azure.Databricks.Client.csproj

Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>

---------

Signed-off-by: Niels Pilgaard Grøndahl <niels.pilgaard@hotmail.com>
Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>
Co-authored-by: Jason Wang <jasonwang_83@hotmail.com>
2024-09-22 17:00:28 -07:00
Jason Wang 9c59c4fb73
fix: Jobs.RunsList expandTasks argument does not work (#216) 2024-09-13 11:40:00 -07:00
Jason Wang f84ea5a2ed
Remove nullable reference type for now (#214)
Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>
2024-09-13 00:01:18 -07:00
Mike Morse 70173ac54d
Added Models for Run Status (#210)
* Added run status models

* Added run status models

* Updated unit test per PR instructions. (#3)

Co-authored-by: Mike Morse <mike.morse@authenticasolutions.com>

---------

Co-authored-by: Mike Morse <mike.morse@authenticasolutions.com>
2024-09-12 23:53:39 -07:00
Jason Wang 09b880600b
Target .NET 8 (#213) 2024-09-12 23:33:17 -07:00
Jason Wang e3a6335fc8
Add pageable support for RegisteredModels/List and ModelVersion/List (#212)
Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>
2024-09-12 23:16:34 -07:00
Hugh Signoriello 4017d4e0ce
Add Databricks ML flow api endpoints (#206)
* DevOps Pipeline

* New models

* update Unity Catalog Client

* Fix query parametor error which neglected the correct format with ? followed by &

* Fix run_workspace_id type to long (int64) from string

* Add sample program to Examples

* Add Machine Learning Experiment Api endpoint and test

* Add Machine Learning Experiment Api endpoint and test

* Updated build-databricks-client.yml working directory path

* Updated build-databricks-client.yml error

* Updated build-databricks-client.yml. Bump build version to avoid version conflicts

* Updated build-databricks-client.yml fix minor version

* Updated build-databricks-client.yml working directory path

* Updated build-databricks-client.yml error

* Updated build-databricks-client.yml. Bump build version to avoid version conflicts

* Updated build-databricks-client.yml fix minor version

* Add format whitespace and update ML endpointAdd Machine Learning Experiment Api endpoint and test

* Add sample programAdd format whitespace and update ML endpointAdd Machine Learning Experiment Api endpoint and test

* Add Machine Learning Experiment Api endpoint and test

* Add format whitespace and update ML endpointAdd Machine Learning Experiment Api endpoint and test

* Add sample programAdd format whitespace and update ML endpointAdd Machine Learning Experiment Api endpoint and test

* Remove ADO file

* Apply code review comments

* missing semicolon

* bug fix and cleanups

* apply code review comments

---------

Co-authored-by: Hugh Signoriello <hugh.signoriello@insightfactory.ai>
Co-authored-by: Jason Wang <jasonwang_83@hotmail.com>
2024-09-12 22:08:51 -07:00
Jason Wang b526c95b9b
fix: Wrong request URI name for getting columns data lineage (#209) 2024-09-05 00:20:46 -07:00
Jason Wang ed1208d7bd
fix: add missing trigger types (#208) 2024-09-05 00:03:05 -07:00
dependabot[bot] 8895dbac98
build(deps): bump System.Text.Json (#203)
Bumps System.Text.Json from 6.0.5 to 8.0.4.

---
updated-dependencies:
- dependency-name: System.Text.Json
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-10 13:23:52 -07:00
Jason Wang 2ef14e1d08
doc: add release notes for 2.5.0 (#199) 2024-06-21 15:37:20 -07:00
Jason Wang fea2dbefee
fix: Streaming response from HttpClient for better memory utilization (#198) 2024-06-21 02:03:20 -07:00
Jason Wang 8e9ff9fc27
fix: better handle token expiration when TokenCredential is used (#197) 2024-06-21 00:08:18 -07:00
Jason Wang 5be4182381
feat: list operations now support AsyncPageable if next_page_token is returned (#196)
* feat: jobs/list and jobs/runs/list now returns AsyncPageable

* More AsyncPageable support

* fixing style issue
2024-06-19 23:01:48 -07:00
Jason Wang d5c1b2039c
feat: support TokenCredential based authentication for managed identity and service principal (#195) 2024-06-18 18:41:01 -07:00
Henri Tuomola 98479ed98a
Make top-level client properties virtual to enable mocking (#193)
Change DatabricksClient sub-client properties to be virtual so that they can be mocked in testing scenarios. Also do the same for UnityCatalogClient because that one follows same pattern of individual clients.
2024-06-17 00:54:59 -07:00
Jason Wang 4b2fbb9955
update release notes for 2.4.0 (#190) 2024-04-14 20:57:04 -07:00
Jason Wang f739dcfbbe
fix build warning: Dereference of a possibly null reference. (#189) 2024-04-14 20:56:41 -07:00
InsightFactory-Mick 3c8dbe5b92
Added new Dashboard Object Type. (#180) 2024-04-14 18:10:05 -07:00
Samuel Chmiel 03581dea4f
Add foreign type catalog and table support and PostgreSQL datasource format (#181) 2024-04-14 18:09:05 -07:00
Jonathan 2933b6d089
add Source attribute to NotebookTask according to https://docs.databricks.com/api/workspace/jobs/get#settings-tasks-notebook_task-source (#184) 2024-04-14 17:41:45 -07:00
Bartlomiej Dyrala 34638d9848
Add support for job-level parameters (#188)
* added support for job-level parameters

* Replace testing idempotent tokens

* Remove trailing space

---------

Co-authored-by: Jason Wang <jasonwang_83@hotmail.com>
2024-04-14 17:41:33 -07:00
Countervayl cc1952ab38
Add support for abfss init script (#187)
Co-authored-by: Alexander Hamilton <alexander.hamilton@hymans.co.uk>
2024-04-14 17:33:11 -07:00
Adam Weigert c71bd4bb5d
Add Statement Execution API (#185)
* Add Statement Execution API

* Use standard datetime format string when converting SqlStatementParameter value

---------

Co-authored-by: Jason Wang <jasonwang_83@hotmail.com>
2024-04-14 15:45:30 -07:00
Jason Wang 6b68479514
add release notes (#179) 2024-03-08 13:23:39 -08:00
Jason Wang ee294a92fb
build: upgrade action versions (#178) 2024-03-08 11:29:38 -08:00
Szymon Karpęcki 7928b2e6be
Unity (#159)
* Added Pipelines endpoint

* Type fix

* Test fixes

* Added UnityCatalog Catalogs endpoint

* Final fixes

* Pipelines sample program fix

* Added UnityCatalog Connections endpoint

* Added ExternalLocations endpoint

* Added UnityCatalog Functions endpoint

* Added Unity Catalog Permisions endpoint

* Added UnityCatalog Metastore endpoint

* Removing unnecessary models

* Fixing tests

* Added UnityCatalog Schemas endpoint

* Added UnityCatalog StorageCredentials endpoint

* Added UnityCatalog SystemSchemas endpoint

* Added UnityCatalog TableConstraints Endpoint

* UnityCatalog added Tables endpoint

* Fix changes

* Added Volumes Unity Catalog endpoint

* Added SecurableWorkspaceBinding UnityCatalog endpoint

* Added UnityCatalog client

* Refactor

* Added sample requests

* Added lineages endpoint

* Added sample requests

* Uncommented sample program runs

* Adedd listing catalogs and fixed catalog type error for not provided catalog type in documentation

* Fixed table constraints

* Fixed view dependecies

* Extended model for lineage object

* bug fix: Dependencies should be public

* refactor

* fixing unit tests

* refactor

* linting

Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>

---------

Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>
Co-authored-by: Szymon Karpęcki <szymon.karpecki@dataedo.com>
Co-authored-by: Jason Wang <jasonwang_83@hotmail.com>
2024-03-08 11:19:54 -08:00
Jason Wang 7bdd9cdc89 lint: update action top level permission to readonly 2024-03-08 11:08:15 -08:00
Jason Wang 2dfe11d54c update action verions 2024-03-08 02:47:26 -08:00
Jason Wang 389d336548 adding enum members for ClusterSource
Signed-off-by: Jason Wang <jasonwang_83@hotmail.com>
2024-03-08 01:30:30 -08:00
Jason Wang 16cb61c6c7 build: update build pipeline; move release pipeline to internal ADO account 2024-03-07 23:36:45 -08:00
Jason Wang fedd24338c fix: Wrong page token parameter name in PipelinesApiClient 2024-03-07 23:07:21 -08:00