dotnet
/
spark
зеркало из https://github.com/dotnet/spark.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
372 коммитов 2 Ветки 21 Тег 56 MiB
Граф коммитов

372 Коммитов

Автор SHA1 Сообщение Дата
Andrew Fogarty b63c08b87a
Upgrade to .NET 6 (#1112) 2023-02-17 16:56:32 -05:00
Andrew Fogarty d7725033c9
Support for Spark 3.2.2 and 3.2.3 (#1127) 2023-01-24 16:41:41 -08:00
Drago Rosson 51531603e2
Allow 3.2.2 (#1122) 
Co-authored-by: Andrew Fogarty <andrew.f.fogarty@gmail.com>
 2023-01-24 11:02:52 -05:00
Eric StJohn 4c0888c275
Wait before running apt command (#1132) 2023-01-23 15:37:28 -08:00
Drago Rosson 2c98109939
Update maven download link (#1121) 2023-01-05 10:42:02 -08:00
Matt Galbraith 3244c18f9e
Fix build pipeline: Rename service connection from dotnet -> public and update public pool name (#1115) 2022-11-01 14:22:19 -07:00
Nina Reynolds c41fb0ca62
Update: newtonsoft.json package reference (#1079) 
Co-authored-by: Nina Reynolds <ninareynolds@microsoft.com>
 2022-10-24 16:00:37 -07:00
Niharika Dutta 45d0058e31
change windows pool (#1065) 2022-05-24 12:43:24 -07:00
Michael Rys 393418b677
Added a documentation regarding support (#1040) 2022-05-19 15:31:51 -07:00
Niharika Dutta 30a4b02e2f
Prep v2.1.1 release (#1050) 2022-05-19 15:25:05 -07:00
Serena Ruan c96efde569
Add assembly check when pipeline trying to get stages (#1049) 2022-05-05 23:42:18 -07:00
Brooke Philpott c2ee198598
JvmBridge semaphore fix (#1061) 2022-05-02 09:55:17 -07:00
kalamut 0f5159069b
Capture dotnet application error stack trace (#1047) 2022-04-21 15:57:54 -07:00
Serena Ruan b2fa3508d7
feat: add base classes for ML and refine code base (#1031) 2022-04-14 10:28:51 -07:00
Jon Fortescue c89bd283f5
Switch queue to demands to fix error (#1030) 2022-02-14 18:22:46 -08:00
Jon Fortescue fac8defe91
Switch to 1ES hosted pools on main (#1021) 2022-02-02 20:58:32 -08:00
Steve Suh 04092d328b
Migrate to 1ES hosted pools (#1020) 2022-02-01 13:10:15 -08:00
Niharika Dutta 8ded5a0301
Prep v2.1.0 release (#1018) 2022-02-01 10:24:44 -08:00
Prashanth Govindarajan 02c71cdfdb
Update MDA to 0.18.0 (#977) 2022-01-31 21:16:43 -08:00
Niharika Dutta e0f4324cb4
Add 3.2.0 Function APIs (#1013) 2022-01-31 14:56:19 -08:00
Niharika Dutta 7bc016f5ed
Add microsoft-spark 3.2 jar (#1010) 2022-01-27 11:13:13 -08:00
Steve Suh 6f82f15c22
Fix build pipeline due to Ubuntu 1604 Image deprecation and bintray no longer available as spark-package repository (#1007) 2022-01-21 12:12:35 -08:00
Steve Suh b0a3068bd8
Prep 2.0.0 release (#950) 2021-06-13 16:15:38 -07:00
Terry Kim 5f5215e6a4
Support for Spark 2.4.8 and Spark 3.1.2 (#953) 2021-06-13 16:14:06 -07:00
Niharika Dutta 7682aeaac1
Expose Avro related APIs (#805) 2021-06-12 19:18:33 -07:00
Steve Suh 328ca1bc2a
Add public APIs to access JvmBridge, JvmObjectReference, IJvmObjectReferenceProvider (#951) 2021-06-12 10:21:12 -07:00
Steve Suh a18bb5f638
Extensions.DotNet.Interactive - Add ENV to control disposal of tmp dir (#952) 2021-06-11 23:08:43 -07:00
Alvaro Muir 4ede264c2b
Expose Spark version info (#919) 2021-06-03 22:23:35 -07:00
Steve Suh 1f1f736894
StreamingQueryManagerTests test fix (#907) 2021-04-19 18:44:07 -07:00
Steve Suh 5e6a142879
Drop Spark 2.3 Support (#895) 2021-04-19 13:02:58 -07:00
Sunil Dixit 2632d8de12
Expose FileSystem.Exists API (#909) 2021-04-19 11:58:10 -07:00
Niharika Dutta d5b4f42ba8
Update README for v1.1.1 for JARs (#911) 2021-04-17 21:54:34 -07:00
Steve Suh 9ed5191e6d
Spark 3.1.0 APIs - SparkContext (#889) 2021-04-09 12:50:35 -07:00
Steve Suh 9479ba059c
Disable forward/backward tests in preparation for v2.0.0 (#896) 2021-04-09 09:20:31 -07:00
Steve Suh 767997cfc3
Spark 3.1.0 APIs - Catalog (#893) 2021-04-09 08:13:23 -07:00
Terry Kim c79cf8fad4
Revert "Revert "Add 'Z' to the string format in Timestamp.ToString() to indicate UTC time. (#871)" (#873)" (#897) 
This reverts commit 309f4107d5.
 2021-04-08 22:18:20 -07:00
Steve Suh 8bd763ce53
Spark 3.1.0 APIs - Functions (#890) 2021-04-08 20:06:29 -07:00
Steve Suh 7c67ec9c7a
Spark 3.1.0 APIs - DataFrame (#888) 2021-04-08 14:44:37 -07:00
Terry Kim ea83dac5a6
Revert "Temporarily disable support for Spark 3.1.1 to release .NET for Apache Spark 1.1 (#870)" (#891) 
This reverts commit c4b86737e0.
 2021-04-07 21:06:07 -07:00
Steve Suh affd7f2493
Spark 3.1.0 APIs - Column (#887) 2021-04-07 17:56:19 -07:00
Steve Suh 469f2607f4
Spark 3.1.0 APIs - DataStreamReader and DataStreamWriter (#886) 2021-04-06 22:24:47 -07:00
Terry Kim 3fb684c50d
Prep 1.1.1 release (#874) 2021-03-29 22:26:45 -07:00
Terry Kim 309f4107d5
Revert "Add 'Z' to the string format in Timestamp.ToString() to indicate UTC time. (#871)" (#873) 
This reverts commit 53717b43f5.
 2021-03-29 21:09:03 -07:00
Niharika Dutta 32789e0f84
Prep 1.1 release (#757) 2021-03-27 08:46:29 -07:00
Terry Kim c4b86737e0
Temporarily disable support for Spark 3.1.1 to release .NET for Apache Spark 1.1 (#870) 2021-03-27 00:33:45 -07:00
Steve Suh 53717b43f5
Add 'Z' to the string format in Timestamp.ToString() to indicate UTC time. (#871) 2021-03-26 23:53:16 -07:00
Steve Suh 33299cf2f2
Bug Fix for Spark 3.x - Avoid converting converted Row values (#868) 2021-03-26 20:48:30 -07:00
Steve Suh b9283ebdcb
Add DOTNET_WORKER_<ver>_DIR environment variable (#861) 2021-03-24 20:00:59 -07:00
Steve Suh b6348d64b1
Add spark.dotnet.ignoreSparkPatchVersionCheck conf to ignore Spark's patch version in DotnetRunner (#862) 2021-03-23 16:00:16 -07:00
Terry Kim d5e95b47b0
Update README.md to point to the build status from main branch. 2021-03-18 10:20:00 -07:00