Граф коммитов

320 Коммитов

Автор SHA1 Сообщение Дата
Steve Suh dbad951d66
Support Spark 3.1.1 (#836) 2021-03-16 19:40:19 -07:00
Steve Suh 04b9a332f2
Add microsoft-spark-3-1 JAR for the Spark 3.1 support preparation (#834) 2021-03-08 23:26:38 -08:00
Steve Suh f5d71599b6
Support Spark 3.0.2 (#833) 2021-03-08 23:20:29 -08:00
Andrew Fogarty fe03c7431e
Support for Delta Lake 0.8.0 (#823) 2021-02-12 11:32:09 -08:00
dotnet bot f50ea5fb87
NuGet Feed Update (#822)
Co-authored-by: Matt Mitchell <mmitche@microsoft.com>
2021-02-09 21:33:01 -08:00
高阳阳 d608d8e6c5
Using (processId, threadId) as key to mantain threadpool executor instead of only threadId (#793) 2021-02-03 11:10:44 -08:00
Andrew Fogarty d3039e2f32
Support for Hyperspace 0.4.0 (#815) 2021-01-29 14:46:43 -08:00
Matt Mitchell b16b4f64e6
Remove unnecessary RestoreSources (#812) 2021-01-22 12:21:09 -08:00
Andrew Fogarty 491de17685
Expose Hadoop Configuration/FileSystem (#787) 2021-01-21 13:28:02 -08:00
Ramanathan d2822c33e5
Implement ML Feature: SQLTransformer (#781) 2021-01-15 12:55:12 -08:00
Alex Popitich 1767c3ec81
Fix for memory leak in JVMObjectTracker (#801) 2021-01-14 10:47:45 -08:00
Terry Kim 2346553ca3
Update dotnet-try feed for install-interactive-notebook.sh (#808) 2021-01-12 17:56:48 -08:00
Terry Kim 0eb881c889
Upgrade dotnet/arcade to fix the deprecated feed issue. (#807) 2021-01-12 17:16:43 -08:00
Saravanakumar 638898d7f6
Implement NGram (ML Feature) (#734) 2021-01-04 20:37:18 -08:00
Martina Oefelein 064503bc04
[DOC] Add instructions on setting permissions and removing quarantine attribute for worker binaries (#784) 2020-11-24 23:27:40 -08:00
Saravanakumar 4894956442
Add stop words removers (#726) 2020-11-23 09:43:04 -08:00
Niharika Dutta 87bdd6d192
Support using Broadcast variables in Databricks (#766) 2020-11-11 22:12:56 -08:00
Ed Elliott b8e2259bcf
Expose Ml/FeatureHasher's constructors (#761) 2020-11-05 09:08:54 -08:00
Steve Suh 6197dc46c5
Add comments and cleanup azure pipeline (#764) 2020-11-05 09:02:53 -08:00
dependabot[bot] 4d5610cdf0
Bump junit from 4.4 to 4.13.1 in /src/scala/microsoft-spark-2-4 (#741)
Co-authored-by: Terry Kim <yuminkim@gmail.com>
2020-11-03 11:56:03 -08:00
Steve Suh 27e67ac447
Run E2E tests on Linux in build pipeline and add Backward/Forward E2E tests (#737) 2020-11-03 11:54:28 -08:00
Ed Elliott d252590bb7
Check whether file is found before trying to dereference it (#759) 2020-10-30 16:26:01 -07:00
Steve Suh 059686cc2d
Fix flaky CallbackTests.TestCallbackHandlers Test (#745) 2020-10-24 00:35:35 -07:00
Terry Kim 5b18475614
Fix signer information mismatch issue (#752) 2020-10-23 12:08:32 -07:00
Prashanth Govindarajan d6f0b094f4
Changes to support Arrow 2.0 and Spark 3.0 (#711) 2020-10-23 11:42:34 -07:00
dependabot[bot] 1bcd37b501
Bump junit from 4.4 to 4.13.1 in /src/scala/microsoft-spark-3-0 (#740)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Terry Kim <yuminkim@gmail.com>
2020-10-15 09:31:08 -07:00
dependabot[bot] d1d471f52c
Bump junit from 4.4 to 4.13.1 in /src/scala/microsoft-spark-2-3 (#739)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Terry Kim <yuminkim@gmail.com>
2020-10-14 22:25:50 -07:00
Steve Suh ffdfc5a387
Fix typo in migration guide (#743) 2020-10-14 20:33:08 -07:00
dependabot[bot] 69bff4c5fd
Bump junit from 4.4 to 4.13.1 in /benchmark/scala (#738)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Terry Kim <yuminkim@gmail.com>
2020-10-14 20:30:50 -07:00
Saravanakumar c16a66f625
Use pattern matching in arrow test utils to improve readability (#725) 2020-10-14 17:54:35 -07:00
Terry Kim 550835feeb
Fix package-worker.ps1 to handle output path with ":" (#742) 2020-10-13 14:34:56 -07:00
Steve Suh 7bfd0bb352
Prep 1.0.0 release (#723) 2020-10-12 19:40:08 -07:00
Steve Suh 103174a889
Isolate all dotnet-interactive statements to use the same jvm thread (#736) 2020-10-12 19:37:07 -07:00
Steve Suh 21edf80bb0
Migration Guide: 0.x to 1.0 (#721) 2020-10-12 08:53:54 -07:00
Terry Kim 43a2faf977
Shutdown the JVM thread pool to fix the hanging issue while exiting. (#735) 2020-10-11 23:15:12 -07:00
Terry Kim 28ad6a0ae2
Update C# coding style for the max number of characters in a line (#730) 2020-10-09 20:44:50 -07:00
Steve Suh b21e22e031
Parallelize all E2E tests in build pipeline (#724) 2020-10-09 16:31:39 -07:00
Andrew Fogarty 7484cfc8c0
Support for DeltaTable.ForName (Delta Lake 0.7+) (#727) 2020-10-09 14:14:55 -07:00
Terry Kim 80c745bd40
Update microsoft-spark JARs to include Scala version (#728) 2020-10-09 13:29:50 -07:00
Steve Suh 2a6479d538
Update docs related to new Jar names (#729) 2020-10-09 12:52:39 -07:00
Terry Kim 86e3eb4ba6
Update version check logic on the worker (#718) 2020-10-08 21:24:12 -07:00
Steve Suh e384bf04ca
Get Microsoft.Spark and Microsoft.Spark.Worker assembly version information (#715) 2020-10-08 16:54:41 -07:00
Terry Kim f0a63977e9
Fix a bug where extension E2E tests are not being run (#720) 2020-10-08 12:02:00 -07:00
Terry Kim 0ff23e2db2
Split E2E test build pipeline (#719) 2020-10-08 10:18:45 -07:00
Terry Kim 41e5c6381d
[Build] Separate publish stage from signing stage. (#717) 2020-10-07 18:05:29 -07:00
Ed Elliott 8a1ef48c56
Add missing transform/transformSchema APIs for CountVectorizerModel (#703) 2020-10-06 15:53:34 -07:00
Steve Suh a0cc7dc979
JvmBridge/Netty blocking connection deadlock mitigation (#714) 2020-10-06 15:51:12 -07:00
Andrew Fogarty a67ad5907e
Full support for multithreaded applications (#641) 2020-10-05 17:31:54 -07:00
Rahul Potharaju 7bcd2a5060
Update CONTRIBUTING.md (#704) 2020-10-05 10:28:33 -07:00
Terry Kim 810d9a8de3
Remove compatibility tests from the build pipeline (#705) 2020-10-05 10:24:07 -07:00