guwang
|
81882e513e
|
Refactor DataFrame schema and create data type classes, add CreateDataFrame of SqlContext
|
2015-12-21 13:49:00 +08:00 |
skaarthik
|
b9d4995ca1
|
spark 1.5.2 upgrade & unit test updates
|
2015-12-17 11:00:39 -08:00 |
|
guwang
|
e30ecfe23a
|
[Spark 1.5.2] Refactor DataFrame schema and create data type classes, add CreateDataFrame of SqlContext
|
2015-12-17 23:11:22 +08:00 |
|
guwang
|
cd104bf31c
|
[Spark 1.4.1] - Refactor DataFrame schema and create data type classes, add CreateDataFrame of SqlContexxt
|
2015-12-17 09:48:02 +08:00 |
tawan0109
|
c4b7e895ba
|
Enable '--remote-sparkclr-jar' option for standalone cluster mode
|
2015-12-15 14:56:52 +08:00 |
tqin
|
88a8cfcc99
|
Add stack trace info for the function executed in Worker
|
2015-12-11 12:46:31 -08:00 |
renyi
|
4162263823
|
optimize DStream transformation by removing extra CSharpRDD introduced by current implementation from python
|
2015-12-11 10:02:52 -08:00 |
|
skaarthik
|
e57761f2c8
|
adding dataframe perf suites in scala
|
2015-12-10 16:19:04 -08:00 |
|
renyi
|
71b904b0ea
|
enable streaming driver checkpoint
|
2015-12-09 16:24:06 -08:00 |
|
skaarthik
|
207b892f21
|
adding scala perf suite
|
2015-12-08 17:12:36 -08:00 |
Daniel Li
|
0d3aad2d46
|
Merge pull request #145 from danielli90/versionstamp
added back AssemblyInfo.cs for version stamps
|
2015-12-07 23:37:45 -08:00 |
Daniel Li
|
650ff5b1c4
|
added back AssemblyInfo.cs for version stamps
|
2015-12-07 23:09:39 -08:00 |
|
tawan0109
|
0cc694228f
|
[SparkCLR-147] Set executable name as app name when app.name is not explicitly set
|
2015-12-08 14:19:33 +08:00 |
|
tqin
|
d214f949d6
|
Fix the problem that DFTextFileLoadDataFrameSample fail randomly
|
2015-12-07 19:05:00 -08:00 |
|
tqin
|
96fdeb2776
|
Minor change to improve exception handling in Scala driver side
|
2015-12-07 19:05:00 -08:00 |
|
tqin
|
3ed57ecb0d
|
Fix the problem that the driver Java process may not exit after C# process quit
|
2015-12-07 09:37:48 -08:00 |
|
Daniel Li
|
ae41842de0
|
enabled "provided" flag in pom.xml, when creating uber package
|
2015-12-03 23:00:16 -08:00 |
|
skaarthik
|
9056eea715
|
reenabling debug mode (follow-up to PR#118)
|
2015-12-03 09:33:33 -08:00 |
|
tawan0109
|
3f8cbac3ca
|
Add reference to Spark scalastyle-config.xml
|
2015-12-03 14:41:11 +08:00 |
|
tawan0109
|
44cf00d598
|
Enable scala style check in pom.xml
|
2015-12-03 13:49:03 +08:00 |
|
Daniel Li
|
bfb8084c14
|
workaround to build uber pacakge in build.cmd using shade-plugin, without breaking debug mode in IntelliJ
|
2015-12-02 16:38:47 -08:00 |
|
tqin
|
e726b082c1
|
add thread-safe feature to callback socket server through a socket connection queue
|
2015-12-01 13:48:23 -08:00 |
|
tawan0109
|
9e89b01fd2
|
Resolve conflict in scala/src/main/org/apache/spark/deploy/csharp/CSharpRunner.scala
|
2015-12-01 21:29:41 +08:00 |
|
tawan0109
|
162e501f79
|
Enable SparkCLR to run samples in standalone cluster mode
|
2015-12-01 21:25:40 +08:00 |
|
danielli90
|
225c0c172c
|
clear the clutter in console output when running samples
|
2015-11-30 10:00:12 -08:00 |
|
Tao Wang
|
1582fb2f5b
|
Merge pull request #93 from tawan0109/dev-runner
Fix NPE in CSharpRunner
|
2015-11-26 16:59:18 +08:00 |
|
tawan0109
|
14e8a70ff8
|
Fix NPE in CSharpRunner
|
2015-11-26 16:51:35 +08:00 |
|
Tao Qin
|
196470354d
|
Add callbackSocketShutdown flag to denote whether callback socket is closed explicitly. Only log exception when the callback socket is not closed explicitly
|
2015-11-25 15:53:13 +08:00 |
|
tawan0109
|
c42dac1423
|
Remove unused SparkCLRSubmit.scala
|
2015-11-23 23:48:41 +08:00 |
|
tawan
|
83d89abb68
|
Utils supports to zip&unzip folder with subfolders
|
2015-11-19 22:15:14 +08:00 |
|
renyi
|
9996508efa
|
add null key support for SerializedMode.Pair and sharable backend handler
|
2015-11-16 09:01:08 -08:00 |
|
danielli90
|
55d92d08c1
|
use uber packaging to include all dependencies, per recommendation of the book "Learning Spark: lightning fast big data analysis", exclude spark-core, spark-streaming, and spark-sql, from uber package, because those are provided at run-time by Apache Spark
|
2015-11-15 23:05:15 -08:00 |
|
tawan
|
6048bd91dc
|
Fix minor error in the printed usage of sparkclr-submit
|
2015-11-16 14:23:37 +08:00 |
|
Tao Wang
|
dcbe5f4873
|
Merge pull request #52 from tawan0109/master
Add unit tests for env variable `SPARKCSV_JARS` is not supported issue.
|
2015-11-13 18:17:33 +08:00 |
|
tawan
|
69dd481a27
|
Add unit tests for env variable SPARKCSV_JARS is not supported issue.
|
2015-11-13 18:14:25 +08:00 |
Tao Wang
|
a44536e99e
|
Merge pull request #43 from tawan0109/master
Fix `SPARKCSV_JARS` is not supported issue
|
2015-11-12 17:43:05 +08:00 |
|
tawan
|
61b84579e6
|
Fix `SPARKCSV_JARS` is not supported issue
|
2015-11-12 17:36:04 +08:00 |
|
renyi
|
0fb612dd77
|
add csharp streaming module and dstream text file sample, unit test
|
2015-11-11 12:17:50 -08:00 |
|
skaarthik
|
fc11040277
|
fixing the issues introduced by recent PRs
|
2015-11-11 00:29:59 -08:00 |
|
tawan
|
a088ee53ad
|
Simplified job submission & Zip support
|
2015-11-11 14:21:07 +08:00 |
|
skaarthik
|
481789194d
|
renaming parameter to avoid confusion with driver executable
|
2015-11-06 11:37:08 -08:00 |
|
skaarthik
|
0641232c61
|
capturing stacktrace when exception occur in JVM & setting app name
|
2015-11-04 14:43:46 -08:00 |
J.Thelin
|
a326a83d00
|
Fix typo in parameter name.
|
2015-10-31 05:00:18 -07:00 |
|
renyi
|
7db271cba7
|
add back test project and top level proxy
|
2015-10-30 12:46:17 -07:00 |
|
skaarthik
|
77819657e4
|
initial commit
|
2015-10-29 15:27:15 -07:00 |