abe1dfbbab
fix Duration type mismatch bug in
...
enable DStreamTextFileSample and add Window API
change duration type to seconds for streaming bacth interval, Window, Checkpoint and Remember APIs
fix Duration type mismatch bug in
enable DStreamTextFileSample and add Window API
Update JvmBridgeUtils.cs
use GetJavaDuration utility method
use GetJavaDuration utility method
include Window API in unit test
revert DStreamTextFileSample to experimental
Window API included in unit test
2016-05-25 15:10:10 -07:00
434bcbfd04
Merge branch 'master' of https://github.com/Microsoft/SparkCLR
2016-05-25 15:05:21 -07:00
78c3033f52
revert DStreamTextFileSample to experimental
...
Window API included in unit test
2016-05-25 10:30:49 -07:00
9909b7fc0d
include Window API in unit test
2016-05-25 10:28:48 -07:00
1711a2dfe1
use GetJavaDuration utility method
2016-05-25 10:27:46 -07:00
3776666a1a
use GetJavaDuration utility method
2016-05-25 10:25:51 -07:00
f7bf3cee5c
Update JvmBridgeUtils.cs
2016-05-25 10:23:06 -07:00
71e3c37616
Merge branch 'dev' of https://github.com/xiongrenyi/SparkCLR into dev
2016-05-20 13:06:04 -07:00
eab9a53366
change duration type to seconds for streaming bacth interval, Window, Checkpoint and Remember APIs
2016-05-20 13:04:14 -07:00
d8f96a9fe5
enable DStreamTextFileSample and add Window API
2016-05-20 13:04:09 -07:00
69f5673741
fix Duration type mismatch bug in
2016-05-20 13:04:07 -07:00
0ee69f65a1
enable DStreamTextFileSample and add Window API
2016-05-20 11:17:46 -07:00
bd1eb4354d
fix Duration type mismatch bug in
2016-05-20 11:12:52 -07:00
e35a903155
Merge pull request #453 from kai-zeng/master
...
Fix for issue #285
2016-05-20 10:25:29 -07:00
4def779f7f
Merge pull request #449 from xiongrenyi/dev
...
add parallel job to UpdateStateByKey
2016-05-20 08:38:35 -07:00
7e93c05352
hacky check to work with previous releases
2016-05-20 00:11:09 -07:00
9c491397c6
trigger pull request since last one failed randomly
2016-05-19 12:25:49 -07:00
5f4e589154
add conf.set("spark.testing", "true")
2016-05-19 12:08:39 -07:00
ef65a37a8b
update jobExecutor from protected to private[streaming] so that accessable from unit test
2016-05-19 11:19:40 -07:00
08f55eff78
fix jobExecutor to be protected
2016-05-19 10:39:36 -07:00
b2a1a8e957
revert changes
2016-05-19 09:38:49 -07:00
ba8c179eae
add an item for spark.mobius.streaming.parallelJobs
2016-05-19 09:30:02 -07:00
92ec5af2c7
adding unit test for parallel jobs in UpdateStateByKey
2016-05-19 09:16:04 -07:00
8b00f5261f
refactoring by creating runParallelJob method
2016-05-19 09:14:46 -07:00
a0d890536b
remove the sample for parallel jobs, adding scala unit test instead
2016-05-19 09:11:26 -07:00
e774e979aa
Merge pull request #457 from tawan0109/build
...
Fixing issue that build did not stop when mvn build failed
2016-05-19 15:29:28 +08:00
7d08bc9c6d
Fix error passing arguments of sparkclr-submit to spark-submit when arguments contain special characters.
2016-05-18 21:30:25 -07:00
b97ed0a37d
Fixing issue that build did not stop when mvn build failed
2016-05-19 12:16:06 +08:00
f10f646fc4
clean up Utils and UtilsSuite codes
2016-05-18 20:11:18 -07:00
063065a06f
fix adapter test
2016-05-18 19:51:37 -07:00
3661ea8be9
clean Utils codes and add unit tests for file permission
2016-05-17 13:13:27 -07:00
59a35c4d05
Use Apache commons compress library to zip&unzip Mobius application
2016-05-17 13:13:27 -07:00
d82b5e70fc
condensed utils testsuites
2016-05-17 13:13:26 -07:00
f68eaf4949
fix csharp worker path for non-local cases
2016-05-17 13:13:26 -07:00
fa402b9f6a
Update DStreamSamples.cs
2016-05-13 17:53:57 -07:00
2ed393aabf
Update DStreamSamples.cs
2016-05-13 17:45:59 -07:00
45ee018bfa
Update CSharpDStream.scala
2016-05-13 17:42:25 -07:00
f873c1addf
Update DStreamSamples.cs
2016-05-12 12:20:18 -07:00
0e42f223cf
Update CSharpDStream.scala
2016-05-12 12:18:31 -07:00
82ea61c8d9
Merge pull request #26 from Microsoft/master
...
merge from main
2016-05-12 12:12:07 -07:00
5b86ee546a
Add F# documentation and Maven version data
...
F# documentation to allow F# work count example to compile under build step. Also version of Maven that is standard in the Debian repository, therefore which is pulled by apt for Debian, Ubuntu, Mint, etc. is 3.0.5 not 3.3.x. I had no problems running any of the scripts with that version of Maven.
2016-05-11 10:45:52 -07:00
bef703215e
Fix error passing arguments of sparkclr-submit to spark-submit when arguments contain special characters.
2016-05-12 00:12:10 +08:00
20aeac30e5
Merge pull request #442 from qualiu/lqmdev
...
Update download path of winutils.exe to fix running localmode example problem
2016-05-11 12:46:58 +08:00
f6c048bcf7
Fixing unary operator error in Linux build scripts
2016-05-10 11:27:20 -07:00
0c91852baa
Update download path of winutils.exe to fix running localmode example problem (such as: permission of /tmp/hive)
2016-05-10 10:58:01 +08:00
07b704f8aa
Sample word count project in F#
2016-05-07 11:07:19 -07:00
d0f51b5a42
Merge remote-tracking branch 'microsoft/master' into tuplify
2016-05-07 09:10:15 +02:00
1208b1d925
Fix path for mono
2016-05-04 09:34:51 -07:00
6f4e7d920f
Merge remote-tracking branch 'microsoft/master' into tuplify
...
# Conflicts:
# csharp/Adapter/Microsoft.Spark.CSharp/Streaming/MapWithStateDStream.cs
2016-05-04 10:46:16 +02:00
93457321d3
Fix path for mono
2016-05-04 09:51:55 +02:00
Renyi Xiong
Kai Zeng
kai
Tao Wang
Kaarthik Sivashanmugam
HankG
qualiu
Tao Qin
Scott Lyons
Isaac Abraham
Isaac Abraham
Steffen Forkmann