Граф коммитов

771 Коммитов

Автор SHA1 Сообщение Дата
skaarthik 170560bf74 replacing old SparkCLR logo with new Mobius logo 2016-04-19 11:27:33 -07:00
Tao Qin 674944d093 Merge pull request #390 from qintao1976/dev
Make CSharpBackendHandler thread safe
2016-04-19 11:49:53 +08:00
tqin f6e20ebd19 Make CSharpBackendHandler thread safe 2016-04-19 10:05:00 +08:00
Tao Wang 416245b2fe Merge pull request #386 from tawan0109/minor-fix
Fixing RefreshOffsetScheduler was not started after restored from checkpointing
2016-04-19 09:24:00 +08:00
Tao Wang 688a302fd0 Merge pull request #385 from tawan0109/ConstantInputDStream
Support ConstantInputDStream
2016-04-19 09:23:27 +08:00
Renyi Xiong 56831a1124 Merge pull request #387 from Microsoft/xiongrenyi-patch-kafka-CSharpReaderENable
Update DynamicPartitionKafkaRDD.scala
2016-04-18 14:44:39 -07:00
Renyi Xiong e8ca81488e Update DynamicPartitionKafkaRDD.scala 2016-04-18 13:04:36 -07:00
tawan0109 fdef777fed Fixing RefreshOffsetScheduler was not started after restored from checkpointing 2016-04-18 18:16:28 +08:00
tawan0109 f6777a3098 Support ConstantInputDStream 2016-04-18 17:52:59 +08:00
guwang ea6597a69c Merge pull request #382 from jayjaywg/TakeOrdered
Add 'keyFunc' parameter in RDD.TakeOrdered()
2016-04-13 09:17:03 +08:00
Tao Wang 6fb9c42851 Merge pull request #381 from tawan0109/minor-fix
Skip existing files when unzip driver zip file to destination directory
2016-04-12 14:26:53 +08:00
tawan0109 d29e39de23 Skip existing files when unzip driver zip file to destination directory 2016-04-12 12:53:21 +08:00
unknown fbe265462f Add 'keyFunc' parameter in RDD.TakeOrdered() 2016-04-10 21:33:27 -07:00
guwang 67c6edb33d implement HiveContext (#380)
Implement HiveContext
2016-04-11 10:56:05 +08:00
Kaarthik Sivashanmugam 87199de783 moving examples projects under subfolders (Batch, Sql and Streaming) (#376)
* moving example projects to subfolder

* updating doc to reflect change in example folders

* fixing incorrect package paths
2016-04-08 16:45:24 +08:00
Kaarthik Sivashanmugam 451712e94a Merge pull request #373 from tanviraumi/master
Removed SetSparkClrPackageVersion.ps1 file from examples folder
2016-04-06 11:38:03 +08:00
Tanvir Aumi 11e33ab573 Removed SetSparkClrPackageVersion.ps1 file from examples folder 2016-04-05 19:37:04 -07:00
Tao Qin 3f6e998b53 Merge pull request #372 from qintao1976/dev
Fix the problem that accumulator can only be used in main thread
2016-04-05 10:18:27 +08:00
tqin e6e5d64070 Fix the problem that accumulator can only be used in main thread 2016-04-05 09:45:28 +08:00
Renyi Xiong cdeaf2acc9 Merge pull request #371 from hebinhuang/FixBuildWarnings
Fix Build Warnings (part 5): Add XML comments and remove unused variables in Csharp code
2016-04-04 11:01:18 -07:00
Hebin Huang 61421eff8f Fix Build Warnings (part 5): Add XML comments and remove unused variables in Csharp code 2016-04-01 17:49:05 -07:00
Renyi Xiong fc2a91fb4b Merge pull request #370 from hebinhuang/FixBuildWarnings
Fix Build Warnings (part 4): Add XML comments for Csharp code
2016-04-01 16:07:05 -07:00
Hebin Huang bc2d7cb9e4 Fix Build Warnings (part 4): Add XML comments for StorageLevel,Column,RowConstructor,SaveMode,Kafka 2016-04-01 15:21:35 -07:00
Renyi Xiong 0de9e28e26 Merge pull request #368 from xsidurd/master
https://github.com/Microsoft/Mobius/issues/267
2016-03-31 18:10:47 -07:00
Renyi Xiong ab1a6cf951 Merge pull request #369 from hebinhuang/FixBuildWarnings
Fix Build Warnings (part 3): Add XML comments for CSharp code
2016-03-31 17:44:31 -07:00
Hebin Huang 24b2e71360 Fix Build Warnings (part 3): Add XML comments for PipelinedRDD,Profiler,IJvmBridge,JvmBridge,Types,PairDStreamFunctions,StreamingContext 2016-03-31 14:08:53 -07:00
Renyi Xiong d6e34cc636 Merge pull request #367 from hebinhuang/FixBuildWarnings
Fix build warnings (part 2): Fix special characters in XML comments
2016-03-31 10:55:11 -07:00
Tao Qin 5fac5a206d Merge pull request #364 from qintao1976/dev
Add the option of use offset size to control dynamic kafka partition
2016-03-31 11:19:15 +08:00
tqin 3d9191102c Merge branch 'master' into dev
# Conflicts:
#	csharp/Adapter/documentation/Microsoft.Spark.CSharp.Adapter.Doc.XML
2016-03-31 10:43:29 +08:00
tqin 0fabe0c983 Add the option of control dynamic Kafka repartition by Spark conf 2016-03-31 10:30:15 +08:00
Hebin Huang 5dc2319e33 Fix build warnings (part 2): Fix special characters in XML comments and add XML coments for PairRDDFunctions,RDD,SparkContext,SqlContext 2016-03-30 16:19:56 -07:00
Renyi Xiong 831b5cb0dd Merge pull request #366 from hebinhuang/FixBuildWarnings
Fix build warning (part 1): Add XML comments for Csharp classes
2016-03-30 13:07:59 -07:00
Hebin Huang 58a1cb8784 Fix build warning (part 1): Add XML comments for ConfigurationService,Accumulator,Broadcast,DoubleRDDFunctions,Option,OrderedRDDFunctions 2016-03-30 11:12:28 -07:00
Tao Qin cb277ab0ca Merge pull request #363 from qintao1976/dev
Fix the problem that TaskRunner's log4j logger is not properly initia…
2016-03-28 16:27:48 +08:00
tqin 410050d880 Fix the problem that TaskRunner's log4j logger is not properly initialized 2016-03-28 14:35:10 +08:00
Tao Qin 3e99c58db1 Merge pull request #362 from qintao1976/dev
Support multiple long running CSharpWorker processes by use different…
2016-03-28 14:30:32 +08:00
tqin e8d6580d43 Support multiple long running CSharpWorker processes by use different PythonWorkerFactory in JVM side 2016-03-28 13:45:15 +08:00
xdrudis c83b6b9660 Addressed comments 2016-03-25 13:47:18 -07:00
xdrudis bcd36e82b4 WordCount Mobius example 2016-03-25 12:01:21 -07:00
Tao Qin 6ae3a81196 Merge pull request #361 from qintao1976/dev
Fix the UT - TestBroadcastVariablesInWorker
2016-03-25 12:43:43 +08:00
tqin 40ec88bcec Fix the UT - TestBroadcastVariablesInWorker 2016-03-25 10:56:49 +08:00
Tao Qin a4a3486f01 Merge pull request #359 from qintao1976/dev
In MultiThreadWorker mode, does not let the whole worker process exit when some TaskRunner fails
2016-03-25 09:43:36 +08:00
Daniel Li 2e3381be53 Merge pull request #360 from ms-guizha/master
Implement a Daemon process to take charge of launching Worker processes
2016-03-24 18:01:05 -07:00
guiling 0a855ce640 Implement a Daemon process to take charge of launching Worker processes 2016-03-24 16:24:02 +08:00
tqin e4001e68ce Minor change to improve log info in worker 2016-03-24 16:19:31 +08:00
tqin ce3e04f986 In MultiThreadWorker mode, does not let the whole worker process exit when some TaskRunner fails. 2016-03-24 16:18:55 +08:00
Kaarthik Sivashanmugam 8c4952ce45 Merge pull request #357 from skaarthik/dev
fixing local variable hiding issue introduced in PR#349
2016-03-23 15:20:24 -07:00
skaarthik 05bee08e02 fixing local variable hiding issue introduced in PR#349 2016-03-23 14:50:36 -07:00
Kaarthik Sivashanmugam d2abc0768d Merge pull request #355 from skaarthik/doc
adding Nuget and Twitter badges
2016-03-22 19:22:24 -07:00
Tao Wang 1be3ccbaf9 Merge pull request #356 from tawan0109/dev
Make the name of 'referesh-offsets' thread unique for different DynamicPartitionKafkaInputDStream instances
2016-03-23 09:03:27 +08:00