9aa97b98c6
Dev/sutyag/upgrade mobius ( #697 )
...
* basic
* Add extractor and outputter
* Add reducer not done
* Add procedure
* kill node, broadcast, upload executable error feed to cosmos, specify avro or parquet syntax
* Add more functions to HDFS.
Add submitter heartbeat
Update doc
* Redesign cosmos download, add replication setting for hdfs
* Improve executable runner to deal with bad lines
* MERGE MOBIUS
* change dependency path
* Add registration method to mobius
* Major refactoring to add ISparkosmosModule to modulize everything
Start supporting streaming
Fixed a couple of Mobius bugs
Added integration tests
Reenabled unit tests
Added DatedPath
* Make sparkcontext settable, fix setjobgroup
* Expose more interface from Mobius
* Mobius change for Spark 2.3
* fix version conflict, remove unused files
* Added support for multiple UDFs
* Fixed non sql udf issue
* 1. Upgarde mobius to spark 2.3.1 2. Fixed UDF bugs 3. Added support for multipe UDFs
* 1. Added sample testcases 2.Updated referece for examples
* Removed stashed files
* Fixed review comments
* Fixed review comments
* Fixed failed unit test cases
* Deleting all the things
* Updated version in appveyor
* Updated tartool download path
* Fixed java process terminate issue
* Revert access modifier to internal from public for JvmBridge
2018-11-20 17:23:43 -08:00
704afbc1f8
WordCount Example (Batch) exe path correction
...
It was pointing to SparkClrPi.exe instead of SparkClrWordCount.exe
2017-03-28 23:36:11 +08:00
313dbf308b
Update linux-instructions.md
...
Add a note about `wget` (Im on macOS and had to install it using homebrew) + formatting
2017-01-05 21:23:40 +01:00
142701109b
documentation for implementing Spark Apps in F# using Mobius
2016-10-17 11:58:54 -07:00
e64e342b33
adding instructions for HDI
2016-10-11 12:38:06 -07:00
3ac63040d7
Modify HiveDataFrame example
2016-08-16 10:05:30 -07:00
0d16a57739
doc updates for M3 release
2016-08-15 18:09:43 -07:00
4944319a55
Add read and write buffer for CSharpWorker ( #521 )
...
* Add read and write buffer for CSharpWorker
* Fix test coverage decrease issue
* Adjust read buffer
* Fix failed unit test
* use --conf option to pass buffer size
* Fix flaky unit test
* Address review comments
* Fix option name renaming issue
2016-08-12 14:21:31 +08:00
04f642eed8
documentation updates
2016-08-11 18:18:38 -07:00
da03e58dbe
added new F# example
...
* moved existing F# example to have all F# examples under a single folder
* added copyright notice to existing F# examples
* updated documentation
2016-08-10 17:54:09 -07:00
a2fe4f5dee
improving debug experience
...
* Added the option of using default port (5567) when debugging Mobius driver app. It is possible to provide a specific port number for CSharpBackend and also continue using the old debug behavior by specifying port 0
* Deleted App.Config from examples and updated projects to share App.Config
* Updated documentation
* Added/updated tests
2016-08-09 14:52:25 -07:00
6f94bc7aaa
fix broken links in markdown files
2016-07-31 00:43:13 +08:00
c1dd6d1962
Merge pull request #508 from tawan0109/REPL
...
Mobius REPL
2016-07-29 10:04:02 +08:00
7f618571af
Fixed broken doc link
2016-07-28 16:03:36 -07:00
2c4ea6e07e
Code clean up & add document
2016-07-27 16:31:22 +08:00
36e8fbbf2c
Update configuration-mobius.md
2016-07-20 14:59:44 -07:00
df00f417d7
Update configuration-mobius.md
2016-07-20 14:58:13 -07:00
2bceabb2a0
Update configuration-mobius.md
...
add spark.mobius.streaming.kafka.numPartitions.<topicName>[.<clusterId>]
2016-07-20 14:51:27 -07:00
b6ec24119e
Add RIOSocketWrapper and SaeaSocketWrapper
2016-07-09 22:00:10 -07:00
4004001732
fixes to run Mobius in Linux
...
* allowing to specify worker path for all modes - this will help specifying prefix script for worker exe in CentOS
* fixing issue 467 - with this change Mobius can run in YARN cluster mode
* updating notes since YARN cluster mode is supported with the fix to issue #467
* added check to run OS-specific path tests
2016-07-01 11:21:33 -07:00
4f39658e4e
updates to documentation for Mobius in Linux
2016-06-28 16:15:17 -07:00
0359d66548
support parallelly pre-fetch data for DynamicPartitionKafkaInputDStream
2016-06-22 22:40:00 -07:00
6cecf1c7b2
Cassandra example and other minor updates
2016-06-13 17:43:51 -07:00
18668c3c58
adding instructions for Linux
2016-06-06 22:19:20 -07:00
ba8c179eae
add an item for spark.mobius.streaming.parallelJobs
2016-05-19 09:30:02 -07:00
5b86ee546a
Add F# documentation and Maven version data
...
F# documentation to allow F# work count example to compile under build step. Also version of Maven that is standard in the Debian repository, therefore which is pulled by apt for Debian, Ubuntu, Mint, etc. is 3.0.5 not 3.3.x. I had no problems running any of the scripts with that version of Maven.
2016-05-11 10:45:52 -07:00
2fbd2b0cfe
merge from branch-1.6 and version bump
2016-05-01 14:47:30 -07:00
7982c8e4a6
updated doc and packaging step
2016-04-26 21:37:36 -07:00
80832ba9f0
doc updates and using Mobius name in scripts
2016-04-25 13:06:18 -07:00
9e8be109fb
documentation updates ( #411 )
2016-04-22 17:07:37 -07:00
590f6b7c4a
Merge pull request #394 from tawan0109/minor-fix
...
Add instructions to run samples in YARN mode
2016-04-21 08:57:00 +08:00
c039a2ab7e
adding Kafka example and index for examples
2016-04-20 14:19:27 -07:00
b47437b2a1
Add instructions to run samples in YARN mode
2016-04-20 16:28:18 +08:00
87199de783
moving examples projects under subfolders (Batch, Sql and Streaming) ( #376 )
...
* moving example projects to subfolder
* updating doc to reflect change in example folders
* fixing incorrect package paths
2016-04-08 16:45:24 +08:00
c83b6b9660
Addressed comments
2016-03-25 13:47:18 -07:00
b7d056cc6c
replacing references to SparkCLR after repo rename
2016-03-07 11:42:07 -08:00
e8cb1b1407
Address review comments
2016-03-03 14:20:50 -08:00
e2a3b5f80e
more changes for rebranding SparkCLR to Mobius
2016-02-26 12:42:03 -08:00
4651ddb7df
adding EventHubs example
2016-02-12 16:15:36 -08:00
50435268aa
Merge pull request #294 from skaarthik/example
...
improvements in logging, examples and documentation
2016-02-04 22:45:56 -08:00
d762cdc07f
documentation improvements
2016-02-04 14:13:22 -08:00
76f5ed3158
documentation fix: more change for linux instructions
2016-02-03 09:46:55 -08:00
6183d21fb2
documentation fix: built binaries under build/localmode/ instead of run/
2016-02-03 09:36:00 -08:00
9e0abd4b54
formtting changes, moving linux-compatibility to separate file
2016-01-27 19:51:28 -08:00
7f0fee4516
updating version numbers, fixing url to run-samples scripts, organizing notes
2016-01-27 19:29:32 -08:00
b77c881abc
Update CONTRIBUTING.md
...
fix the path to contributing code changes
2016-01-14 19:07:09 -08:00
d99d19e524
fixing codecov issue and moving linux-patch to notes directory
2016-01-09 22:53:46 -08:00
01f190116e
updating more relative paths in instructions
2016-01-09 19:00:16 -08:00
4e472ba036
fixing relative path in more places
2016-01-09 18:25:13 -08:00
8add53fa56
consolidating build scripts in one directory
2016-01-09 17:54:51 -08:00
sutyag
Leow Kah Man
Jacek Laskowski
Kaarthik Sivashanmugam
Yun Tang
Tao Wang
cosminBoaca
Renyi Xiong
Hebin Huang
tqin
HankG
skaarthik
xdrudis
Cryusz Zhang
Daniel Li