sutyag
|
9aa97b98c6
|
Dev/sutyag/upgrade mobius (#697)
* basic
* Add extractor and outputter
* Add reducer not done
* Add procedure
* kill node, broadcast, upload executable error feed to cosmos, specify avro or parquet syntax
* Add more functions to HDFS.
Add submitter heartbeat
Update doc
* Redesign cosmos download, add replication setting for hdfs
* Improve executable runner to deal with bad lines
* MERGE MOBIUS
* change dependency path
* Add registration method to mobius
* Major refactoring to add ISparkosmosModule to modulize everything
Start supporting streaming
Fixed a couple of Mobius bugs
Added integration tests
Reenabled unit tests
Added DatedPath
* Make sparkcontext settable, fix setjobgroup
* Expose more interface from Mobius
* Mobius change for Spark 2.3
* fix version conflict, remove unused files
* Added support for multiple UDFs
* Fixed non sql udf issue
* 1. Upgarde mobius to spark 2.3.1 2. Fixed UDF bugs 3. Added support for multipe UDFs
* 1. Added sample testcases 2.Updated referece for examples
* Removed stashed files
* Fixed review comments
* Fixed review comments
* Fixed failed unit test cases
* Deleting all the things
* Updated version in appveyor
* Updated tartool download path
* Fixed java process terminate issue
* Revert access modifier to internal from public for JvmBridge
|
2018-11-20 17:23:43 -08:00 |
Kaarthik Sivashanmugam
Hebin Huang