9aa97b98c6
Dev/sutyag/upgrade mobius ( #697 )
...
* basic
* Add extractor and outputter
* Add reducer not done
* Add procedure
* kill node, broadcast, upload executable error feed to cosmos, specify avro or parquet syntax
* Add more functions to HDFS.
Add submitter heartbeat
Update doc
* Redesign cosmos download, add replication setting for hdfs
* Improve executable runner to deal with bad lines
* MERGE MOBIUS
* change dependency path
* Add registration method to mobius
* Major refactoring to add ISparkosmosModule to modulize everything
Start supporting streaming
Fixed a couple of Mobius bugs
Added integration tests
Reenabled unit tests
Added DatedPath
* Make sparkcontext settable, fix setjobgroup
* Expose more interface from Mobius
* Mobius change for Spark 2.3
* fix version conflict, remove unused files
* Added support for multiple UDFs
* Fixed non sql udf issue
* 1. Upgarde mobius to spark 2.3.1 2. Fixed UDF bugs 3. Added support for multipe UDFs
* 1. Added sample testcases 2.Updated referece for examples
* Removed stashed files
* Fixed review comments
* Fixed review comments
* Fixed failed unit test cases
* Deleting all the things
* Updated version in appveyor
* Updated tartool download path
* Fixed java process terminate issue
* Revert access modifier to internal from public for JvmBridge
2018-11-20 17:23:43 -08:00
09462fff7e
Merge pull request #695 from davidk/readme-community-button
...
README: Twitter badge fix
2018-10-03 12:21:37 -07:00
2ee4ae8c32
README: Twitter badge update
...
Twitter: This change urlencodes the ?text= parameter so that the button can be
used/linked as intended
2018-10-03 01:18:20 -07:00
221dfbd498
Merge pull request #694 from sutyag/dev/sutyag/FixedReturnTypeIntIssue
...
Fixed integer Data type issue for UDF
2018-09-21 09:55:10 -07:00
766acc8f58
Merge pull request #673 from mhamilton723/patch-2
...
Fix README title
2018-09-12 12:38:04 -07:00
a78996bbe3
Fixed integer return type issue for UDF
2018-09-11 23:53:13 +05:30
c950d00820
Fix README title
2017-10-25 11:40:30 -04:00
6ed8316625
Merge pull request #648 from kmleow/master
...
WordCount Example (Batch) exe path correction
2017-04-08 21:18:47 -07:00
563f364a5d
updating TarTool URL
2017-04-08 21:18:01 -07:00
1a27f42dc1
updating TarTool URL
2017-04-08 21:07:10 -07:00
704afbc1f8
WordCount Example (Batch) exe path correction
...
It was pointing to SparkClrPi.exe instead of SparkClrWordCount.exe
2017-03-28 23:36:11 +08:00
b9593ceb58
Make SparkContext available through SparkSession ( #640 )
2017-03-20 23:43:27 -04:00
a402cb4471
Update TarTool direct link. ( #639 )
...
* Update TarTool direct link.
A more permanent solution here needs to be found so that
we do not need to update this link. In the meantime, this
will unblock users from successfully building
* Trigger new build
2017-03-19 12:23:59 -04:00
d4652e8122
Merge pull request #622 from dwnichols/master
...
Expose JobExecutionStatus in SparkJobInfo as an enum
2017-02-23 10:32:37 -05:00
0368a7b8d8
Merge remote-tracking branch 'upstream/master'
2017-02-13 16:30:53 -05:00
02c2ad4ff7
Expose JobExecutionStatus in SparkJobInfo as an enum
2017-02-13 16:28:58 -05:00
5e8f280f21
Update default spark version in Windows build to 2.0.2
2017-02-12 01:31:46 -08:00
14d9eb4f46
DStream ReduceByKey will fail with reference types
2017-02-12 01:31:15 -08:00
92c281ffc2
Update default spark version in Windows build to 2.0.2
2017-02-09 14:51:25 -05:00
9f60e5ec57
Remove unnecessary comment from previous attempt
2017-01-31 12:50:56 -05:00
e8c8f4db92
updated examples to use latest version of Mobius
2017-01-28 21:43:32 -08:00
f996894416
updating incorrect versions for Mobius jar
2017-01-28 21:33:21 -08:00
e829864490
updated examples to use latest version of Mobius
2017-01-28 21:01:17 -08:00
41e1836ff7
Merge branch 'branch-2.0' into master
2017-01-28 19:32:19 -08:00
51873f7a5d
updating version tags for Spark 2.0 preview release #3
2017-01-28 19:11:16 -08:00
5c6e7bcab5
updating version tags for Spark 2.0 preview release #3
2017-01-28 18:51:39 -08:00
c243fe5119
upgrading to Spark 2.0.2
2017-01-28 18:41:50 -08:00
e14b92ba43
merging latest changes from Microsoft/master
2017-01-28 18:40:14 -08:00
7d0f7ae1da
disabling log messages that are not useful to Mobius app developers
2017-01-28 18:15:46 -08:00
5e9fe61311
added UDF support to SparkSession
2017-01-28 18:15:26 -08:00
ee03c96abb
updating build version
2017-01-28 02:10:24 -08:00
8aad6b483f
upgrading to Spark 2.0.2
2017-01-28 01:48:49 -08:00
b2be81c37f
disabling log messages that are not useful to Mobius app developers
2017-01-28 01:21:35 -08:00
a1b74ad8a7
added UDF support to SparkSession
2017-01-28 01:03:17 -08:00
b95520eff8
Replace KeyValuePair with Tuples
2017-01-27 22:00:55 -08:00
3c30dd6b26
Update linux-instructions.md
2017-01-05 13:03:12 -08:00
313dbf308b
Update linux-instructions.md
...
Add a note about `wget` (Im on macOS and had to install it using homebrew) + formatting
2017-01-05 21:23:40 +01:00
46e09f6ab6
Add PairRDD SortBy descending test
2016-12-14 14:49:41 -05:00
0260524872
DStream ReduceByKey will fail with reference types
...
This fix depends on #605 , and is related to #602
2016-12-14 14:25:15 -05:00
ed73082895
Test changes to improve test coverage
2016-12-14 14:04:56 -05:00
8eb8cd0b54
Remove test
2016-12-14 00:28:12 -05:00
50d65dead5
Added a few tests against Adapter Builder and RDDs
2016-12-14 00:22:00 -05:00
3e3a209bf4
Test fixes for Samples in PairRDDSamples and RDDSamples
2016-12-13 22:44:07 -05:00
2fe5ec409e
Update documatation for tuples change
2016-12-13 16:25:23 -05:00
a36b16009e
Further work on Tuple change
2016-12-13 16:24:59 -05:00
66fc5123d0
Fix test TestDStreamUpdateStateByKey to use Tuples
2016-12-13 16:08:02 -05:00
3ee5289b50
Merge remote-tracking branch 'origin/tuplify' into TupleContinue
2016-12-13 15:35:23 -05:00
88f76af038
Fix ReduceByKey failure when the value type is a reference type
2016-12-03 22:49:00 -08:00
12c46c8ed1
fixing Travis build issue
...
* using openjdk7
2016-12-03 22:28:59 -08:00
6e2b820524
Fix Spark version build problems
...
* Check that Download-File function got a real file.
- Check in the `Download-File` function that the current downloaded copy of the file is not empty [zero length].
* archive.apache.org
- Use `archive.apache.org` as the default server location for downloading Spark [and Maven] binary distributions.
- Previous location was `www.us.apache.org` but that only supports the most recent distributions for each major release
[ie currently `2.0.1` but not `2.0.0` which Mobius is using at the moment.]
* The Apache distribution server is used during both build and run phases.
2016-11-01 22:41:17 -07:00
sutyag
Kaarthik Sivashanmugam
davidk
Suny Tyagi
Mark Hamilton
Leow Kah Man
David Nichols
skaarthik
Jacek Laskowski
Attila Szucs
Jorgen Thelin