Kaarthik Sivashanmugam
1a27f42dc1
updating TarTool URL
2017-04-08 21:07:10 -07:00
David Nichols
b9593ceb58
Make SparkContext available through SparkSession ( #640 )
2017-03-20 23:43:27 -04:00
David Nichols
a402cb4471
Update TarTool direct link. ( #639 )
...
* Update TarTool direct link.
A more permanent solution here needs to be found so that
we do not need to update this link. In the meantime, this
will unblock users from successfully building
* Trigger new build
2017-03-19 12:23:59 -04:00
David Nichols
d4652e8122
Merge pull request #622 from dwnichols/master
...
Expose JobExecutionStatus in SparkJobInfo as an enum
2017-02-23 10:32:37 -05:00
dwnichols
0368a7b8d8
Merge remote-tracking branch 'upstream/master'
2017-02-13 16:30:53 -05:00
dwnichols
02c2ad4ff7
Expose JobExecutionStatus in SparkJobInfo as an enum
2017-02-13 16:28:58 -05:00
Kaarthik Sivashanmugam
5e8f280f21
Update default spark version in Windows build to 2.0.2
2017-02-12 01:31:46 -08:00
Kaarthik Sivashanmugam
14d9eb4f46
DStream ReduceByKey will fail with reference types
2017-02-12 01:31:15 -08:00
dwnichols
92c281ffc2
Update default spark version in Windows build to 2.0.2
2017-02-09 14:51:25 -05:00
dwnichols
9f60e5ec57
Remove unnecessary comment from previous attempt
2017-01-31 12:50:56 -05:00
Kaarthik Sivashanmugam
e8c8f4db92
updated examples to use latest version of Mobius
2017-01-28 21:43:32 -08:00
skaarthik
f996894416
updating incorrect versions for Mobius jar
2017-01-28 21:33:21 -08:00
skaarthik
e829864490
updated examples to use latest version of Mobius
2017-01-28 21:01:17 -08:00
Kaarthik Sivashanmugam
41e1836ff7
Merge branch 'branch-2.0' into master
2017-01-28 19:32:19 -08:00
Kaarthik Sivashanmugam
51873f7a5d
updating version tags for Spark 2.0 preview release #3
2017-01-28 19:11:16 -08:00
skaarthik
5c6e7bcab5
updating version tags for Spark 2.0 preview release #3
2017-01-28 18:51:39 -08:00
Kaarthik Sivashanmugam
c243fe5119
upgrading to Spark 2.0.2
2017-01-28 18:41:50 -08:00
Kaarthik Sivashanmugam
e14b92ba43
merging latest changes from Microsoft/master
2017-01-28 18:40:14 -08:00
Kaarthik Sivashanmugam
7d0f7ae1da
disabling log messages that are not useful to Mobius app developers
2017-01-28 18:15:46 -08:00
Kaarthik Sivashanmugam
5e9fe61311
added UDF support to SparkSession
2017-01-28 18:15:26 -08:00
skaarthik
ee03c96abb
updating build version
2017-01-28 02:10:24 -08:00
skaarthik
8aad6b483f
upgrading to Spark 2.0.2
2017-01-28 01:48:49 -08:00
skaarthik
b2be81c37f
disabling log messages that are not useful to Mobius app developers
2017-01-28 01:21:35 -08:00
skaarthik
a1b74ad8a7
added UDF support to SparkSession
2017-01-28 01:03:17 -08:00
Kaarthik Sivashanmugam
b95520eff8
Replace KeyValuePair with Tuples
2017-01-27 22:00:55 -08:00
Kaarthik Sivashanmugam
3c30dd6b26
Update linux-instructions.md
2017-01-05 13:03:12 -08:00
Jacek Laskowski
313dbf308b
Update linux-instructions.md
...
Add a note about `wget` (Im on macOS and had to install it using homebrew) + formatting
2017-01-05 21:23:40 +01:00
dwnichols
46e09f6ab6
Add PairRDD SortBy descending test
2016-12-14 14:49:41 -05:00
dwnichols
0260524872
DStream ReduceByKey will fail with reference types
...
This fix depends on #605 , and is related to #602
2016-12-14 14:25:15 -05:00
dwnichols
ed73082895
Test changes to improve test coverage
2016-12-14 14:04:56 -05:00
dwnichols
8eb8cd0b54
Remove test
2016-12-14 00:28:12 -05:00
dwnichols
50d65dead5
Added a few tests against Adapter Builder and RDDs
2016-12-14 00:22:00 -05:00
dwnichols
3e3a209bf4
Test fixes for Samples in PairRDDSamples and RDDSamples
2016-12-13 22:44:07 -05:00
dwnichols
2fe5ec409e
Update documatation for tuples change
2016-12-13 16:25:23 -05:00
dwnichols
a36b16009e
Further work on Tuple change
2016-12-13 16:24:59 -05:00
dwnichols
66fc5123d0
Fix test TestDStreamUpdateStateByKey to use Tuples
2016-12-13 16:08:02 -05:00
dwnichols
3ee5289b50
Merge remote-tracking branch 'origin/tuplify' into TupleContinue
2016-12-13 15:35:23 -05:00
Attila Szucs
88f76af038
Fix ReduceByKey failure when the value type is a reference type
2016-12-03 22:49:00 -08:00
Kaarthik Sivashanmugam
12c46c8ed1
fixing Travis build issue
...
* using openjdk7
2016-12-03 22:28:59 -08:00
Jorgen Thelin
6e2b820524
Fix Spark version build problems
...
* Check that Download-File function got a real file.
- Check in the `Download-File` function that the current downloaded copy of the file is not empty [zero length].
* archive.apache.org
- Use `archive.apache.org` as the default server location for downloading Spark [and Maven] binary distributions.
- Previous location was `www.us.apache.org` but that only supports the most recent distributions for each major release
[ie currently `2.0.1` but not `2.0.0` which Mobius is using at the moment.]
* The Apache distribution server is used during both build and run phases.
2016-11-01 22:41:17 -07:00
Kai Zeng
5311e3027a
add RunJob method to SparkContext; add SparkContext property to RDD ( #590 )
...
* add RunJob method to SparkContext; add SparkContext property to RDD
* test RDD.SparkContext
2016-10-25 14:06:42 -07:00
Kaarthik Sivashanmugam
142701109b
documentation for implementing Spark Apps in F# using Mobius
2016-10-17 11:58:54 -07:00
Kaarthik Sivashanmugam
dae6f9a55d
updating HiveExample to use SparkSession
2016-10-11 16:45:49 -07:00
Kaarthik Sivashanmugam
8597df2d0f
updating examples to use latest preview release
2016-10-11 16:20:41 -07:00
Kaarthik Sivashanmugam
da69c1fef8
merging latest changes from master
2016-10-11 15:09:13 -07:00
skaarthik
fd386b09a4
merging latest changes from master and version updates
2016-10-11 14:58:47 -07:00
Kaarthik Sivashanmugam
9a8fbe811d
updating AssemblyInfo versions
2016-10-11 12:38:22 -07:00
Kaarthik Sivashanmugam
e64e342b33
adding instructions for HDI
2016-10-11 12:38:06 -07:00
Kaarthik Sivashanmugam
fbf0f8d841
fixing the issue in YARN clusters introduced during Spark 2.0 upgrade
2016-10-10 23:42:07 -07:00
skaarthik
7d920d1206
fixing the issue in YARN clusters introduced during Spark 2.0 upgrade
2016-10-10 19:11:55 -07:00