Граф коммитов

1064 Коммитов

Автор SHA1 Сообщение Дата
Kaarthik Sivashanmugam 1a27f42dc1 updating TarTool URL 2017-04-08 21:07:10 -07:00
David Nichols b9593ceb58 Make SparkContext available through SparkSession (#640) 2017-03-20 23:43:27 -04:00
David Nichols a402cb4471 Update TarTool direct link. (#639)
* Update TarTool direct link.

A more permanent solution here needs to be found so that
we do not need to update this link. In the meantime, this
will unblock users from successfully building

* Trigger new build
2017-03-19 12:23:59 -04:00
David Nichols d4652e8122 Merge pull request #622 from dwnichols/master
Expose JobExecutionStatus in SparkJobInfo as an enum
2017-02-23 10:32:37 -05:00
dwnichols 0368a7b8d8 Merge remote-tracking branch 'upstream/master' 2017-02-13 16:30:53 -05:00
dwnichols 02c2ad4ff7 Expose JobExecutionStatus in SparkJobInfo as an enum 2017-02-13 16:28:58 -05:00
Kaarthik Sivashanmugam 5e8f280f21 Update default spark version in Windows build to 2.0.2 2017-02-12 01:31:46 -08:00
Kaarthik Sivashanmugam 14d9eb4f46 DStream ReduceByKey will fail with reference types 2017-02-12 01:31:15 -08:00
dwnichols 92c281ffc2 Update default spark version in Windows build to 2.0.2 2017-02-09 14:51:25 -05:00
dwnichols 9f60e5ec57 Remove unnecessary comment from previous attempt 2017-01-31 12:50:56 -05:00
Kaarthik Sivashanmugam e8c8f4db92 updated examples to use latest version of Mobius 2017-01-28 21:43:32 -08:00
skaarthik f996894416 updating incorrect versions for Mobius jar 2017-01-28 21:33:21 -08:00
skaarthik e829864490 updated examples to use latest version of Mobius 2017-01-28 21:01:17 -08:00
Kaarthik Sivashanmugam 41e1836ff7 Merge branch 'branch-2.0' into master 2017-01-28 19:32:19 -08:00
Kaarthik Sivashanmugam 51873f7a5d updating version tags for Spark 2.0 preview release #3 2017-01-28 19:11:16 -08:00
skaarthik 5c6e7bcab5 updating version tags for Spark 2.0 preview release #3 2017-01-28 18:51:39 -08:00
Kaarthik Sivashanmugam c243fe5119 upgrading to Spark 2.0.2 2017-01-28 18:41:50 -08:00
Kaarthik Sivashanmugam e14b92ba43 merging latest changes from Microsoft/master 2017-01-28 18:40:14 -08:00
Kaarthik Sivashanmugam 7d0f7ae1da disabling log messages that are not useful to Mobius app developers 2017-01-28 18:15:46 -08:00
Kaarthik Sivashanmugam 5e9fe61311 added UDF support to SparkSession 2017-01-28 18:15:26 -08:00
skaarthik ee03c96abb updating build version 2017-01-28 02:10:24 -08:00
skaarthik 8aad6b483f upgrading to Spark 2.0.2 2017-01-28 01:48:49 -08:00
skaarthik b2be81c37f disabling log messages that are not useful to Mobius app developers 2017-01-28 01:21:35 -08:00
skaarthik a1b74ad8a7 added UDF support to SparkSession 2017-01-28 01:03:17 -08:00
Kaarthik Sivashanmugam b95520eff8 Replace KeyValuePair with Tuples 2017-01-27 22:00:55 -08:00
Kaarthik Sivashanmugam 3c30dd6b26 Update linux-instructions.md 2017-01-05 13:03:12 -08:00
Jacek Laskowski 313dbf308b Update linux-instructions.md
Add a note about `wget` (Im on macOS and had to install it using homebrew) + formatting
2017-01-05 21:23:40 +01:00
dwnichols 46e09f6ab6 Add PairRDD SortBy descending test 2016-12-14 14:49:41 -05:00
dwnichols 0260524872 DStream ReduceByKey will fail with reference types
This fix depends on #605, and is related to #602
2016-12-14 14:25:15 -05:00
dwnichols ed73082895 Test changes to improve test coverage 2016-12-14 14:04:56 -05:00
dwnichols 8eb8cd0b54 Remove test 2016-12-14 00:28:12 -05:00
dwnichols 50d65dead5 Added a few tests against Adapter Builder and RDDs 2016-12-14 00:22:00 -05:00
dwnichols 3e3a209bf4 Test fixes for Samples in PairRDDSamples and RDDSamples 2016-12-13 22:44:07 -05:00
dwnichols 2fe5ec409e Update documatation for tuples change 2016-12-13 16:25:23 -05:00
dwnichols a36b16009e Further work on Tuple change 2016-12-13 16:24:59 -05:00
dwnichols 66fc5123d0 Fix test TestDStreamUpdateStateByKey to use Tuples 2016-12-13 16:08:02 -05:00
dwnichols 3ee5289b50 Merge remote-tracking branch 'origin/tuplify' into TupleContinue 2016-12-13 15:35:23 -05:00
Attila Szucs 88f76af038 Fix ReduceByKey failure when the value type is a reference type 2016-12-03 22:49:00 -08:00
Kaarthik Sivashanmugam 12c46c8ed1 fixing Travis build issue
* using openjdk7
2016-12-03 22:28:59 -08:00
Jorgen Thelin 6e2b820524 Fix Spark version build problems
* Check that Download-File function got a real file.
- Check in the `Download-File` function that the current downloaded copy of the file is not empty [zero length].
* archive.apache.org
- Use `archive.apache.org` as the default server location for downloading Spark [and Maven] binary distributions.
- Previous location was `www.us.apache.org` but that only supports the most recent distributions for each major release
  [ie currently `2.0.1` but not `2.0.0` which Mobius is using at the moment.]

* The Apache distribution server is used during both build and run phases.
2016-11-01 22:41:17 -07:00
Kai Zeng 5311e3027a add RunJob method to SparkContext; add SparkContext property to RDD (#590)
* add RunJob method to SparkContext; add SparkContext property to RDD

* test RDD.SparkContext
2016-10-25 14:06:42 -07:00
Kaarthik Sivashanmugam 142701109b documentation for implementing Spark Apps in F# using Mobius 2016-10-17 11:58:54 -07:00
Kaarthik Sivashanmugam dae6f9a55d updating HiveExample to use SparkSession 2016-10-11 16:45:49 -07:00
Kaarthik Sivashanmugam 8597df2d0f updating examples to use latest preview release 2016-10-11 16:20:41 -07:00
Kaarthik Sivashanmugam da69c1fef8 merging latest changes from master 2016-10-11 15:09:13 -07:00
skaarthik fd386b09a4 merging latest changes from master and version updates 2016-10-11 14:58:47 -07:00
Kaarthik Sivashanmugam 9a8fbe811d updating AssemblyInfo versions 2016-10-11 12:38:22 -07:00
Kaarthik Sivashanmugam e64e342b33 adding instructions for HDI 2016-10-11 12:38:06 -07:00
Kaarthik Sivashanmugam fbf0f8d841 fixing the issue in YARN clusters introduced during Spark 2.0 upgrade 2016-10-10 23:42:07 -07:00
skaarthik 7d920d1206 fixing the issue in YARN clusters introduced during Spark 2.0 upgrade 2016-10-10 19:11:55 -07:00