Andy Konwinski
462cd8be60
Re-enabling responsive for better looking padding and more sane resizing,
...
but removed the collapsable stuff from the nav bar.
2012-09-13 15:39:35 -07:00
Andy Konwinski
5ec7a6665b
More crisp logo created from vector source (ai) and disabled
...
responsive css (so nav menu doesn't switch to collapsed version
for narrow viewports).
2012-09-13 15:27:33 -07:00
Andy Konwinski
b0207e2bfd
Replaces "Spark" word in nav bar with logo.
2012-09-13 12:08:12 -07:00
Andy Konwinski
130f2f2f41
Merge remote-tracking branch 'public-spark/dev' into doc
2012-09-13 11:29:25 -07:00
Matei Zaharia
77a0ee99fa
Merge pull request #199 from dennybritz/dev
...
YARN and standalone documentation
2012-09-13 10:02:04 -07:00
Denny
638a8511fa
Fixed navbar style problem
2012-09-13 09:56:27 -07:00
Denny
6d53b971b9
Added standalone and YARN docs. Merged standalone cluster into standalone doc
2012-09-13 09:47:54 -07:00
Andy Konwinski
ca2c999e0f
Making the link to api scaladocs work and migrating other code snippets
...
to use pygments syntax highlighting.
2012-09-12 23:25:07 -07:00
Andy Konwinski
c4db09ea76
Adds ec2-scripts.md back (it was mistakenly removed earlier due to
...
git weirdness).
2012-09-12 20:56:32 -07:00
Matei Zaharia
d3db46fdef
Remove title from content in Bagel
2012-09-12 19:50:38 -07:00
Matei Zaharia
88181bee9e
Small tweaks to generated doc pages
2012-09-12 19:47:31 -07:00
Matei Zaharia
35e17be840
Merge branch 'dev' of github.com:mesos/spark into dev
2012-09-12 19:38:15 -07:00
Matei Zaharia
c92e6169cf
Merge pull request #198 from andyk/doc
...
Fix links and make things a bit prettier.
2012-09-12 19:37:51 -07:00
Andy Konwinski
1bcd09e093
Merge remote-tracking branch 'public-spark/dev' into doc
2012-09-12 19:28:55 -07:00
Andy Konwinski
35adccd008
Adds syntax highlighting (via pygments), and some style tweaks to make things
...
easier to read.
2012-09-12 19:27:44 -07:00
Reynold Xin
4b8b0d5c08
Added a link to AMPCamp website in Spark docs.
2012-09-12 17:54:16 -07:00
Reynold Xin
b603e55a0a
Changed block storage level for shuffle to DISK_ONLY.
2012-09-12 17:54:01 -07:00
Andy Konwinski
bf54ad2fe0
Merge remote-tracking branch 'public-spark/dev' into doc
2012-09-12 16:36:43 -07:00
Andy Konwinski
95c5a376b5
Fixing a hanging sentence in docs/ec2-scripts.md
2012-09-12 16:17:24 -07:00
Andy Konwinski
3c7e40fa27
Removed the upper-case version of docs/EC2-Scripts.md.
2012-09-12 16:09:34 -07:00
Andy Konwinski
4d3a17c8d7
Fixing lots of broken links.
2012-09-12 16:06:18 -07:00
Matei Zaharia
b4dfa25c8a
Store shuffle map outputs as DISK_ONLY
2012-09-12 16:05:57 -07:00
Matei Zaharia
2d761e3353
Ported performance and FT improvements from latest streaming work
2012-09-12 14:54:40 -07:00
Matei Zaharia
9b4cd1648b
Fix bugs with Connection's shutdown callback failing to get its address
2012-09-12 14:54:14 -07:00
Matei Zaharia
9199775d41
Wait for Akka to really shut down in SparkEnv.stop()
2012-09-12 14:50:37 -07:00
Matei Zaharia
d5bdd12353
Merge pull request #197 from andyk/doc
...
Adds a "docs" directory containing existing Spark documentation and doc build instructions
2012-09-12 13:50:50 -07:00
Andy Konwinski
49e98500a9
Updated base README to point to documentation site instead of wiki, updated
...
docs/README.md to describe use of Jekyll, and renmaed things to make them
more consistent with the lower-case-with-hyphens convention.
2012-09-12 13:03:43 -07:00
Andy Konwinski
16da942d66
Adding docs directory containing documentation currently on the wiki
...
which can be compiled via jekyll, using the command `jekyll`. To compile
and run a local webserver to serve the doc as a website, run
`jekyll --server`.
2012-09-12 13:03:43 -07:00
Matei Zaharia
a29ac5f9cf
Merge pull request #195 from dennybritz/feature/fileserver
...
Spark HTTP FileServer
2012-09-11 17:04:17 -07:00
Denny
5e4076e3f2
Merge branch 'dev' into feature/fileserver
...
Conflicts:
core/src/main/scala/spark/SparkContext.scala
2012-09-11 16:57:17 -07:00
Denny
77873d2c8e
Formatting
2012-09-11 16:51:46 -07:00
Denny
24b9b37314
Subclass URLClassLoader instead of using reflection
2012-09-11 16:51:08 -07:00
Denny
31c53e917d
Use stageId as index for fileSet caches.
2012-09-11 16:10:45 -07:00
Matei Zaharia
943df48348
Merge branch 'dev' of github.com:mesos/spark into dev
2012-09-11 16:00:37 -07:00
Matei Zaharia
6d7f907e73
Manually merge pull request #175 by Imran Rashid
2012-09-11 16:00:06 -07:00
Matei Zaharia
4767ba5b7d
Merge pull request #196 from rxin/dev
...
Log entire exception (including stack trace) in BlockManagerWorker.
2012-09-11 14:40:44 -07:00
Reynold Xin
7af7c79ce5
Updated the logError call from the previous commit to conform to
...
logError API.
2012-09-11 14:32:24 -07:00
Reynold Xin
38b9119c96
Log entire exception (including stack trace) in BlockManagerWorker.
2012-09-11 11:31:35 -07:00
Denny
4d3471dd07
Fix serialization bugs and added local cluster tests
2012-09-10 15:39:58 -07:00
Denny
94a7e82ba1
Merge branch 'dev' of git://github.com/mesos/spark into feature/fileserver
2012-09-10 12:54:20 -07:00
Denny
b864c36a30
Dynamically adding jar files and caching fileSets.
2012-09-10 12:49:09 -07:00
Denny
f275fb07da
General FileServer
...
A general fileserver for both JARs and regular files.
2012-09-10 12:48:59 -07:00
Matei Zaharia
a13780670d
Added a unit test for local-cluster mode and simplified some of the code involved in that
2012-09-10 12:48:58 -07:00
Denny
f2ac55840c
Add shutdown hook to Executor Runner and execute code to shutdown local cluster in Scheduler Backend
2012-09-10 12:48:58 -07:00
Denny
9ead8ab14e
Set SPARK_LAUNCH_WITH_SCALA=0 in Executor Runner
2012-09-10 12:48:58 -07:00
Denny
8bb3c73977
Renamed spark-cluster to spark-local.
2012-09-10 12:48:58 -07:00
Denny
a367c20f49
Fix wrong counting
2012-09-10 12:48:57 -07:00
Denny
93fe331e6d
Delete old DeployUtils.
2012-09-10 12:48:57 -07:00
Denny
cf074f9c96
Renamed class.
2012-09-10 12:48:57 -07:00
Denny
3749f94184
Start a standalone cluster locally.
2012-09-10 12:48:57 -07:00