I'm using the spark-shell to run a linear regression on a small data set with 5000 observations, but I get a "java.lang.OutOfMemoryError: PermGen space" error message. How can I increase the MaxPermSize for the spark-shell?   Thanks. Stefan ... View more

I've been using the Spark shell on a CDH5 cluster and now I'd like to use the sbt tool to create a standalone Scala program to be deployed on the cluster, but I can't locate where the sbt tool is installed. Is sbt included in CDH5 and if so where is it installed?   Thanks. Stefan ... View more