Support Questions

Find answers, ask questions, and share your expertise

Spark 1.6 Technical Preview

avatar

Team,

Congratulations. We just published Spark 1.6 technical preview (http://hortonworks.com/hadoop-tutorial/apache-spark-1-6-technical-preview-with-hdp-2-3/)

Please take it out for a spin.

1 ACCEPTED SOLUTION

avatar

1. The clickalbe link is: apache-spark-1-6-technical-preview-with-hdp-2-3

2, @vshukla: is there a tarball somewhere too? That's useful client-side

View solution in original post

11 REPLIES 11

avatar
Master Mentor

+1 for including DataSet API example, incredible work team!

avatar
Master Mentor

@vshukla running through the tutorial, in the step 1 of

Accessing the Spark SQL Thrift Server for JDBC/ODBC Access

sudo root yields

"sudo: root: command not found"

avatar

Could not find this in Spark 1.6 Tech Preview. The latest updates to the "Accessing the Spark SQL Thrift Server for JDBC/ODBC Access" have been updated, tested, and incorporated into http://hortonworks.com/hadoop-tutorial/a-lap-around-apache-spark/

avatar
Master Mentor

@Robert Hryniewicz yes I believe Vinay fixed it when I reported it.

avatar
Master Mentor

in Launch SparkR: step

it should be

./bin/sparkR

avatar

Thanks. Incorporated feedback to A Lap Around Apache Spark - http://hortonworks.com/hadoop-tutorial/a-lap-around-apache-spark/

avatar
Master Mentor

in using DataSet API step 1, it should be

su spark 

./bin/spark-shell --num-executors 2--executor-memory 512m--master yarn-client

and not

su spark ./bin/spark-shell --num-executors 2--executor-memory 512m--master yarn-client

otherwise it doesn't work

avatar

Thanks. Incorporated feedback to A Lap Around Apache Spark - http://hortonworks.com/hadoop-tutorial/a-lap-around-apache-spark/

avatar

Thanks @Artem Ervits. Typos fixed.