No. You will at the least need to build spark for 2.11. From spark apache documentation, To produce a Spark package compiled with Scala 2.11, use the -Dscala-2.11 property: ./dev/change-scala-version.sh 2.11 mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package Spark does not yet support its JDBC component for Scala 2.11. ... View more

Check if you find nodemanager and datanode logs on slave nodes where they didn't start. They should tell what went wrong. Most likely they failed with errors. You may also need yarn-site.xml to configure yarn.nodemanager.log-dirs and yarn.nodemanager.local-dirs params. Try following these instructions for start and stop services since this is the supported way. Also, always try to configure FQDN instead of just hostnames. ... View more

Can you try manually installing ambari-agent on the client node using instructions here. Once you start ambari-agent, you can check ambari-server logs to see if client.hortonworks.com registered. As long as you got the network part figured out (like I see from your setup), there should be nothing else from sandbox preventing adding a new node. ... View more