The root password is 'cloudera' (any passwords remaining on the machine are the same). ... View more

What does your /etc/hosts file look like now? You shouldn't remove the 127.0.0.1 line completely - just don't have quickstart or quickstart.cloudera on that line. ... View more

Your original question is answered here: http://community.cloudera.com/t5/Apache-Hadoop-Concepts-and/About-ports-to-write-to-HDFS-in-pseudo-distributed-mode-using/m-p/41456#M2517.   One problem that may explain some of the behavior you're seeing in Spark is that your hosts file has quickstart.cloudera mapped to both 127.0.0.1 and your bridged IP address. quickstart.cloudera should only resolve to the IP address you'll use everywhere - otherwise what you see happening is Spark is looking up the IP for quickstart.cloudera and thinking it's 127.0.0.1 - but that means different machines depending on where it's resolved. ... View more

Here's a screenshot from my VM if this helps make it clearer what I'm talking about. ... View more

You're looking in HDFS directories - I expect those to be blank unless you've loaded some data to those directories or run some jobs. On the 5.7 VM I just successfully ran some Spark code by typing `pyspark` on the command-line or `spark-shell --master yarn-client` for the Scala shell. I confirmed that the spark-submit and spark-executor commands are also on the PATH. ... View more

Spark is installed in the 5.7 VM. We support Spark-on-YARN, and spark-shell and pyspark are both on the PATH. ... View more

Can you post the output from when you first ran the Sqoop job? It's very unlikely you're hitting the same root problem. If you try it again, be sure you add the --hive-overwrite option since some of the tables & metadata will have already been created. ... View more

Yes it does. ... View more