Tutorial: Hands-on Tour of Apache Spark in 5 Minutes - Issue Resolution

[#1]

Tutorial Link

Sandbox Version: HDP 2.3.2
Ambari Version 2.1.2
Hadoop stack version: Hadoop 2.7.1.2.3.2.0-2950

Issue 1: Permission Denied

Copy the data over to HDFS on Sandbox with the following command will result in a Permission denied error.

hadoop fs -put ~/Hortonworks /user/guest/Hortonworks

Resolution: See Hands-on Spark Tutorial: Permission Denied

------------------------------

[#2]

This has been addressed in the latest tutorial. The permission denied error message related to a missing step in creating a guest user. We now use a /tmp directory instead. The new instruction step is:

hadoop fs -put ~/Hortonworks /tmp