Below is the example is used to access hdfs from SparkR. -bash-4.1$ hadoop fs -ls /user/hdfs/passwd -rw-r--r-- 3 hdfs hdfs 2296 2016-06-09 16:29 /user/hdfs/passwd -bash-4.1$ -bash-4.1$ SparkR > sqlContext <- sparkRSQL.init(sc) > people <- read.df(sqlContext,"/user/hdfs/passwd", "text") > head(people) If you created the hive table in non default location then kindly use below command to see the underlining hdfs location. hive> desc extended "tablename"; To access hive through SparkR. -bash-4.1$ SparkR > hiveContext <- sparkRHive.init(sc) > sql(hiveContext, "CREATE TABLE IF NOT EXISTS src (key INT, value STRING)") > sql(hiveContext, "LOAD DATA LOCAL INPATH 'examples/src/main/resources/kv1.txt' INTO TABLE src") # Queries can be expressed in HiveQL. > results <- sql(hiveContext, "FROM src SELECT key, value") # results is now a DataFrame >head(results) ... View more

@Aidan Condron I believe the working directory will be local filesystem i.e under /usr. However the /user directory is hdfs location where it has each user home directory and spark will use it for staging area. You need to point the setwd() to some local path instead of hdfs path. ... View more

Hi @Smart Solutions Did you tried the suggested way? ... View more

So is that the same exception you got initally? ... View more

Major things goes under /usr and confs to /etc and logs inside /var, /hadoop, In new releases we are also using /opt ... View more

So it seems that SAP JDBC error is gone but somehow sqoop is not resolving the double quotes. Will do search locally and get back to you. ... View more

yes, probably you can mount /usr on path where you want to use but it should be same name I believe. ... View more

Ok then we may need to remove the initial double quote. SCHEMA.\"/BI0/TCUSTOMER\" ... View more

Did you tried the last suggested syntax or are you able to resolve this issue? ... View more