Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Accessing Hive from SparkR in HDP 3.0


Accessing Hive from SparkR in HDP 3.0


We are struggling to get SparkR to work together with Hive LLAP in HDP 3.0. In the documentation, there is only talk about python and Java. Nothing about R. Is there not support for R anymore? And if so, what other options do we have as we have a lot of SparkR code accessing Hive today.

The problem I get is that the SparkR code tries to access the HDFS files for the database and tables in Hive, as if LLAP connector is not there at all. So basically, we get the following

by: org.apache.spark.sql.AnalysisException:
org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table
addresstype. Permission denied: user=<username>,
access=EXECUTE, inode="/apps/hive":hdfs:hdfs:drwx------

And that is correct. The user I’m running with don’t have, and shouldn’t have permissions to that folder. Is anybody using sparkr together with Hive LLAP in HDP3.0?


Re: Accessing Hive from SparkR in HDP 3.0


@Berry Österlund , SparkR is indeed no longer supported to access Hive, R is not considered in the HWC connector.

Don't have an account?
Coming from Hortonworks? Activate your account here