question Re: permission issue between hive and nifi in Support Questions

permission issue between hive and nifi

lubinlemarchand — Fri, 11 Mar 2016 23:45:07 GMT

Hi,

I'm having some permission issue with Hive. I wrote a file in HDFS using the PutHDFS nifi processor.

When i try to create a table from this location in Hive Ambari view i get this error message :

H110 Unable to submit statement. Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user [admin] does not have [READ] privilege on [hdfs://sandbox.hortonworks.com:8020/tmp/fb_post_name2] [ERROR_STATUS]

I can fix that by typing :

 sudo -u hdfs hadoop fs chown -R admin /tmp/fb_post_name2

sudo -u hdfs hadoop fs chmod 777 /tmp/fb_post_name2

But do i have a way to make it automatic (with the executeProcess processor for instance)?

Thank you in advance.

Re: permission issue between hive and nifi

mburgess — Sat, 12 Mar 2016 00:01:39 GMT

If NiFi is running as a user that can change permissons in HDFS, you should be able to use the following properties in PutHDFS to do the chown/chmod:

Permissions umask

Remote Owner

Remote Group

...according to the documentation: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.hadoop.PutHDFS/index.html

Re: permission issue between hive and nifi

lubinlemarchand — Sat, 12 Mar 2016 00:45:52 GMT

@mburgess

Thank you very much. I tried to change the remote Owner but apparently i was not executing nifi as super user. So i went to the shell, stopped nifi and typed :

sudo bash /opt/nifi-1.1.1.0-12/bin/nifi.sh start

However i'm still not considered as super user. Should i change something in the configuration of nifi?

Re: permission issue between hive and nifi

mburgess — Sat, 12 Mar 2016 02:33:29 GMT

Being the client OS superuser doesn't imply that user is a superuser on HDFS. You'd need to add a user to Hadoop with the same UID and GID as your client user, and make the Hadoop user a superuser on that system, or better yet, just give the user the permissions it needs for the desired folder(s): http://stackoverflow.com/questions/24184306/how-to-add-user-in-supergroup-of-hdfs-in-linux