I see that there are some linux packages available to parse this. Quick search showed there are different tools that are available. If you can use them to parse this data outside nifi, you can use ExecuteProcess to call that executable. Alternatively, I see https://www.openmuc.org/asn1/ which is a java API. You can use that and write a custom processor in Nifi. ... View more

What are you trying to achieve with this? If it is a non-kerberos cluster, if you have network access to the cluster, it will still leave holes for a user to go in as any other user. Just blocking hadoop fs access is not possible (unless you block full hadoop command) and it is not going to help You need to go with Kerberos for security and authentication AND then ranger or ACLs for authorization. ... View more

You are importing as file into a directory (/tmp/dbo-customer). You can check in HDFS to see the files there. You can either create a table from hive that points to this table OR use --hive-import and --create-hive-table options directly import into hive ... View more

Take a look at hiveserver2 logs and post any errors that you see there (if you are using beeline). ... View more

Check what is in hive.security.authorization.manager. You will need to set that as well. It is a lot easier if you are using ambari to do it. Take a look at https://cwiki.apache.org/confluence/display/Hive/SQL+Standard+Based+Hive+Authorization#SQLStandardBasedHiveAuthorization-ForHive0.14andNewer for detailed configuration ... View more

Take a look at this. https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_ambari_views_guide/content/ch_using_files_view.html ... View more

If you disable it, you need to manage krb5.conf on your own, either with puppet/chef or some other way. Ambari will not overwrite whatever is present in /etc/krb5.conf. ... View more

Is /tmp filling up on your client/gateway node or hiveserver2 node? If it is on the client node, are you using hive CLI or beeline? I have looked at a cluster which runs few hundred queries a day using beeline. I looked at both gateway node and hiveserver2 node and don't see much data on /tmp. Can you list contents of /tmp with datasizes if you are using beeline and hiveserver2? ... View more