Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to use apache Nifi on kerberized HDP Cluster nodes

Solved Go to solution

how to use apache Nifi on kerberized HDP Cluster nodes

Rising Star

I have 7 node Kerberized HDP cluster. I have installed apache Nifi on one of my HDP cluster nodes just for testing purpose. When I try to configure putHdfs processor, the following warning pops up:

12753-puthdfs.png

I tried to set the Kerberos properties as follows:

12755-puthdfs-kerberos.png

In addition to this, I set nifi.kerberos.krb5.file=/etc/krb5.conf

in the nifi.properties file. What is the correct configuration(on the Nifi host or HDFS host) for the putHdfs processor to work properly in this case?

Do I need to create Kerberos principal and Kerberos keytab file for the Nifi? Which service's principal or keytab file am I required to provide for "Kerberos Principal" and "Kerberos Keytab" fields in the putHdfs processor configuration?(is it the Nifi's or the Hdfs?)

Thanks,


puthdfs.png
1 ACCEPTED SOLUTION

Accepted Solutions

Re: how to use apache Nifi on kerberized HDP Cluster nodes

Hi @Kibrom Gebrehiwot,

You need to set the

nifi.kerberos.krb5.file=/etc/krb5.conf

property so that NiFi is able to know the information about your realms/controllers and negotiate tickets. Once this property is set, NiFi must be restarted.

Then, in the PutHDFS processor, you need to use the principal and keytab of the user you want to use to push data into HDFS. It is recommended to use the principal/keytab of a user you created if you have one.

Hope this helps.

3 REPLIES 3

Re: how to use apache Nifi on kerberized HDP Cluster nodes

Hi @Kibrom Gebrehiwot,

You need to set the

nifi.kerberos.krb5.file=/etc/krb5.conf

property so that NiFi is able to know the information about your realms/controllers and negotiate tickets. Once this property is set, NiFi must be restarted.

Then, in the PutHDFS processor, you need to use the principal and keytab of the user you want to use to push data into HDFS. It is recommended to use the principal/keytab of a user you created if you have one.

Hope this helps.

Re: how to use apache Nifi on kerberized HDP Cluster nodes

Rising Star

Thank you very much @Pierre Villard Your are answer was really helpful.

Re: how to use apache Nifi on kerberized HDP Cluster nodes

New Contributor

The directory being specified is pointing to the NiFi server and not to the Hadoop Server Directory, please help,

Directory: /home/my_name is what i am keeping @Pierre Villard

Don't have an account?
Coming from Hortonworks? Activate your account here