question configuration Nifi to work with kerberized Hadoop in Archives of Support Questions (Read Only)

configuration Nifi to work with kerberized Hadoop

xw0927 — Mon, 24 Oct 2016 14:37:31 GMT

I want nifi to use kerberos principal while running the Hive script in Hadoop with Kerbores set up.

Is there a way to automate renew Kerbores ticket? Nifi executestream process group stopped working after the Kerbores ticket expired. The process continue after executing command "kinit <username>".

current nifi.properties file:

nifi.kerberos.krb5.file=/etc/krb5.conf

nifi.kerberos.service.principal=<username>

nifi.kerberos.keytab.location=/home/username.keytab

nifi.kerberos.authetication.expiration=12 hours

Re: configuration Nifi to work with kerberized Hadoop

bbende — Mon, 24 Oct 2016 20:55:56 GMT

Some of these properties are a little bit mis-leading and were renamed in 1.0 to make it clearer:

https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#kerberos_properties

I think if you are calling an external script you would need to handle renewing the kerberos tickets yourself. You could just setup a GenerateFlowFile on a timer schedule that went to an ExecuteStreamCommand and just did a kinit every couple of hours.