Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Please see the Cloudera blog for information on the Cloudera Response to CVE-2021-4428

Nifi custom property for SelectHiveQL Database Connection URL

Contributor

We are trying making our processor using custom properties for environment independent.

In this case we are using a SelectHiveQL processor which is working if the Database Connection URL is hardcode.

If the Database Connection URL is a reference as done with Kerberos Principal and Kerberos Keytab it return a error, when running SelectHiveQL.

The pictures show the two scenarios.

Our hive url is as follow: jdbc:hive2://HOST:10000/default;principal=hive/_HOST@HOST.com

I have tried added the propery

41474-skatrdp-c713747-forbindelse-til-fjernskrivebord-2.png

How is it possible to do a custom property reference in Database Connection URL?

41475-skatrdp-c713747-forbindelse-til-fjernskrivebord.png

1 ACCEPTED SOLUTION

Accepted Solutions

Super Guru

Edited due to Matt Clarke's comment below:

Support for Expression Language in SelectHiveQL properties was added to NiFi 1.3.0 under NIFI-3867. It is also available in HDF 3.0.x.

One (less-than-ideal) workaround is to set the property to something invalid but identifiable (like "@HIVE_URL@") and have a script to replace that value in the template before uploading to a particular environment.

View solution in original post

3 REPLIES 3

Super Guru

Edited due to Matt Clarke's comment below:

Support for Expression Language in SelectHiveQL properties was added to NiFi 1.3.0 under NIFI-3867. It is also available in HDF 3.0.x.

One (less-than-ideal) workaround is to set the property to something invalid but identifiable (like "@HIVE_URL@") and have a script to replace that value in the template before uploading to a particular environment.

View solution in original post

Master Guru

@Matt Burgess @Anders Boje

NiFi-3867 is included in HDF 3.0.0 baseline:

https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.0.0/bk_release-notes/content/ch_hdf_relnotes.ht...

While HDF 3.0.0 is based off Apache NiFi 1.2.0, it included many additional fixes/enhancements that later went in to Apache NiFi 1.3.0. The above release notes show all additional Apache Jiras that were included on top of everything Apache NiFi 1.2.0 that makes up the HDF 3.0.0 release.

Thanks,

Matt

Contributor


Thx for answer. We are using a older version today. As showed only some of the fields is supported for Expression Language.

HDF Version 2.1.1 - Powered by Apache NiFi - Version 1.1.0.2.1.2.0-10