NiFi to Hive connection on Docker

ehehtenandayo — Wed, 27 Mar 2024 14:28:52 GMT

Hi, I'm trying to query a Hive database on NiFi, but I get the following error, both Hive and NiFi are hosted on the same Docker container.

I downloaded and put 'nifi-hive-nar-1.25.0.nar' and 'nifi-hive-services-api-nar-1.25.0.nar' files in the lib folder to add the processor as It was not built in for my installation.

I'm trying the following configuration :

This is the part of the schema where I'm encountering this issue:

Maybe the issue is with the connection URI ? Regardless any help to steer me to the solution would be nice, thanks.

Re: NiFi to Hive connection on Docker

steven-matison — Mon, 08 Jul 2024 12:58:50 GMT

@ehehtenandayo your Hive Metastore URI should look like "thirft://<Hive Metastore host>:9083." Note that hive meta store host is not the same as the hive server host.

You can usually locate the correct thrift string in the hive-site.xml as such:

<property>
  <name>hive.metastore.uris</name>
  <value>thrift://host1.cloudera.site:9083,thrift://host2.cloudera.site:9083</value>
</property>

question Re: NiFi to Hive connection on Docker in Support Questions

NiFi to Hive connection on Docker

Re: NiFi to Hive connection on Docker