question Re: HttpClient error with SelectHiveQL NiFi Processor in Support Questions

HttpClient error with SelectHiveQL NiFi Processor

NagendraKumar — Thu, 25 Jul 2024 14:14:17 GMT

We are facing the HttpClient error when we try to fetch data from the Hive using the SelectHiveQL NiFi Processor.

Please find the error details below and help us resolve this with your expertise.

Controller Service - HiveConnectionPool

Database Connection URL: jdbc:hive2://localhost:10000/default;principal=hive@test@xyz.com
Hive Configuration Resources: /etc/hive/conf/hive-site.xml,/etc/hadoop/conf/core-site.xml

NiFi Processor - SelectHiveQL

Error Message :

SelectHiveQL[id=23er-1234-9999-4444-17] org.apache.nifi.processors.hive.SelectHiveQL$$Lambda$2132/2007351143@6ab4a383 failed to process due to java.lang.NoClassDefFoundError: org/apache/http/client/HttpClient
- Caused by: java.lang.ClassNotFoundException: org.apache.http.client.HttpClient; rolling back session: {}

SelectHiveQL[id=sge33-1234-9999-21-33] Processing halted: yielding [1 sec]: java.lang.NoClassDefFoundError: org/apache/http/client/HttpClient
- Caused by: java.lang.ClassNotFoundException: org.apache.http.client.HttpClient

Re: HttpClient error with SelectHiveQL NiFi Processor

monica345 — Fri, 26 Jul 2024 05:47:36 GMT

Hello,

@NagendraKumar My Indigo Cardwrote:
We are facing the HttpClient error when we try to fetch data from the Hive using the SelectHiveQL NiFi Processor.
Please find the error details below and help us resolve this with your expertise.
Controller Service - HiveConnectionPool
Database Connection URL: jdbc:hive2://localhost:10000/default;principal=hive@test@xyz.com
Hive Configuration Resources: /etc/hive/conf/hive-site.xml,/etc/hadoop/conf/core-site.xml

NiFi Processor - SelectHiveQL
Error Message :
SelectHiveQL[id=23er-1234-9999-4444-17] org.apache.nifi.processors.hive.SelectHiveQL$$Lambda$2132/2007351143@6ab4a383 failed to process due to java.lang.NoClassDefFoundError: org/apache/http/client/HttpClient
- Caused by: java.lang.ClassNotFoundException: org.apache.http.client.HttpClient; rolling back session: {}
SelectHiveQL[id=sge33-1234-9999-21-33] Processing halted: yielding [1 sec]: java.lang.NoClassDefFoundError: org/apache/http/client/HttpClient
- Caused by: java.lang.ClassNotFoundException: org.apache.http.client.HttpClient

Your NiFi isn't talking to Hive properly.

It sounds like there's a missing piece in your software that's stopping them from connecting.

Let's fix it:

Check the connections: Make sure everything is plugged in correctly (figuratively speaking).
Look for missing software: You might need to add something to NiFi to make it work.
Restart NiFi: Sometimes, a simple restart can fix weird computer problems.

If this doesn't work, you might need to ask for more help from NiFi experts.

Let me know if you need more help!

Re: HttpClient error with SelectHiveQL NiFi Processor

NagendraKumar — Fri, 26 Jul 2024 07:29:00 GMT

Hi @monica345 ,

Thanks a lot for your valuable input!

We have restarted the NiFi multiple times and find below the list of jar files placed in the NiFi lib folder. Please let us know if there is any additional jar file that needs to be used in NiFi for connecting to Hive. Thanks!

slf4j-api-2.0.6.jar
nifi-stateless-bootstrap-1.18.0.2.1.5.3000-3.jar
nifi-stateless-api-1.18.0.2.1.5.3000-3.jar
nifi-server-api-1.18.0.2.1.5.3000-3.jar
nifi-runtime-1.18.0.2.1.5.3000-3.jar
nifi-property-utils-1.18.0.2.1.5.3000-3.jar
nifi-properties-1.18.0.2.1.5.3000-3.jar
nifi-nar-utils-1.18.0.2.1.5.3000-3.jar
nifi-framework-api-1.18.0.2.1.5.3000-3.jar
nifi-api-1.18.0.2.1.5.3000-3.jar
logback-core-1.3.5.jar
logback-classic-1.3.5.jar
log4j-over-slf4j-2.0.6.jar
jul-to-slf4j-2.0.6.jar
jetty-schemas-5.2.jar
jcl-over-slf4j-2.0.6.jar
javax.servlet-api-3.1.0.jar
aspectjweaver-1.9.6.jar
oracle-connector-java.jar
mysql-connector-java.jar
ojdbc8.jar
ojdbc10.jar
hive-jdbc-3.1.3000.7.1.7.2000-305.jar
libthrift-0.9.3.jar