- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Connecting to Hive from NiFi
- Labels:
-
Apache NiFi
Created ‎12-06-2017 05:49 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We are not able to create a connection with Hive on the server using local NiFi. We are facing an error with finding the driver class. Inserted the hive libraries in the lib folder of NiFi which is causing the NiFi to not start at all.
Created ‎12-06-2017 06:05 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It is highly recommended that you don't place JARs in NiFi's lib/ folder; as you can see it can affect the behavior of the whole instance. Instead you can put all the Hive driver JAR(s) into some other folder, and add the path to that folder to the Database Driver Location(s) property of the DBCPConnectionPool.
There is also a HiveConnectionPool controller service, which is similar to DBCPConnectionPool but it comes packaged with a Hive 1.2 driver. Depending on your Hive version, you should be able to use the built-in driver via HiveConnectionPool. If your Hive server is from HDP 2.4+, you will want to use the HDF version of NiFi, as that has the HDP Hive driver packaged within, versus the Apache Hive driver.
Created ‎12-08-2017 05:31 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for replying @Matt Burgess. We are facing error with the location path for the driver as in the screenshot.dbcpconnection-error.png
Is there a free download for the HDF version of NiFi? And will this help in connection of NiFi from local system to the Ambari on Server.
Created on ‎12-08-2017 06:40 AM - edited ‎08-17-2019 08:00 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We are facing another issue regarding the hive connection pool of which screenshot is attached below and in this we are using HDF version of Nifi. Can you help with this?
