question Re: NiFi Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL in Archives of Support Questions (Read Only)

NiFi Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL

smayani — Fri, 23 Sep 2016 03:27:39 GMT

PutHiveQL and SelectHiveQL processors are looking for class ‘org.apache.hive.jdbc.HiveDriver’ which I guess should have already been specified into. Is there any option to specify that in HiveConnectionPool.

Error is as follows

2016-09-19 17:55:30,084 ERROR [Timer-Driven Process Thread-4] o.a.nifi.processors.hive.SelectHiveQL SelectHiveQL[id=4467ed6d-0157-1000-5114-2998b4c5f3aa] Unable to execute HiveQL select query select * from nifitest; due to org.apache.nifi.processor.exception.ProcessException: org.apache.commons.dbcp.SQLNestedException: Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL '!connect jdbc:hive2://host.name.net:10000/;principal=hive/_HOST@EXAMPLE.COM '. 
No FlowFile to route to failure: org.apache.nifi.processor.exception.ProcessException: org.apache.commons.dbcp.SQLNestedException: Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL '!connect jdbc:hive2://host.name.net:10000/;principal=hive/_HOST@EXAMPLE.COM '

Re: NiFi Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL

mburgess — Fri, 23 Sep 2016 03:31:37 GMT

The Hive JDBC driver is included with the Hive processors. It appears your driver URL has "!connect" at the front when it should instead start with the "jdbc:hive2" prefix, removing that should fix the issue.

Re: NiFi Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL

smayani — Sun, 18 Aug 2019 11:15:19 GMT

@Matt Burgess

Here is new error:

Caused by: java.net.URISyntaxException: Illegal character in path at index 73: hive2://dummyhost:00000/;principal=hive/_HOST@EXAMPLE.COM
        at java.net.URI$Parser.fail(URI.java:2848) ~[na:1.8.0]
        at java.net.URI$Parser.checkChars(URI.java:3021) ~[na:1.8.0]
        at java.net.URI$Parser.parseHierarchical(URI.java:3105) ~[na:1.8.0]
        at java.net.URI$Parser.parse(URI.java:3053) ~[na:1.8.0]
        at java.net.URI.<init>(URI.java:588) ~[na:1.8.0]
        at java.net.URI.create(URI.java:850) ~[na:1.8.0]
        ... 33 common frames omitted

Here is the Database Connection URL:

jdbc:hive2://host.name.net:10000/;principal=hive/_HOST@EXAMPLE.COM

Re: NiFi Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL

mburgess — Tue, 04 Oct 2016 01:05:10 GMT

It appears your URL has been scrubbed (which is fine), can you find the character at (0-based) index 73? The URL above looks ok (should recognize underscores, semicolons, the at symbol, etc.). Also if you are using the default database, try explicitly putting 'default' in the URL, so jdbc:hive2://host.name.net:10000/default;principal=hive/_HOST@EXAMPLE.COM.

You might also try adding "auth=KERBEROS" to the URL parameters, although I don't think that's required (setting the principal is all that's supposed to be needed).

Re: NiFi Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL

smayani — Tue, 04 Oct 2016 23:09:40 GMT

@Matt Burgess

2 things Resolved the issue:

1. start with the "jdbc:hive2" prefix

jdbc:hive2://host.name.net:10000/;principal=hive/_HOST@EXAMPLE.COM

2. Add following property to hive-site.xml that is passed under HiveConnectionPool "Hive Configuration Resources" property.

<property> <name>hadoop.security.authentication</name> <value>kerberos</value> </property>