question Re: How to connect to Spark2 Thrift Server via JDBC in Support Questions

How to connect to Spark2 Thrift Server via JDBC

zack_riesland — Fri, 23 Jun 2017 21:17:16 GMT

I want to connect Aqua Data Studio to the Spark2 Thrift Server on our cluster.

Can someone point me in the right direction as far as connection string and drivers, etc?

zack_riesland — Fri, 23 Jun 2017 22:02:18 GMT

So far, I've figured out that a connection string like this is what you need:

jdbc:hive2://<thrift server>:10016/<dbname>

And the driver class is just like Hive: org.apache.hive.jdbc.HiveDriver

However, the hive-jdbc.jar file is supposed to work, but doesn't.

I get this error:

Required field 'client_protocol' is unset! Struct:TOpenSessionReq(client_protocol:null, configuration:{use:database=default})

zack_riesland — Sat, 24 Jun 2017 18:18:02 GMT

I figured this one out - the hive-jdbc.jar driver that comes with HDP 2.6.1 is not compatible with the Spark2 Thrift Server.

It's also not compatible with the Hive 1.2 that ships with 2.6.1.

If you just grab an older version of the driver, it works as expected, using the connection settings described above.

Port 10016 for Spark2, port 10015 for the original...

hoc — Sun, 31 Dec 2017 05:27:59 GMT