How to access Spark Thrift server via jdbc from apache nifi?

Question

Hello Experts,

I need to query delta table from apache nifi.
Since Nifi cant connect delta table directly, I am trying it through Spark Thrift Server.

I have used 'Hive3ConnectionPool' controller service with 'SelectHive3QL' processor and used below jdbc url and it worked for me.

jdbc:hive2://localhost:10002

But I dont know whether using jdbc:hive2//<host>:<port> is right approach or should I use jdbc:spark//<host>:<port> url?

Will there be any performance difference between jdbc:hive2 & jdbc:spark jdbc url's with respect to performance or any other imp thing?

I tried jdbc:spark//<host>:<port> url with 'DBCPConnectionPool 1.16.3' cntroller service but could not succeed with DatabricksJDBC jar.

Any suggestion would be appreciated

Thanks

Mahendra

hegdemahendra · Answer

Old version of Databricks jdbc jar has the simba driver class, with that I am able to use jdbc:spark:// connection  string.But jdbc:hive2:// performance looks better with thrift for me

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.