Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

How to access Spark Thrift server via jdbc from apache nifi?

avatar
Master Collaborator

Hello Experts,

 

I need to query delta table from apache nifi.
Since Nifi cant connect delta table directly, I am trying it through Spark Thrift Server.

 

I have used 'Hive3ConnectionPool' controller service with 'SelectHive3QL' processor and used below jdbc url and it worked for me.

jdbc:hive2://localhost:10002

 

But I dont know whether using jdbc:hive2//<host>:<port> is right approach or should I use jdbc:spark//<host>:<port> url?

Will there be any performance difference between jdbc:hive2 & jdbc:spark jdbc url's with respect to performance or any other imp thing?


I tried jdbc:spark//<host>:<port> url with 'DBCPConnectionPool 1.16.3' cntroller service but could not succeed with DatabricksJDBC jar.

Any suggestion would be appreciated

 

Thanks

Mahendra

1 REPLY 1

avatar
Master Collaborator

Old version of Databricks jdbc jar has the simba driver class, with that I am able to use jdbc:spark:// connection  string.
But jdbc:hive2:// performance looks better with thrift for me