Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Spark Thrift server JDBC sql with pagination

avatar
Master Collaborator

Hello Experts,

 

I am connecting Spark Thrift Server from Nifi through JDBC to run sql select query against delta tables.

Normal select query is working fine.

But now I want to implement pagination for my sql query for large tables.

 

I tried using OFFSET and LIMIT x,y keywords etc but both of them did not work with STS JDBC.

Is there anyway to achieve pagination with thrift server jdbc sql?
I am not sure if offset and/or limit keywords are not available or not working due to some version.

Could you please suggest me on this?

 

Thanks

Mahendra

1 REPLY 1

avatar
Super Collaborator

Hi @hegdemahendra 

CDP onwards Spark Thrift Server is not supported. 

You can try the following links maybe it is useful for you:

https://stackoverflow.com/questions/29227949/how-to-implement-spark-sql-pagination-query