Support Questions

Find answers, ask questions, and share your expertise

Spark Thrift server JDBC sql with pagination

avatar
Master Collaborator

Hello Experts,

 

I am connecting Spark Thrift Server from Nifi through JDBC to run sql select query against delta tables.

Normal select query is working fine.

But now I want to implement pagination for my sql query for large tables.

 

I tried using OFFSET and LIMIT x,y keywords etc but both of them did not work with STS JDBC.

Is there anyway to achieve pagination with thrift server jdbc sql?
I am not sure if offset and/or limit keywords are not available or not working due to some version.

Could you please suggest me on this?

 

Thanks

Mahendra

1 REPLY 1

avatar
Master Collaborator

Hi @hegdemahendra 

CDP onwards Spark Thrift Server is not supported. 

You can try the following links maybe it is useful for you:

https://stackoverflow.com/questions/29227949/how-to-implement-spark-sql-pagination-query