I am connecting Spark Thrift Server from Nifi through JDBC to run sql select query against delta tables.
Normal select query is working fine.
But now I want to implement pagination for my sql query for large tables.
I tried using OFFSET and LIMIT x,y keywords etc but both of them did not work with STS JDBC.
Is there anyway to achieve pagination with thrift server jdbc sql?I am not sure if offset and/or limit keywords are not available or not working due to some version.Could you please suggest me on this?
CDP onwards Spark Thrift Server is not supported.
You can try the following links maybe it is useful for you: