Infuriatingly, the connector defaults to only returning 1000 rows. This doesn't seem to be documented (anywhere I've found). The relevant configuration is exec.results.max, which can be passed in by setting spark.datasource.hive.warehouse.exec.results.max in spark shell.   Add the following config to increases the maximum to 20000:   --conf "spark.datasource.hive.warehouse.exec.results.max=20000" @russell786  @gopi_gogada      ... View more