Had trouble with this as well, but removing the ".mode(...)" actually worked, AND it appended.   spark.read.parquet("/path/to/parq1.parq","/path/to/parq2.parq").coalesce(1).write.format("parquet").saveAsTable("db.table")   ... View more

sorry , there was a typo, the code I am trying to run is :- df.write.bucketBy(2,"col_name").saveAsTable("table") ... View more