@Apoorva Teja Vanam : It doesn't look like there is a straight forward approach to this. Have you checked : http://stackoverflow.com/questions/37017366/how-can-i-make-spark1-6-saveastextfile-to-append-existing-file
... View more
You can check for empty patition using following code lines.dstream().foreachRDD(rdd => { if(!rdd.partitions.isEmpty)
rdd.saveAsTextFile(outputDir)
})
... View more
