@Nikhil Pawar One thing you could do here is to increase the "spark.executor.heartbeatInterval" which is default set to 10secs to something higher and test it out . Also something to look at would be to review the executor logs to see if you have any OOM / GC issues when the executors are running on the jobs that you kick off from spark. ... View more

Below posts also talks about Backing up Hive tables: https://community.hortonworks.com/questions/394/what-are-best-practices-for-setting-up-backup-and.html https://community.hortonworks.com/questions/78292/backup-specific-hive-table.html ... View more