What is the disk space requirement for job spills. Is there any guideline for the same? Or is it just Job dependent - if so, how to determine the same?
In general I configure disk space allocation for tez job spills the same way as Yarn intermediate data.
Please find here some discussions regarding how to configure it:
View solution in original post