Any guidelines for disk space allocation for tez job Spills?

[#1]

What is the disk space requirement for job spills. Is there any guideline for the same? Or is it just Job dependent - if so, how to determine the same?

[#2 · Accepted solution]

In general I configure disk space allocation for tez job spills the same way as Yarn intermediate data.

Please find here some discussions regarding how to configure it:

http://community.hortonworks.com/questions/2230/recommended-size-for-yarnnodemanagerresourcelocal.ht...

http://community.hortonworks.com/questions/1405/can-you-please-advise-about-how-best-to-use-this-s.h...