06-17-2014 04:22 AM
I'm wondering how Impalad instance deals with the intermediate files during computing, currently the disk space of my Impala directory is nearly full and it seems that Impala becomes very slow. So , is there any configuration that enables Impala to use other disks for storing local intermediate data like hadoop.tmp.dir?
BTW, I'm using Impala 0.9.
06-17-2014 10:18 AM
My first suggestion would be to upgrade from Impala 0.9 - that's a very old version. Try using Impala 1.3.1 and let us know if there's any improvement.
To answer your main question - no, Impala doesn't have such an option partly because the current version does not use local disk as scratch space.