I faced the same problem when trying to run hive query on both hive.execution.engine=mr or hive.execution.engine=tez. The error looks like: Vertex failed, vertexName=Map 1, vertexId=vertex_1494168504267_0002_2_00, diagnostics=[Task failed, taskId=task_1494168504267_0002_2_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : attempt_1494168504267_0002_2_00_000000_0:org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid local directory for output/attempt_1494168504267_0002_2_00_000000_0_10002_0/file.out at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:402) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131) at org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles.getSpillFileForWrite(TezTaskOutputFiles.java:207) at org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.spill(PipelinedSorter.java:544) The problem was solved by setting the following parameters: In file hadoop/conf/core-site.xml parameter hadoop.tmp.dir In file hadoop/conf/tez-site.xml parameter tez.runtime.framework.local.dirs In file hadoop/conf/yarn-site.xml parameter yarn.nodemanager.local-dirs In file hadoop/conf/mapred-site.xml parameter mapreduce.cluster.local.dir Set a valid directory with sufficient free space available and the query will execute.
... View more
