question Re: impala sql failed with errno=2 description=Error(2): No such file or directory in Archives of Support Questions (Read Only)

impala sql failed with errno=2 description=Error(2): No such file or directory

rube — Fri, 16 Sep 2022 09:17:26 GMT

hi:

cdh5.2.0 ,impala 2.0.

Every hour I will pull data from hive to impala(parquet file).Sometimes,can not excute sql like below，and restart the impala cluster could solve the problem,why?

select id,sub1,(ifnull(sum(click),0)) as clicks > from new_td_impala_test
where (part1>='2014-11-06' and part1<='2014-11-06') and (unix_timestamp(substr(time_stamp,1,19)) >= unix_timestamp('2014-10-31 16:00:00') and unix_timestamp(substr(time_stamp,1,19)) < unix_timestamp('2014-11-07 16:00:00')) group by id,sub1 limit 4 ;
Query: select id,sub1,(ifnull(sum(click),0)) as clicks
from new_td_impala_test
where (part1>='2014-11-06' and part1<='2014-11-06') and (unix_timestamp(substr(time_stamp,1,19)) >= unix_timestamp('2014-10-31 16:00:00') and unix_timestamp(substr(time_stamp,1,19)) < unix_timestamp('2014-11-07 16:00:00')) group by id,sub1 limit 4
WARNINGS: Create file /tmp/impala-scratch/7241111ac15574e0:abef55f7a589b3a5_7241111ac15574e0:abef55f7a589b3a7_dc8fc8e3-f98c-41e8-a86a-d9c8f7840cdb failed with errno=2 description=Error(2): No such file or directory

Backend 1:Create file /tmp/impala-scratch/7241111ac15574e0:abef55f7a589b3a5_7241111ac15574e0:abef55f7a589b3a7_dc8fc8e3-f98c-41e8-a86a-d9c8f7840cdb failed with errno=2 description=Error(2): No such file or directory

Re: impala sql failed with errno=2 description=Error(2): No such file or directory

GautamG — Mon, 05 Jan 2015 08:40:41 GMT

When one or more parent directories in the path are missing, file creation will fail with err=2

# ls -ld /tmp/impala-scratch
ls: cannot access /tmp/impala-scratch: No such file or directory
# touch /tmp/impala-scratch/test
touch: cannot touch `/tmp/impala-scratch/test': No such file or directory

Next time this error occurs, check for the presence of /tmp/impala-scratch before restarting the service. Also, check the HDFS Audit logs to identify which user might be deleting the directory.

Re: impala sql failed with errno=2 description=Error(2): No such file or directory

GautamG — Mon, 05 Jan 2015 11:21:04 GMT

Another alternative is to change your scratch_dirs to be outside of /tmp. That way it might be safe from any job that cleans out /tmp

Re: impala sql failed with errno=2 description=Error(2): No such file or directory

Bike the Rain — Mon, 29 Jun 2015 19:31:46 GMT

Hi There,

Do you know, what are the steps we have to follow to make this change?

I kept on reading the page but didn't find that helpfull.

http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/impala_disk_space.html

Re: impala sql failed with errno=2 description=Error(2): No such file or directory

Bike the Rain — Tue, 30 Jun 2015 16:19:28 GMT

I have options to add another directory but I don't know if that will skip default setting or still I will need to change default.