Created on 01-26-2015 02:23 AM - edited 09-16-2022 02:20 AM
Hello,
I'm having a script file that I want to run with impala-shell.
When I do :
hadoop dfs -ls /user/developer/scripts/Impala/
I can see my file
However, when I try to do it in impala I get no such file or directory.
impala-shell -f /user/developer/scripts/Impala/myFile
What should I check? Why is impala not finding my file?
Thank you!
Created 01-26-2015 07:47 AM
Hi -
The Impala shell is looking for the file in your *local* filesystem, not on HDFS. It does not currently support reading input scripts from HDFS. So to make this work, copy the file locally with hdfs -fs get <path to your file> <local path>, and then run impala-shell -f <local path>.
Best,
Henry
Created 01-26-2015 07:47 AM
Hi -
The Impala shell is looking for the file in your *local* filesystem, not on HDFS. It does not currently support reading input scripts from HDFS. So to make this work, copy the file locally with hdfs -fs get <path to your file> <local path>, and then run impala-shell -f <local path>.
Best,
Henry
Created 01-27-2015 02:28 AM
However, with this solution I have a problem… I do not know on which instance from my cluster is the file downloaded (I want shedule my task with oozie)
Created 02-12-2015 10:51 PM
Hi
I had the same issue , I have to make each statement in SQL file to be impala-shell -q *.
Even it can work but I think it is so ugly and will be disaster when you have lots of statements !
I had raised the issue at this post before :