Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 01-26-2015 02:23 AM - edited 09-16-2022 02:20 AM
Hello,
I'm having a script file that I want to run with impala-shell.
When I do :
hadoop dfs -ls /user/developer/scripts/Impala/
I can see my file
However, when I try to do it in impala I get no such file or directory.
impala-shell -f /user/developer/scripts/Impala/myFile
What should I check? Why is impala not finding my file?
Thank you!
Created 01-26-2015 07:47 AM
Hi -
The Impala shell is looking for the file in your *local* filesystem, not on HDFS. It does not currently support reading input scripts from HDFS. So to make this work, copy the file locally with hdfs -fs get <path to your file> <local path>, and then run impala-shell -f <local path>.
Best,
Henry
Created 01-26-2015 07:47 AM
Hi -
The Impala shell is looking for the file in your *local* filesystem, not on HDFS. It does not currently support reading input scripts from HDFS. So to make this work, copy the file locally with hdfs -fs get <path to your file> <local path>, and then run impala-shell -f <local path>.
Best,
Henry
Created 01-27-2015 02:28 AM
However, with this solution I have a problem… I do not know on which instance from my cluster is the file downloaded (I want shedule my task with oozie)
Created 02-12-2015 10:51 PM
Hi
I had the same issue , I have to make each statement in SQL file to be impala-shell -q *.
Even it can work but I think it is so ugly and will be disaster when you have lots of statements !
I had raised the issue at this post before :