Member since
02-11-2015
5
Posts
0
Kudos Received
0
Solutions
02-12-2015
10:55 PM
Hi No, it didn't work.... I assume impala -f only support <local>path , but the hard thing is we couldn't which node will run the script and we couldn't sync the file to every node for some security reason. Do you have more suggestion ? TK
... View more
02-12-2015
10:51 PM
Hi I had the same issue , I have to make each statement in SQL file to be impala-shell -q *. Even it can work but I think it is so ugly and will be disaster when you have lots of statements ! I had raised the issue at this post before : http://community.cloudera.com/t5/Interactive-Short-cycle-SQL/Impala-schedule-with-oozie-tutorial/m-p/24604#M727
... View more
02-11-2015
10:32 PM
Hi cconner It worked by your example, thanks! But if I want to execute impala-shell -f *.sql , in Oozie ,there was error mentioned couldn't find the file. I had upload the sql file into Oozie workspace and add path for it . I try to pass shell argument, like ./impala-shell -f $2 ,but it didn't work. Could you please tell me how to do it in right way? This is my xml ( I replaced sensitive info by ***): <workflow-app name="impala-shelltest" xmlns="uri:oozie:workflow:0.4"> <credentials> <credential name="hcat" type="hcat"> <property> <name>hcat.metastore.uri</name> <value>thrift://***:9083</value> </property> <property> <name>***</name> <value>***</value> </property> </credential> <credential name="hive2" type="hive2"> <property> <name>hive2.jdbc.url</name> <value>jdbc:hive2://***:10000/default</value> </property> <property> <name>hive2.server.principal</name> <value>hive/***</value> </property> </credential> </credentials> <start to="impalashell"/> <action name="impalashell" cred="hcat,hive2"> <shell xmlns="uri:oozie:shell-action:0.1"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <exec>runstats.sh</exec> <argument>***.keytab</argument> <argument>***.sql</argument> <file>runstats.sh#runstats.sh</file> <file>***.keytab#***.keytab</file> <file>***.sql#***.sql</file> <capture-output/> </shell> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app>
... View more