Can any one help me to schedule a job in Crontab which will execute a simple Hive query on specific time and provide me the output in text/log file.
I have created a batch script to execute a select query , but getting error("Hive command not found") while executing it in Crontab. However same script is running fine through shell. Below is my script :
echo "Starting of Job"
hive -e 'select * from mytest.empl'
echo "Script ends here"
10 * * * * /home/hadoop/work/ip.sh >> /home/hadoop/work/quryout.log 2>&1
After executing the Crontab , I am getting below message in log:
Starting Of Job
hive command not found in ip.sh at line number 4
Script ends here
You need to use ./hive in order to execute a command from the directory you are positioned:
./hive -e 'select * from mytest.empl'
Make sure that the hive command is available at all paths, (i.e) hive's bin directory exported to shell varialbes.
Are you starting the hive shell normally or starting shell under hive's bin directory ?