09-02-2016 03:15 PM
I am trying to run the shell from Oozie, the shell contain just simple copyFromLocal command.
The script is test.sh,
hadoop fs -copyFromLocal /export/home/data/ /user/data/
(Local dir on Edge node= /export/home/data/
Hadoop dir = /user/data/)
This script is running fine on Edge node with expected result.
I have placed this script in workspace as well as mentioned in file option in workflow.
But I am getting below error,
Log Type: stderr Log Length: 416 copyFromLocal: `/export/home/data/': No such file or directory Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exit code  log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.impl.MetricsSystemImpl). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Workflow.xml looks like below,
09-02-2016 05:15 PM
09-06-2016 12:14 PM
Thank you Harsh.
Though we don't have enterprise scheduler yet, I am trying to schedule most of jobs through Oozie.
But for data ingestion .sh scripts on Edge node, I may need to use a crontab now.
SSH setup may take long time.
Any suggestions are welcome other that cron and SSH.