Skip to main content
raphaelt
Gold ⭐️
January 25, 2019
Solved

Bash script in HDFS isn't able to read file at same folder

Hello, 

 

I'm trying to run a bash script located at a HDFS folder via oozie workflow. This script has a lot o configurations to be done by the user, and they are passed to the script via a file the script has to read and is put at the same HDFS folder as the script. The script cannot read it, though, and I wonder if I should comply with some specific path configurations for this to work on HDFS. 

 

When this code here is reached: 

 

if [ ! -e `pwd`/vars.sh ] ; then
echo "Unable to continue: file vars.sh doesn't exist!"
exit 1
fi

the script exits. Is the "pwd" a problem? I know that it pressuposes that the oozie workflow would respect the path of execution of my script. Is this a mistake?

 

Thanks! 

raphaelt
raphaeltAnswer
Gold ⭐️
January 30, 2019
There was a file missing in the workflow's file addition via hue. Solved adding the path to the specific file on HUE's oozie editor

1 reply

raphaelt
raphaeltAuthorAnswer
Gold ⭐️
January 30, 2019
There was a file missing in the workflow's file addition via hue. Solved adding the path to the specific file on HUE's oozie editor
Translate