How to point a job in workflow manager to a specific python envirnment?
@Victor Try to execute python binary directly with full path (for example /opt/anaconda3/bin/python3) and pass the script .py file as argument. Make sure anaconda3 is installed on all the cluster nodes.
Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.ShellMain], exit code 
This is the head of the python file
And that is because it could not import pandas.
I can see that althought I use the /opt/anaconda3/bin/python which through the shell has pandas and is python3, oozie somehow manages to do the python2.6 which does not have pandas.
@Victor Perhaps you can use a shell script instead of calling the python directly. There you can set all the necessary environment variables and install the necessary library dependencies if not installed yet.
It seems like Oozie has all the variables to the python set by default to Python 2.6.6 in the usr/ directory. The best way to approach this is to find a way to change the default folder of where oozie points to python. How can I find the configuration in Oozie that points to the Python directory? and then override it with Anaconda virtual environment ?