Member since
07-20-2016
4
Posts
0
Kudos Received
0
Solutions
02-27-2017
09:27 PM
I'm looking for some tips regarding using Oozie shell action on Hadoop cluster. For example,let's say I run a Python code on our edge node that runs some Sqoop and HDFS commands against Hadoop cluster and also writes some local files on the edge node temporarily. If I want to use Oozie to schedule the Python script, all these commands will be run on Hadoop cluster, meaning all the python libraries I use in my code should be on data nodes. Also Python needs to write files on data nodes' file system (not HDFS), which shouldn't be allowed. How to tackle these issues? How permission and security of shell commands by Oozie are handled? Any tips/suggestion/links would be greatly appreciated.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Oozie
07-20-2016
08:43 PM
Is this problem solved?
It's so weird that Apache Ranger doesn't support default:*. I'm wondering if there is any update for this issue or not?
... View more