- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to execute shell commands using ExecuteProcess processor in a kerberized environment ?
- Labels:
-
Apache NiFi
Created ‎02-19-2016 12:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have a Kerberized cluster and a shell script containing some sqoop commands. Can we use NiFi ExecuteProcess processor to execute this shell script ?
I don't want to use ExecuteSQL processor because sqoop script has some processing logic that can't be easily replicated in NiFi.
Created ‎02-19-2016 11:29 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Shishir Saxena execute process is intended for Linux commands, nifi is not a scheduling tool, you still need to use Oozie. Especially if you want to maintain order of your transactions. Oozie is still the solution for that with sqoop job maintaining the last record processed in the sqoop metastore
Created ‎10-21-2016 10:05 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi, I got into very similar issue. Did you find a way to run shell with kerberos principal. We are trying to do the same, wrap the sqoop script inside shell and use ExecuteProcess processor. It fails to execute with GSS credentials exception.
We tried to start the nifi service with 'nifi' user that has nifi service principal. We want nifi to use user kerberos principal while running this sqoop script.
Any thoughts?

- « Previous
-
- 1
- 2
- Next »