Member since
02-02-2017
18
Posts
1
Kudos Received
0
Solutions
03-26-2018
02:00 PM
Is Kerberized server supported by LivySessionController ?
... View more
03-26-2018
01:55 PM
Is Kerberized server supported by LivySessionController ? I tried with the same approach on Kerberized Hadoop cluster but not able to get expected results.
... View more
06-14-2017
07:42 PM
I am using a ExecuteScript processor to run a python script at a remote machine.
This processor doesn't take input from flowfile from an upstream processor, i want to pass the parameter in ExecuteScript processor dynamically. I saw that ExecuteStreamCommand processor can take parameters from upstream processor. But i am unable to find an option to run the python script on remote machine through this processor.
Is there a way to run remote python script through ExecuteStreamCommand processor ?
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
03-30-2017
09:39 AM
Hey @Dan Chaffelson Is there a way we can connect to the remote machine with password instead of key. i was able to run to do ssh (with password) from backend. Can i do it from "ExecuteProcess" processor or any other processor ?
thanks.
... View more
03-30-2017
09:36 AM
Hey @Matt Clarke,
Is there a way we can connect to the remote machine with password instead of key.
i was able to run to do ssh (with password) from backend. Can i do it from "ExecuteProcess" processor.
thanks.
... View more
03-24-2017
08:51 AM
@Dan Chaffelson The python script (is actually a big python code ~ 500 Lines) pulls data from a MS SQL Server and dumps data in CSV format to a specified location in that machine. Actually, the whole use case is extracting Tabular Data from various SQL sources and putting them to HDFS (HDP), we are using NiFi to orchestrate the process. Hence want to instantiate and schedule the whole flow with NiFi only.
... View more
03-24-2017
08:03 AM
Hey @Dan Chaffelson thanks for sharing, Can you help me with a Processor (with configuration) that can be used to trigger a python script on remote machine (by doing ssh) and pulling back the result to HDF cluster.
I have used Execute process processor with below configs to trigger the python script on remote machine. ( As suggest by @Matt Clarke) and was able to run the python script.
Property Value Command ssh Command Arguments -i "<path to private key>" <user>@<remotehost> python <script> &
Now i want to pull back the output of python command (which is at /home/abc with 777 permission) to HDF cluster.
Is there a processor to do that ?
... View more
03-24-2017
07:25 AM
Thanks @Matt Clarke It worked fine, i was able to execute the python script.
Is there a way we can get back the output data which is being generated by the python code, which is being saved to a directory in the remote machine ?
... View more
03-23-2017
01:12 PM
@Matt I have tried exploring Execute Script processor and Execute Process Processor but was not able to do ssh to remote machine. Could you provide more detail on this or help me with the processor and configurations. Thanks
... View more
03-23-2017
11:35 AM
I have a 3 nodes HDF cluster(in AWS cloud) where NiFi is running across the cluster, i want to use a NiFi processor to trigger shell/python script on a remote machine (OnPremise) to perform certain action written in the shell/python script.
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)