Member since
09-22-2017
5
Posts
0
Kudos Received
0
Solutions
10-03-2017
02:39 PM
Thanks Timothy, in order to parse my log file, i can use TailFile or GetFile but these two components doesn't take input connections. Once ExecuteStreamCommand process is completed , how can i set dependency on ExecuteStreamCommand to call TailFile or GetFile. I'm new to NIFI and my question may be simple to you.
... View more
10-02-2017
05:45 PM
Hi, I have ExecuteStreamCommand which calls my spark-submit shell scripts and based on process success or failure sends an email. I have to write the log details like when the job started and when it ended and if there is any error with ExecuteStreamCommand, put that error message in to my email message. Is there a way to do this task? and is it possible to capture number of records processed in to variable , which will be returned by ExecuteStreamCommand process.
... View more
Labels:
- Labels:
-
Apache NiFi
-
Apache Spark
09-25-2017
05:10 PM
Thanks Yash, I tried the way you suggested. It is working. Thank you so much and i truly appreciate for taking your time and helping me 🙂
... View more
09-22-2017
07:35 PM
Thanks Yash for Answering my question, i followed as you recommended but the ExecuteStreamCommand not invoked after GenerateFlowFile was started. This is what i did. Step 1 : Created GenerateFlowFile and scheduled as cron driven and set the time to run. Step 2: Added success relation to ExecuteStreamCommand processor which is schedule as Time Driven and run schedule is at 52 weeks. Result : Step 1 is executed and step2 is not invoked after step1 success. Is there something i am doing wrong here ?
... View more
09-22-2017
05:59 PM
Hi, I am able to schedule a single process in NIFI data flow. I have created a process group which contains ExecuteStreamCommand and PutEmail tasks. Is there way to schedule the entire process group instead of a single process. Please advise. Thanks
... View more
Labels:
- Labels:
-
Apache NiFi