Member since
04-09-2019
25
Posts
1
Kudos Received
0
Solutions
12-12-2019
01:43 PM
Hey @Matt, I'm curious about the MonitorActivity how would the scheduling take on the changing of days in month? Like I want it to run on the 20th of each month, how would I configure that?
... View more
12-12-2019
10:05 AM
Hey, so I want to create a flow that creates a putemail trigger when NO files are present in a hdfs path for a certain date range:
my current flow is
GETHDFS->
ROUTEONATTRIBUTE(has the proper date matching criteria)
-->MATCHED(should be getting files here)
-->UNMATCHED(when this outputs zero I want to receive an email alert)
RouteOnAttribute Logic:
${Path:substring(0,6):equals(${now():toNumber():minus(86400000):format('yyyyMM')})}
Pretty much if I find no files within the current month(last 20 days) then I need to receive an email alert.
How do I get an alert when there are no files that fit the criteria?
@Matt
Thank you matt sorry for yet another question.
... View more
Labels:
- Labels:
-
Apache NiFi
05-06-2019
05:18 PM
Good Afternoon, I am creating an apache nifi flow in which I want to flow files from Oracle DB to IBM/DB2, I have completed that part of the flow. I need help with configuring a way to reconcile failed files, I want to know exactly which files failed and the error which caused it. I'm considering using a PUTHDFS to put the failed files into a HIVE TABLE that way I can capture the flow file error. I would then re-enter the failure files back into the flow via GETHDFS. So, I'm curious is this possible? Also is there a mechanism in NiFi to identify the singular file that fails in a batch?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi