Member since
04-09-2019
25
Posts
1
Kudos Received
0
Solutions
07-20-2022
08:40 AM
Hello All, I'm attempting to convert from a GetHDFS processor in apache nifi in anticipation of it being deprecated. I am going to use the ListHDFS instead yet when I set up the same inputs it is only returning the file path in a flow file and not actual folder content(files). Can anyone help with this? I'm just sourcing from a HDFS directory.
... View more
Labels:
- Labels:
-
Apache NiFi
12-12-2019
01:43 PM
Hey @Matt, I'm curious about the MonitorActivity how would the scheduling take on the changing of days in month? Like I want it to run on the 20th of each month, how would I configure that?
... View more
12-12-2019
10:05 AM
Hey, so I want to create a flow that creates a putemail trigger when NO files are present in a hdfs path for a certain date range:
my current flow is
GETHDFS->
ROUTEONATTRIBUTE(has the proper date matching criteria)
-->MATCHED(should be getting files here)
-->UNMATCHED(when this outputs zero I want to receive an email alert)
RouteOnAttribute Logic:
${Path:substring(0,6):equals(${now():toNumber():minus(86400000):format('yyyyMM')})}
Pretty much if I find no files within the current month(last 20 days) then I need to receive an email alert.
How do I get an alert when there are no files that fit the criteria?
@Matt
Thank you matt sorry for yet another question.
... View more
Labels:
- Labels:
-
Apache NiFi
12-10-2019
01:12 PM
I'm okay with writing over the content of the rest of the file. I'm trying to output the rowcount results in a putemail so I'm okay with overwriting the rest of the flowfile. Can you still help with this?
... View more
12-10-2019
10:45 AM
So it's part of the flowfile content. I attached the flow and the configs. Sorry for the confusion if I caused any I'm using a count
... View more
12-10-2019
09:14 AM
Hey Matt, thank you so much I've set up that flow but I'm having trouble on the actual updateattribute function I'm applying: ${COUNTFILES:minus(31)} I'm using this and it's not modifying the value. Could you please help?
... View more
12-09-2019
11:36 AM
Hello, I want to perform a simple mathematical operation on a json attribute. I simply want to subtract 30 from the value.
Any help would be appreciated
... View more
Labels:
- Labels:
-
Apache NiFi
05-06-2019
05:18 PM
Good Afternoon, I am creating an apache nifi flow in which I want to flow files from Oracle DB to IBM/DB2, I have completed that part of the flow. I need help with configuring a way to reconcile failed files, I want to know exactly which files failed and the error which caused it. I'm considering using a PUTHDFS to put the failed files into a HIVE TABLE that way I can capture the flow file error. I would then re-enter the failure files back into the flow via GETHDFS. So, I'm curious is this possible? Also is there a mechanism in NiFi to identify the singular file that fails in a batch?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
04-19-2019
03:58 PM
so how would I do the 2nd one? I tried the first one but it put "Null" into all the rows in the destination table.
... View more
04-19-2019
01:28 PM
Hey, I'm receiving a special character error in Apache Nifi, I have 4 columns that could be causing it: UCR_COST_IN_$, ACTUAL_COST_IN_$ or REQUESTED#, ASSIGNED# any help or solutions would be greatly appreciated!
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache NiFi