Member since
04-09-2019
25
Posts
1
Kudos Received
0
Solutions
07-20-2022
08:40 AM
Hello All, I'm attempting to convert from a GetHDFS processor in apache nifi in anticipation of it being deprecated. I am going to use the ListHDFS instead yet when I set up the same inputs it is only returning the file path in a flow file and not actual folder content(files). Can anyone help with this? I'm just sourcing from a HDFS directory.
... View more
Labels:
- Labels:
-
Apache NiFi
12-12-2019
01:43 PM
Hey @Matt, I'm curious about the MonitorActivity how would the scheduling take on the changing of days in month? Like I want it to run on the 20th of each month, how would I configure that?
... View more
12-12-2019
10:05 AM
Hey, so I want to create a flow that creates a putemail trigger when NO files are present in a hdfs path for a certain date range:
my current flow is
GETHDFS->
ROUTEONATTRIBUTE(has the proper date matching criteria)
-->MATCHED(should be getting files here)
-->UNMATCHED(when this outputs zero I want to receive an email alert)
RouteOnAttribute Logic:
${Path:substring(0,6):equals(${now():toNumber():minus(86400000):format('yyyyMM')})}
Pretty much if I find no files within the current month(last 20 days) then I need to receive an email alert.
How do I get an alert when there are no files that fit the criteria?
@Matt
Thank you matt sorry for yet another question.
... View more
Labels:
- Labels:
-
Apache NiFi
12-11-2019
09:00 AM
Hello all, I am trying to get a rowcount from hdfs location, then depending on the number, send out an email to flag that directory.
So here is my flow: GETHDFSFILEINFO -> COUNTTEXT -> EXTRACTTEXT -> ROUTEONCONTENT -> PUTEMAIL
I need help with the EXTRACTTEXT configuration for this flow, here is the contents of the flowfile coming from the extracttext: { "objectName" : "**************", "path" : "************", "type" : "directory", "owner" : "***********", "group" : "hdfs", "lastModified" : "************", "length" : "5501268", "replication" : "0", "countFiles" : "38", "countDirs" : "6", "permissions" : "***********" }
So I am using the "countFiles" and want to just extract this value with the EXTRACTTEXT processor. Can someone please help me with the proper configurations?
@Matt
... View more
Labels:
- Labels:
-
Apache NiFi
12-10-2019
01:12 PM
I'm okay with writing over the content of the rest of the file. I'm trying to output the rowcount results in a putemail so I'm okay with overwriting the rest of the flowfile. Can you still help with this?
... View more
12-10-2019
10:45 AM
So it's part of the flowfile content. I attached the flow and the configs. Sorry for the confusion if I caused any I'm using a count
... View more
12-10-2019
09:14 AM
Hey Matt, thank you so much I've set up that flow but I'm having trouble on the actual updateattribute function I'm applying: ${COUNTFILES:minus(31)} I'm using this and it's not modifying the value. Could you please help?
... View more
12-09-2019
11:36 AM
Hello, I want to perform a simple mathematical operation on a json attribute. I simply want to subtract 30 from the value.
Any help would be appreciated
... View more
Labels:
- Labels:
-
Apache NiFi
10-29-2019
11:19 AM
Hello, I am curious if it's capable through scripting or another measure to start NiFi Processors/process groups in a specific manner. Any help or leads will be appreciated.
... View more
Labels:
- Labels:
-
Apache NiFi
10-21-2019
07:55 AM
Good Morning,
Is it possible to simultaneously clear the state of multiple processors? I have 108 different process groups and I want to see if there is a way to clear the state of the QueryDatabaseTable in each process group without manually going into each one and clearing it.
Any ideas/suggestions would be appreciated.
... View more
Labels:
- Labels:
-
Apache Hadoop