Member since
04-29-2021
6
Posts
0
Kudos Received
0
Solutions
05-13-2022
03:54 AM
I have a deleteHDFS after a getHDFS processor which removes files older than a certain time period. The getHDFS removes the file no problem, but what I have after is folders within folders that are empty, so I am using a deleteHDFS just after that, that uses the $path attribute - but I then need to specify the folder that contains that $path as I already told the getHDFS processor where to look to expire files - so I use a $custom_path attribute for where to look and add the $path variable to the deleteHDFS processor, but it only deletes the last folder. Is there a way to tell the deleteHDFS processor to delete the $path and keep the $custom_path? Currently in the deleteHDFS processor I have the Path set to: ${custom_path}/${path} and Recursive set to True.
... View more
Labels:
- Labels:
-
Apache NiFi
-
HDFS
09-21-2021
03:11 AM
Hello, I was wondering if there were any good templates out there that anyone has been successful with for getting Cisco ASA logs into Elastic, via Filebeat using Nifi. I am trying to get a steady amount of EPS but as there are so many individual files, I am being hampered by using a PutUDP connector - maybe there is a better way?
... View more
Labels:
06-30-2021
01:36 AM
Every now and then, one of my processors fills the bulletin board with connection error messages from a FetchSentinelData 1.5 processor. Is there a way to suppress only those messges or route them to an output file to prevent them from filling the bulletin board each time?
... View more
Labels:
- Labels:
-
Apache NiFi
05-07-2021
06:28 AM
Thanks, I tried something just like this yesterday, and it would work, but these logs don't have a file extension like what would be needed, (.gz) but I think I have an issue somewhere else, so will carry on trying to fix the overall issue.
... View more
05-06-2021
04:20 AM
I have identified that some of my Ranger logs are coming in in gz format (but without the extension). Is there a way of extracting the log data within the Nifi flow?
... View more
Labels:
- Labels:
-
Apache NiFi
-
Apache Ranger