Hello everyone, I'm trying to configure Log4j for HDFS Namenode and Security Audit logs. In either way Size based rotation or Daily Rotation I should be able to rotate and delete the logs. However It is not working as expected. Can someone send me the best configurations in Log4j for HDFS NN/Audit Logs.Attaching the Log4j configurations . log4j.txt Help me to delete the logs once it reached 10 Days .I would like to Gzip the older files. Please find the below screenshot for the size consumed on the disk We would like to remove Logs based on Size for Audit logs . ... View more

Hello, We are trying to handle Inserts/Updates/Deletes in Nifi . Currently attached the flow which is taking longer time to process the records and inserts into Hbase . I need to use Compositeprimarykey(ServerSerialno,ServerName) .Based on the CompositeKey will do the Inserts/Updates/Deletes.Need to boost the performance by altering the flow/configs.Kindly assist me to use the right flow to achieve this. Attached the flow . ... View more

Hi I need to load the JSON data into HBASE on the below conditions . If the record(composite primary key)(servername+serverid) is matched then update/delete the record , If not matched Insert the record. How Can I do this in Nifi with Hbase for larger dataset. forecasted data size would be 50-100TB approx for the next one year. optional if at possible , I need to discard the invalid entries from JSON on the flow using regular exp . Where I need to discard the entries and those discarded values creates empty space . Kindly let me know how to remove those empty space after removing the blank values. If possible How to avoid JSON breaking into bad values . I couldn't find good tutorial to Insert/Update in HBASE. Attached sample data test.txt ... View more

I'm currently trying to remove the blank line after discarding the lines in Nifi Removing those lines in Nifi {"eventType":"delete","ServerSerial":"0","ServerName":"","deletedat":"2018-08-24 17:56:34.944"} Since the serial number is 0 and empty servername . After removing there will be a blank space created in the final output file I want to replace the blanks space "eventType":"delete","ServerSerial":"1556562030","ServerName":"XYZ_U_O","deletedat":"2018-08-24 17:56:39.974"} {"eventType":"delete","ServerSerial":"0","ServerName":"","deletedat":"2018-08-24 17:56:34.944"} {"eventType":"delete","ServerSerial":"0","ServerName":"","deletedat":"2018-08-24 17:56:34.944"} So I'm currently using ReplaceText to search for the value : {"eventType":"delete","ServerSerial":"0","ServerName":""[^}]+},? and replacing with empty spaces . It failed to remove the blank lines Replaced with ^[ \t]*$\r?\n --> Failed to remove . Replaced with \r\n --> Failed to remove . Replace value is not considered the regex value . What shall I do . How can i replace blank lines after removing the lines based on the Search value. ... View more