@Abdelkrim Hadjidj Thanks a lot appreciate you help! ... View more

The problem was because of iptables. I turn off it and it works with NAT (port forwarding) ... View more

Thank you very much. The Ranger audit was helpful to understand what's happening. My API policy was not correct. ... View more

Thanks for replying @Abdelkrim Hadjidj @Matt Burgess. Now I have two different schemas for input and output CSV for LookupRecord. I modified Result RecordPath to /COMPANY. When I start LookupRecord it takes in 6 flow files but doesn't return anything. ... View more

Hi @Ranith Ranawaka In your screenshot you are using 'equals' as a condition rather than 'lt'. Make sure to use the right relation. Also, you need to add the attribute maxTimestamp to the flowfile. ... View more

Hi @Abdelkrim Hadjidj I tried the same the thing and what it does in the count attribute the value is not getting reset to 0. In fact when you check view state of Update attribute a new "count" attribute is being generated with its value 0 whereas the previous count attribute keeps on increasing whenever it receives a flow file. 11.jpg1.jpg2.jpg5.jpg6.jpg I'm using HDF - Nifi 1.5 Thanks fffI I t ... View more

@Arullaldivakar Jayapalan For 1, I think you can use Rules feature of UpdateAttribute : https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-update-attribute-nar/1.4.0/org.apache.nifi.processors.attributes.UpdateAttribute/additionalDetails.html You can for instance add a rule to compare between current date (now(YYYYMMDD) and the one stored in the state. If it's different, set seq to zero. You can have three attributes for instance Date Seq Filename which is a concat of the two For storing (date,max), I think the best is to use an external data store (MySQL for instance) and use NiFi to store the correct values. NiFi is not meant to keep data ... it's a data mover like DHL. Please let me know if you succeed in implementing this. Thanks ... View more

Sorry. I have read MergeContent documentation and realized my mistake. Thank you! ... View more

Hi @Matthew Gaetano There's another feature in the UpdateProcessor that you can use which Rules : https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-update-attribute-nar/1.4.0/org.apache.nifi.processors.attributes.UpdateAttribute/additionalDetails.html This feature is available in the advanced settings and you can use to define conditions and actions. So you can say if condition than update timestamps, else do not. Look at my answer to this question to see how you can use it : https://community.hortonworks.com/questions/140060/nifi-how-to-load-a-value-in-memory-one-time-from-c.html?childToView=140233#answer-140233 ... View more

But I didnt manage to extract .tar nor .zip files with CompressContent. I have many different files (.tar.gz, .tar, .zip ...) which should all be decompressed/extracted at the end. I thought first of all I get to know all .gz files to decompress them (see first two processors in my screenshot), after that I want to extract all other files (.tar and .zip) what happens in the following two processors. For example: Getting an 'test.tar.gz', decompressing it to 'test.tar' and extracting it to 'test' afterwards. ... View more