Hi Team, I want to achive the below mentioned transformation in Nifi. using any processor. Please help me to get this done. sample input: { "date": "35 days 11:13:10.88", "key1": "value1", "keyToBeMapped1": "hostname.com", "key2": "value2", "key3": "value3", "key4": "value4", "keyToBeMapped2": "High Paging Rate", "key5": "PAGING", "keyToBeMapped3": "A high paging activity has been detected on host abc.lab.com. This could mean that too many processes are being run", "Entity OID": "keyToBeMapped1", "Parameter": "keyToBeMapped2", "Description": "keyToBeMapped3" } Expected Output: { "date": "35 days 11:13:10.88", "key1": "value1", "keyToBeMapped1": "hostname.com", "key2": "value2", "key3": "value3", "key4": "value4", "keyToBeMapped2": "High Paging Rate", "key5": "PAGING", "keyToBeMapped3": "A high paging activity has been detected on host abc.lab.com. This could mean that too many processes are being run", "Entity OID": "hostname.com", "Parameter": "High Paging Rate", "Description": "A high paging activity has been detected on host abc.lab.com. This could mean that too many processes are being run" } Regards, Priyanka ... View more

Hi Team, I am using HandleHttpRequest to receive data in Nifi (version 1.23.2), and number of nodes in a Nifi cluster is 3. Now, there are possibilities of receiving data on load-balancer which is distributing load in round-robin way. My requirement is to count the total number of events in a min on the cluster. How to achieve that? My current flow: haldleHttpRequest --> MergeRecord (bin age is 1 min) --> calculateRecordStats (to get count) But my current flow is counting the number of events received by a node in a min not the total number of received data in a cluster in 1 min. Please suggest.   Regards, Priyanka Mondal ... View more

Hi, I have gone through multiple community support link, where it is mainly saying  to start cluster, say, 50MB/s And 1000 events/sec sustained throughput for average Flow is: 3 nodes each with: CPU: 8+ cores (16 is preferred) Memory: 8+ GB Disk: 6 disks, each 1TB disks (could be spinning or SSD) Referred link: https://community.cloudera.com/t5/Community-Articles/NiFi-Sizing-Guide-Deployment-Best-Practices/ta-p/246781 My Nifi (version 1.23.2) cluster maintaining below hardware configuration, where Disk is a concern in my environment. Only one disk and all the repository is using the same default Nifi configuration. What will be expected throughput in these case ? 3 nodes each with: CPU: 8+ cores (16 is preferred) Memory: 8+ GB Disk: 1 disk of 500GB (could be spinning or SSD)   5 nodes each with: CPU: 8+ cores (16 is preferred) Memory: 8+ GB Disk: 1 disk of 500GB (could be spinning or SSD)   7 nodes each with: CPU: 8+ cores (16 is preferred) Memory: 8+ GB Disk: 1 disk of 500GB (could be spinning or SSD) ... View more

Hi, I am using 3 node NiFi (Version: 1.23.2) cluster. If a node goes down, it is known that the flow can be directed to another node, but what about the data that is queued in the failed node? Is there anyway to replicate the data from failed node to other node? or will have to wait until the node comes back up? Please explain how to handle this scenario. ... View more

Hi, I have 3-node Nifi cluster using self signed certificate. and that is working fine. Now I want to run these 3 node Nifi UI (port 8443) behind Load Balancer. The changes I have in nifi.properties file is:   nifi.web.proxy.host=localhost:8443,nifiinstance-group-1:8443,<load-balancer>   All Nifi UI has same credential. and loadBalancer is using HTTP connection. Now, Nifi UI is coming up, but while passing the credentials it is throwing error:     there is no such error in nifi logs: 3X.XX.XX.XX - - [28/Dec/2023:11:03:12 +0000] "GET /nifi/ HTTP/1.1" 200 21126 "http://3X.XX.XX.XX/nifi/login" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36"   Please guide me with the root cause if this problem and how to solve this? ... View more