Member since
03-26-2018
110
Posts
10
Kudos Received
7
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9743 | 06-24-2020 09:21 PM | |
6721 | 05-20-2020 06:12 AM | |
1769 | 02-25-2019 12:39 AM | |
4550 | 02-21-2019 11:33 AM | |
1488 | 02-21-2019 11:16 AM |
04-08-2019
04:30 AM
Update Attribute processor Not working after upgrade from version 1.8 to version 1.9. We recently upgraded our Nifi Cluster from version 1.8 to version 1.9 and we were surprised to see the update attribute processor all going invalid for our existing flows. We had to manually fix the existing flow but this ideally should have been handled with the upgrade . Is there a way to overcome this ?
... View more
Labels:
- Labels:
-
Apache NiFi
02-25-2019
12:39 AM
1 Kudo
For now we set the nifi.queue.swap.threshold to 150000 and this seems to have done the trick. Loads are performing well and there is no build up of the queue. thanks all
... View more
02-24-2019
11:20 PM
Hi All, We have just productionized our Nifi flows which is a real time streaming application . We have a cluster of 2 Nodes and each node has 6 processors and a high memory of 28 GB. On the Nifi side the memory has been set to 24 GB. Moreover , we tend to see a queue size reaching to around 90,000 or more. For this I have set the property nifi.queue.swap.threshold to 90000 . We also have a disk space of 200 GB. Despite having such a powerful configuration , we still get flow file repository failed to update. I understand that initially the JVM memory is uitilized for the flow file processing and if that gets overused , it spills over to disk space . Our disk space is also pretty high at 200 GB however we still keep on seeing this error. Any pointers or suggestion in this space will be of great help.
... View more
Labels:
- Labels:
-
Apache NiFi
02-24-2019
06:54 PM
Hi Rishabh , did you try shutting down the nifi instances and start them one at a time ?
... View more
02-21-2019
11:33 AM
Got this fixed now 🙂 . Actually there is an extra line in the zookeeper.properties file which is right at the end and that line creates an issue . It just needs to be deleted and this will then work like a charm .
... View more
02-21-2019
11:16 AM
Ok , we managed to get the answer to this. If Minifi for some reason isnt able to transmit data to the Nifi server , the minifi content repository starts getting filled up and this needs to be avoided. So , we need to add some space to the filesystem that points to the content repository as a best practice in production.
... View more
02-21-2019
11:11 AM
Hi Rishabh , Have a look at https://pierrevillard.com/2016/08/13/apache-nifi-1-0-0-cluster-setup/ This one is really good . I have followed this although I am stuck . Waiting for Pierre Villard to respond
... View more
02-21-2019
04:51 AM
HI All , I have created 2 nifi instances on Google Cloud Platform. I now plan to bring them onto a cluster. However I am getting this error server.quorum.QuorumPeerConfig does not have the form host:port or host:port:port or host:port:port:type I have checked my zoo keeper properties file again and again but not sure whats the issue. My zoo keeper properties file is as follows . I am not sure as to why this issue is cropping up. My nifi servers are by the name nifi-server2 and nifi-server1 and ports are 2888 and 3888 . I have followed the documentation by Pierre Villard. server.1=nifi-server2:2888:3888 server.2=nifi-server1:2888:3888 # server.3=nifi-node3-hostname:2888:3888 Can someone please help me here.
... View more
Labels:
- Labels:
-
Apache NiFi
02-13-2019
09:54 PM
This is superb. I plan to do the same. Quick question , whats the version of the Minifi in the sense is it Java or C ++ . @Timothy Spann
... View more
02-12-2019
09:47 PM
Is there any progress on this as we are in 2019 now and this post is almost 3 years back . Is there an easy way to install Minifi on an Android Phone and then use it to transmit data
... View more