Member since
03-26-2018
110
Posts
10
Kudos Received
7
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 12302 | 06-24-2020 09:21 PM | |
| 9196 | 05-20-2020 06:12 AM | |
| 2518 | 02-25-2019 12:39 AM | |
| 6628 | 02-21-2019 11:33 AM | |
| 2041 | 02-21-2019 11:16 AM |
07-07-2020
06:25 PM
1 Kudo
Thanks @stevenmatison for your response on this
... View more
06-24-2020
09:21 PM
Hi All , I fixed this by changing the source URL to jdbc:mysql://127.0.0.1:3306/source . I still need to understand the reason as to why it works this way when both the applications are installed on the same linux box . Also to note that in my case I have this linux installed on a VM on Google Cloud Platform I will work on it and post the reasoning for reference. Thanks
... View more
06-24-2020
06:24 PM
Hi Team , I am having issues while connecting to mysql database using apache nifi. The error is as follows Cannot create PoolableConnectionFactory Please note that Apache Nifi and MySQL is installed on the same Linux server and hence there shouldn't be any problems with the 2 applications talking to each other. The database connection pool settings is provided below The error when I try extracting the records is provided below This is something very urgent as we are doing a POC and if this succeeds our Projects will be based on this. Any help in this regard will be much appreciated. @Matt @Shu
... View more
Labels:
- Labels:
-
Apache NiFi
05-20-2020
06:12 AM
Thanks , enabling the GIGC has helped along with reducing the Heap JVM settings in the bootstrap conf file. Thanks again
... View more
05-16-2020
11:13 PM
Hi Team , I need some advice on how to tune our Nifi Cluster. We have a 3 Node Nifi Cluster that processes events in a real time streaming fashion which means our flows are running 24 by 7 . Each of the Nifi Linux servers have a RAM of 31GB. We have set the JVM memory setting in the bootstrap conf file to 28 G. #JVM memory Settings java.arg.2=-Xms28G java.arg.3=-Xms28G However when I run a free -h command on the servers this is what I get which clearly shows that the used Memory is 30 G. As a result of this , we keep getting incidents raised from the Linux team stating that the Nifi servers are always hovering over the 95 % mark and on top of that if any processor in the flow starts misbehaving , it shoots up to 100 percent and the server goes unresponsive. So my question is , even after setting the threshold to 28 G in the bootstrap conf file , why do we still see Nifi taking up almost all the memory allocated to the server ? @Matt
... View more
Labels:
- Labels:
-
Apache NiFi
04-30-2020
02:07 PM
Thanks for the revert mate. Much Appreciated.
... View more
04-29-2020
08:47 PM
Hi , Thanks for the revert . I just did the same last night by taking up the NAR file from the previous Nifi version and placing it in the lib directory of the current Nifi version . I then went for the restart and then could see the processors. However , this I believe this isn't right and every new version should be backward compatible . Yes , there can be a new flavor of a processor i.e. a few more properties here and there but not having the processor at all in the new release is actually not acceptable as it can break your existing flows . It has caused us a lot of headache as our process runs in real time . Because of this there was an outage of almost a day as it took us some time to figure out the cause and then come up with a solution . Is there a tech support where this can be put up so that subsequent releases should have backward compatibility .
... View more
04-28-2020
09:04 PM
Hi Experts. We recently upgraded our Nifi Version from 1.9.2 to 1.11.4 however many of our flows arent working as some processors arent available in the new version. One of them being the "Infer Avro Schema" . I am not sure why this should be the case as every new release should be backward compatible. Is there a way to restore this processor onto the latest version as our code is impacted. We can also see that this has been an issue and raised separately as well. Please find the link here http://apache-nifi-users-list.2361937.n4.nabble.com/GRPC-processors-missing-after-upgrade-to-1-11-3-td9161.html#a9166 cheers Abhinav
... View more
Labels:
- Labels:
-
Apache NiFi
04-18-2019
01:28 PM
Thanks Matt . We edited the flow.xml file and removed the reference to 1.4 Update Attribute bundle from it and used the edited flow file to start Nifi and the issue got fixed. No more ghost Update Attribute Processors. Thanks alot for all your help and detailed explanation on this,
... View more
04-10-2019
11:38 PM
Thanks Matt. I had a look at the flow.xml file and could see some multiple bundled up versions of the update attribute processor . There was no mention of the custom processor though however we had multiple versions like 1.4 and 1.8. Is there a possibility that we could tweak the flow.xml file and remove these old instances and get the flow.xml uploaded ?
... View more