Member since
03-26-2018
110
Posts
10
Kudos Received
7
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9740 | 06-24-2020 09:21 PM | |
6718 | 05-20-2020 06:12 AM | |
1768 | 02-25-2019 12:39 AM | |
4549 | 02-21-2019 11:33 AM | |
1487 | 02-21-2019 11:16 AM |
08-04-2021
06:23 PM
Hi @Shu_ashu We have an issue with our Consume Imap Processor. While this has been running good for the last 2 years , these days we see that we have an email that has an attachment that is of size 5 MB. The consume IMAP processor seems to take ages to read this file almost 3 hours . We have observed that if the attachment is less than 5 MB , the reading is quick however for 5 MB and greater it seems to get stuck. We have increased the JVM memory as well. Added Java tuning parameters to the bootstrap conf file . However nothing is helping. Can you suggest an improvement tweak here please
... View more
07-29-2020
08:36 PM
hey Guys , quick one. With the infer schema approach now being available , do we need to have the avro registry ?
... View more
07-29-2020
04:00 PM
Did you get a solution to this . I am also getting a communication error . My Nifi Instance and Mysql are on the same linux server .
... View more
07-07-2020
06:25 PM
1 Kudo
Thanks @stevenmatison for your response on this
... View more
07-07-2020
02:42 AM
Hi Friends I tried running the curl from my Linux session on which Nifi installed. This is a secured nifi instance . I got the forbidden error. Please see the error below -bash-4.2$ curl -i -X PUT -H 'Content-Type: application/json' -d '{"id":"e3d11d1d-327b-1b5b-96a7-3cb59c48df17","state":"RUNNING"}' https://XXXXX:8443/nifi//nifi-api/flow/process-groups/e3d11d1d-327b-1b5b-96a7-3cb59c48df17; HTTP/1.1 403 Forbidden Server: squid/3.5.20 Mime-Version: 1.0 Date: Tue, 07 Jul 2020 09:34:57 GMT Content-Type: text/html;charset=utf-8 Content-Length: 3347 X-Squid-Error: ERR_ACCESS_DENIED 0 Vary: Accept-Language Content-Language: en X-Cache: MISS from XXXXX X-Cache-Lookup: NONE from XXXX Via: 1.1 XXXXXsquid/3.5.20) Connection: keep-alive curl: (56) Received HTTP code 403 from proxy after CONNECT @Shu_ashu - can you please help me here sir. Is it that I need to specify the certs somewhere ?
... View more
06-24-2020
09:21 PM
Hi All , I fixed this by changing the source URL to jdbc:mysql://127.0.0.1:3306/source . I still need to understand the reason as to why it works this way when both the applications are installed on the same linux box . Also to note that in my case I have this linux installed on a VM on Google Cloud Platform I will work on it and post the reasoning for reference. Thanks
... View more
06-24-2020
06:24 PM
Hi Team , I am having issues while connecting to mysql database using apache nifi. The error is as follows Cannot create PoolableConnectionFactory Please note that Apache Nifi and MySQL is installed on the same Linux server and hence there shouldn't be any problems with the 2 applications talking to each other. The database connection pool settings is provided below The error when I try extracting the records is provided below This is something very urgent as we are doing a POC and if this succeeds our Projects will be based on this. Any help in this regard will be much appreciated. @Matt @Shu
... View more
Labels:
- Labels:
-
Apache NiFi
06-01-2020
04:24 AM
Hi Alim , thanks for this very wonderful post on using Nifi as CDC. Is there a provision in Nifi to use something similar for Oracle Database ?
... View more
05-20-2020
06:12 AM
Thanks , enabling the GIGC has helped along with reducing the Heap JVM settings in the bootstrap conf file. Thanks again
... View more
05-16-2020
11:13 PM
Hi Team , I need some advice on how to tune our Nifi Cluster. We have a 3 Node Nifi Cluster that processes events in a real time streaming fashion which means our flows are running 24 by 7 . Each of the Nifi Linux servers have a RAM of 31GB. We have set the JVM memory setting in the bootstrap conf file to 28 G. #JVM memory Settings java.arg.2=-Xms28G java.arg.3=-Xms28G However when I run a free -h command on the servers this is what I get which clearly shows that the used Memory is 30 G. As a result of this , we keep getting incidents raised from the Linux team stating that the Nifi servers are always hovering over the 95 % mark and on top of that if any processor in the flow starts misbehaving , it shoots up to 100 percent and the server goes unresponsive. So my question is , even after setting the threshold to 28 G in the bootstrap conf file , why do we still see Nifi taking up almost all the memory allocated to the server ? @Matt
... View more
Labels:
- Labels:
-
Apache NiFi