Member since
07-12-2017
53
Posts
3
Kudos Received
0
Solutions
04-09-2018
11:18 AM
Hi All, We have Nifi-1.1.1 installed on hdp 2.6.3, standalone instance. The UI has become very slow, it takes more than a minute to move between process-groups, also many a times while entering into a process-group the cursor returns back to the Nifi-Flow root window. Also CPU Usage goes to 500 % and memory usage to 10 percent when only 115 processors are running and rest (2k) processors are stopped. Could you please suggest some settings to improve the performance of UI : I have applied all settings in nifi.properties & bootstrap.conf files according to this article by @Matt Clarke: https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.html Server Disc Space Details: total used free shared buffers cached
Mem: 120G 73G 46G 40G 488M 43G -/+ buffers/cache: 29G 90G
Swap: 511M 0B 511M CPU Usage Details: PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 118806 root 20 0 19.7g 10g 103m S 455.0 9.0 559:31.81 java Canvas Details: (Is processor crowding can be issue for slowness?) 20385 Processors Stopped 2524 Disabled 115 Running @Matt Burgess,@Mark Payne,@Matt Clarke Please suggest solutions to improve nifi performance. Thanks in advance!!!!
... View more
Labels:
- Labels:
-
Apache NiFi
01-02-2018
05:57 PM
Thanks @Manchun Kumar , but i am unable to find post for this in the link you provided. could you please share the particualr link for ssl/TLS in Nifi-1.1.1 or above
... View more
01-02-2018
12:22 PM
@Matt Clarke
Hi Matt, i am trying to secure my nifi-1.1.1 instance using kerberos, i have set up the truststore, keystore in nifi home directory using nifi-tls-toolkit, also set the truststore and keystore passwords in the nifi.properties, provided kerberos-provider as the login-identity-provider. have set up the authorizers.xml with the same CN as i used in certificates. But after restarting nifi, the UI is not coming up, i am getiing "site can't be reached:refuse to connect error" , i also tried importing .p12 cert to my browser but that also didn't helped. could you please suggest what is wrong in the process i followed?
... View more
12-29-2017
01:02 PM
@Matt Clarke @brosander i am using kerberos as a login identity provider to secure nifi1.1.1 instance, could you please suggest do i need to provide two way ssl for this? or we dont need to do in Nifi-1.1.1, as it is no where mentioned in nifi administration guide to provide ssl certificates with kerberos. i am following this article: https://community.hortonworks.com/content/kbentry/34147/nifi-security-user-authentication-with-kerberos.html Thanks a lot in advance!!
... View more
12-01-2017
10:43 AM
@Andrew Grande I want to delete all templates visible in the Nifi UI under Templates tab how to do it? i dont want to delete it one by one from UI. Also in my Nifi setup my templates are not being stored in /home/nifi/conf/templates directory, so where are these stored by Nifi? please help!!
... View more
11-28-2017
09:33 AM
Hi All, I am also looking to join data from two flowfiles based on one common column. Reading above comments i got to know that sql joins for this kind of scenario are not available, can anyone suggest if there is any way provided by Nifi, may be i am not aware? Thanks in advance!!
... View more
11-14-2017
12:04 PM
Hi Matt, This was indeed a very informative post, i have a question: If "nifi.content.repository.archive.max.retention.period=12 hours" then is there any need to clean up content repository manually, will this add upt to nifi UI performance in terms of speed in procesing? Thanks
... View more
11-14-2017
09:12 AM
Hi Matt, Does Clearing flowfile & content repositories clears up state of the processors too?
... View more
11-09-2017
11:17 AM
@Abdelkrim Hadjidj Thanks a lot for your inputs into this, i will try this, i think this will surely solve my issue.
... View more
11-01-2017
01:20 PM
Hi, Thanks for the suggestion, but doing this thing for 5o flows is very time consuming, i was looking for an alternative if we can empty the queues of a particular Process group all at once, may be from nifi backend using some api?
... View more
- « Previous
- Next »