question Re: NiFi memory leak on Production in Archives of Support Questions (Read Only)

NiFi memory leak on Production

ilyal — Sun, 29 Jul 2018 20:02:47 GMT

Hi All,

We set jmxremote and saw what NiFi has a memory leak. GC can not clean located memory, and after 2-3 days NiFi starts to work strange(all the time tries switch primary, monitoring API does not answer).

We made the update of HDF from 3.0 to 3.1.

Our environment is production, therefore we are limited for actions.

In our flow, we use all standard processors and one ExecuteScript (ECMAScript)

Java8

If you know how to search leak source or have any idea how to search we will be grateful.

Thanks,

Ilya

Re: NiFi memory leak on Production

hmatta — Sun, 29 Jul 2018 20:44:02 GMT

@Ilya Li If you have nifi ranger plugin enabled, then memory leak is due to nifi ranger authoriser.

Jira: https://issues.apache.org/jira/browse/NIFI-4925

Re: NiFi memory leak on Production

ilyal — Sun, 29 Jul 2018 22:05:05 GMT

@hmatta Thanks for your answer. We user ranger plugin. If we user HDF 3.1.1.0 what should we do for resolving? Is it enough update to 3.1.2.0?

Re: NiFi memory leak on Production

hmatta — Mon, 30 Jul 2018 00:15:35 GMT

@Ilya Li

Yes upgrading to HDF-3.1.2.0 will solve this issue and few other issues of HDF-3.1.1. Please accept the answer if you find it appropriate.