Hoping you might be able to point me in the right direction.  If I'm experiencing this same error and "cat /proc/sys/fs/file-max" is reporting 3136547 "over 1 million" what would you suggest?  When I run "ls /proc/<PID>/fs/" on the Nifi "Process ID" it reports back a low and high limit of 4096.  Does this mean that my Nifi process is limited to 4096 open files at a given time?  I'm wondering whether the problem is that the limit is just to low or more of a Nifi issue that its failing to close files at a faster rate. ... View more

@Winnie Philip if you are persisting some small datasets like tens of MB's should be good.If you are trying to cache some big dataset(couple of hundred MB's) then you need to increase the Max cache entry size in PutDistributedCacheMap processor. In DistributedMapCacheServer service configure Persistence Directory property value, If the value specified, the cache will be persisted in the given directory; if not specified, the cache will be in-memory only. By specifying directory we are not going use memory to cache the dataset. Also you need to increase Maximum Cache Entries property in DistributedMapCacheServer according to number of cache entries you are trying to keep in cache. ... View more

Thank you, Shu. This worked perfectly, thanks for the additional info as well. ... View more

Thanks Tim. NiFi Flow worked with HDF version of NiFi. ... View more

Thank you Sridhar! ... View more

Thanks so much Jay! My problem is fixed. After fixing JAVA_HOME path, I stopped ambari-server and edited ambari-server.property file to reflect the new java_home path, and restarted. After that I was able to start datanode etc. Thanks again for helping me today!!! ... View more

@Winnie Philip Great you got a solution for that, now you have to accept the best response as a reward to the HCC member this ensure that members are motivated to help . ... View more