Hi @Raja Ray, Do you have logs from YARN node manager? ... View more

Hi @Smart Solutions The main reason I see is to distribute load in case you have a lot of clients connecting to the edge nodes. You could imagine a load balancer in front of your Knox instances to distribute the load with only one entry point for your clients. ... View more

Hi @Francis Apel I believe the information you are looking for is here: - https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.distributed.cache.client.DistributedMapCacheClientService/index.html You have links to three pages talking about distributed cache. In short it gives you the ability to have a map key/value to store information along your flow. The service is what you reference in some processors to link the processors to this map. Hope this helps. ... View more

Hi @Thierry Vernhet NiFi is using Java regular expressions. Personally, I am using http://regexr.com/ to check my regular expressions. ... View more

@jmedel I think you should answer your question with your answer and accept your own answer. It will mark the thread as answered and will help people to find relevant information when dealing with the same issue 😉 ... View more

Hi @jmedel, could you share the configuration of your MergeContent processor? Also, do you have files with the same name in multiple zip files? ... View more

Hi @Marco G, Probably not related but I think you need to point to both core-site and hdfs-site configuration files: "A file or comma separated list of files which contains the Hadoop file system configuration. Without this, Hadoop will search the classpath for a 'core-site.xml' and 'hdfs-site.xml' file or will revert to a default configuration." ... View more

Hi @sarfarazkhan pathan, It looks like you are trying to install HDP on nodes where there is an already existing installation. What is the status of the nodes you are using? If you can, it would be easier to start over the installation from clean/fresh nodes. ... View more

Yes you are absolutely right: you have the original source of a split within the attributes. In fact I'd say that it will be complex to handle a file that you split in rows if you want to perform some logic at file level with the rows. In this case, you want to split rows, and you need all the rows, to confirm a value of one single row. It is possible depending of your use case and using something like the distributed cache but it is easier with ExecuteScript (even more if you want to introduce some logic to reject or not the whole flow file). In short, it greatly depends of all the actions you want to perform along the flow and how you want to optimize I/O to meet performance expectations. ... View more