@Zack Riesland You would have to use ExtractText processor to extract the path and set it as an attribute of your flow file. Then you can use this attribute using expression language in the next processors. Let's say you extract .* to put it as attribute "mypath", then in following processor, for properties accepting expression language, you can reference this value using ${mypath}. Hope this helps. ... View more

Hi, It sounds like something really oriented for a specific case. Then I would try something custom to answer your specific need by using InvokeScriptedProcessor. For example, if you know that you have to wait for three flow files and that you have always only one "batch execution" at a time you could connect A to D, B to D, and C to D, D being an InvokeScriptedProcessor and use a code like: def flowFiles = session.get(3) if (flowFiles.size() != 3) return // my code here This way it will wait for your three flow files to be here, and once you have the three flow files, you can do whatever you want. Otherwise it may even be simpler to go for a custom processor. ... View more

Hi, No Apache NiFi is not running on YARN. It does connect with elements running on YARN such as Storm, Spark, Hive, Hbase, etc. Apache NiFi itself is running as an independent JVM process (or multiple JVMs in cluster mode). ... View more