Member since
07-30-2019
3133
Posts
1565
Kudos Received
909
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
158 | 01-09-2025 11:14 AM | |
894 | 01-03-2025 05:59 AM | |
441 | 12-13-2024 10:58 AM | |
497 | 12-05-2024 06:38 AM | |
392 | 11-22-2024 05:50 AM |
12-06-2016
02:55 PM
6 Kudos
@kumar The default FlowFile attributes include: entryDate
lineageStartDate
fileSize
filename
path
uuid
The above FlowFile attribute key names are case sensitive. Thanks, Matt
... View more
11-30-2016
06:02 PM
@Simon Engelbert You don't need the listFile to use the FetchFile processor. The FetchFile processor also needs an input file to trigger.
... View more
11-30-2016
03:34 PM
The RPG can be used to redistribute the ingested data of a single node using teh primary node strategy mentind here across every node in your NiFi cluster. This is a great way to distribute the work load while ensuring each node is working a unique set of FlowFiles.
... View more
11-30-2016
03:26 PM
2 Kudos
@Sean Murphy Each Node in a NiFi cluster runs its own threads within its own processor working on its own set of FlowFiles. Nodes in a NiFi cluster have no knowledge of what FlowFiles are being worked on by other nodes. If you are seeing multiple copies of the same output, that suggest that each node in your cluster is processing the same files. I am not sure how your dataflow is designed to ingest the data it works on, but ideally you want to design it in such a way to prevent each node from ingesting the same data/files. Thanks, Matt
... View more
11-28-2016
11:40 PM
1 Kudo
@Mothilal marimuthu The documentation for installing the latest HDF release can be found here: http://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.0.1/index.html Thanks, Matt
... View more
11-28-2016
07:41 PM
1 Kudo
@Mothilal marimuthu Those processor were not introduced until Apache NiFi 1.0 / HDF 2.0. You screen shot shows you running NiFi 0.3 / HDF 1.1.
... View more
11-28-2016
07:08 PM
The bootstrap port has nothing to do with the web UI port. Please take a look at the nifi-app.log for the cause of the shutdown.
... View more
11-28-2016
07:06 PM
@Sanaz Janbakhsh You should see why NiFi shutdown in either the nifi-bootstrap.log or the nifi-app.log.
... View more
11-21-2016
08:53 PM
Very possible it is related to that bug. With regular queues in excess of the swap threshold of 20,000 FlowFiles, swapping will occur. It is a bug in that swapping that can result in those swapped FlowFiles not getting removed from the content repo. This bug continues to occur until eventually you run out of disk space. On restart all that "orphaned" FlowFile content is then removed because their are no FlowFiles referencing that content anymore. Matt
... View more
11-21-2016
08:39 PM
@Philippe Marseille Apache NiFi 1.1 should be going up for vote very soon..
... View more