Member since
01-11-2016
355
Posts
230
Kudos Received
74
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
7829 | 06-19-2018 08:52 AM | |
2960 | 06-13-2018 07:54 AM | |
3398 | 06-02-2018 06:27 PM | |
3597 | 05-01-2018 12:28 PM | |
5076 | 04-24-2018 11:38 AM |
03-29-2018
06:25 PM
2 Kudos
@Vincent van Oudenhoven You need to go to the hamburger menu at the top right of the UI, click on template, and delete the template that you added at this process group level.
... View more
03-29-2018
09:12 AM
Ok so maybe you don't have enough flow files to create a new merged flow file. The decision to merge is based on two things : age of the bin and number of record. Do you have 1000 records going through the merge? if no try to set a short Max Bin Age to force the process to do the merge.
... View more
03-29-2018
09:02 AM
@Vivek Singh when you say "multiple csv are generate" do you mean that no original csv is merged? you have X input flow files to MergeRecord and you get X out put? are they going through the success relation? I can see that you have flow files in the "original,failure", do you get errors ?
... View more
03-29-2018
08:22 AM
1 Kudo
Hi @Vivek Singh Have you tried by setting a blank "Correlation Attribute Name" ? As you can see from the doc, this attribute is used to gather files having the same value in this attribute, so having the same filename which leads to the behavior your are seeing If specified, two FlowFiles will be binned together only if they have the same value for this Attribute. If not specified, FlowFiles are bundled by the order in which they are pulled from the queue.
... View more
03-25-2018
05:48 PM
1 Kudo
Hi @Chris Dan Please keep in mind that Flow Registry is the beginning of FDLC in NiFi and an important building block on which several services will come. If you want to export a flow from the registry to backup it somewhere you can either use: NiFi Toolkit: part of NiFi project. https://issues.apache.org/jira/browse/NIFI-4839 Nipyapi: a community feature. As Tim suggested, you case this tool also and follow his excellent article. Today, the flow registry has a file storage provider. Flow registry supports plugins and new storage providers such as Git will follow in my opinion. Thanks
... View more
03-24-2018
10:05 PM
1 Kudo
Hello @Joe Harvy The Atlas reporting task requires building NiFi with a specific profil. If you downloaded NiFi from Apache site, it's normal that the reporting task is not available. You have 2 options:
Use NiFi from HDF that already has this reporting task Download NiFi code from Apache and rebuild with the Atlas profil using the following command mvn clean install -Pinclude-atlas -DskipTests
... View more
03-23-2018
06:00 PM
Hi @Jayendra Patil Any feedback on your issue ?
... View more
03-23-2018
01:36 PM
Hi @Mark Lin What you can do also to manage duplicates is to set a ControlRate with an expire duration for the connection before the ControlRate. This way, you let only when Flowfile goes through each X amount of time, and other FlowFile get stuck in the connexion and deleted automatically. However, to this to work, you should separate your messages before and not route all event to the same ControlRate otherwise you will have 1 notification whatever the issues are. I hope this helps Thanks
... View more
03-23-2018
07:52 AM
2 Kudos
Hi @Pramod N Several NiFi examples are available https://cwiki.apache.org/confluence/display/NIFI/Example+Dataflow+Templates One of them is what you are looking for : https://cwiki.apache.org/confluence/download/attachments/57904847/Hello_NiFi_Web_Service.xml?version=1&modificationDate=1449369797000&api=v2
... View more
03-22-2018
08:47 PM
Hi @Mark Lin When I develop, I use a funnel to see what's happening in my flow. Also, you can use UpdateAttribute with adding any attribute. I think these two don't have much impact on resources usage. Funnel: A funnel is a NiFi component that is used to combine the data from several Connections into a single Connection.
... View more