Member since
07-30-2019
925
Posts
196
Kudos Received
91
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1141 | 10-05-2021 01:53 PM | |
14971 | 09-23-2019 06:03 AM | |
5847 | 05-04-2019 08:42 PM | |
1228 | 06-11-2018 12:45 PM | |
11014 | 06-04-2018 01:11 PM |
07-17-2017
08:44 PM
@sunile manjee Just chain multiple append operations in the same UpdateAttribute processor like:
... View more
07-06-2017
05:27 AM
Thank You mkalyanpur for ur response and i will try
... View more
07-05-2017
06:48 PM
@Bharadwaj Bhimavarapu General guidance here is these values should be set to 2 times the number of available cores and no more then 4 times the number of available cores on a single instance of NiFi. If you are running a NiFi cluster, these values are enforced per node. So a setting of 16 in a 4 node cluster equates to a total of 64 threads cross the cluster. Setting values to high just results in many more threads in cpu wait and will not help performance at all. Beyond increasing these value you need to be mindful of how many concurrent task you assign each of your processors. Some processor are more cpu intensive then others (meaning they take longer to complete a job holding the thread much longer). You can look at the "tasks/time =: stats on a processor to see if it thread are long or short running. For processors that have long running threads you want to be extra careful on how many concurrent tasks you assign them. Thanks, Matt
... View more
06-08-2017
08:19 AM
Hello @rian amrodin
As @Wynner suggested, you should be able to route FlowFiles based on file size using 'gt()' EL function. However surprisingly, ListFTP and ListSFTP doesn't write 'file.size' attribute where it's supposed to do.. I submitted a JIRA NIFI-4041 and a fix for that. I hope it will be merged and available soon. Thanks for sharing your experience with Apache NiFi! https://issues.apache.org/jira/browse/NIFI-4041
... View more
05-25-2017
02:22 PM
Please take a look at @Matt Clarke's response above on how to extract csv files only. It is the most straight forward way.
... View more
05-19-2017
06:14 PM
@Prakash Ravi There are only three processors which require a Distributed map Cache server: DetectDuplicate, FetchDistributedMapCache and PutDistributedMapCache. The rest will use zookeeper were applicable. To clear the state of a processor, just do the following steps Right click on a processor, select View state from the menu Then just click Clear state and the files will be listed again.
... View more
05-19-2017
12:36 PM
@Muhammad Umar What is the OS of the system? How is the partition mounted, xfs, ext4? Is this a VM or a bare metal server? What is returned when you run the command "mount"?
... View more
05-21-2017
10:15 AM
@Wynner I resolved my issue because in fact i have 3 environments, and i was ponting the listProcessor to the wrong environment. I have my local file system Windows 8.1, with VirtualBox, running CentOS 7, and on top of CentOS i have the sandbox, and i was pointing my folder to the CentOS layer. My /media/sf_SharedFolder was placed in CentOS and not in sandbox.
I have to thank you for your help.
... View more
06-27-2017
05:18 PM
@Akash S The optimum value for Maximum Timer Driven Thread count will be based on the number of CPU's your system has. Roughly we recommend between 2 and 4 times the number of CPU. So, if your system has 8 CPUs, assuming it isn't bear metal, then your max timer driven threads can be between 16 and 32. If you have a bare metal system, then you will have more room because of hyper-threading, so the values could be between 32 and 64. The Event Driven thread value can stay at 5, NiFi will not need more than that, no matter how many processors there are on the graph.
... View more