Member since
12-02-2020
9
Posts
0
Kudos Received
0
Solutions
09-27-2023
04:00 PM
Hi Everyone, Can Anyone help us in fixing the issue: I have a flow where I am using control rate processor to control the data flow, I will submit tasks in druid using those files, for example let's say I have a total of 10 files. I will first ask my control rate processor to send 2 flow files to downstream, now I will submit those files as tasks in druid and fetch their status, if 1 task is running and another one is success I need to ask my control rate processor to send only 1 file, if 2 tasks are running dont submit tasks until they are completed, if 2 are success then send 2 files from control rate an counting the tasks which are running and adding them to an attribute,so is there a way that control rate processor takes the value of count attribute in Maximum rate property. I've checked the Rate Control Criteria property which can be set to Attribute Value but I am confused how to set the rate to attribute value.
... View more
Labels:
- Labels:
-
Apache NiFi
07-11-2023
07:02 AM
Yes, whenever we are seeing slowness increasing the concurrent tasks to 6 to 7 but still I am not seeing that much difference, at some time it will be better when increased concurrent tasks. This behaviour is mainly seen for Replace Text processor.
... View more
07-11-2023
04:08 AM
Hi Matt, Thanks for the inputs. Below are the Garbage Collection statics for our Environment of Nifi. Could you please check and let us know any tuning that can be done at this area to increase the performance.
... View more
07-06-2023
12:03 AM
Hi Matt, Thanks for sharing the insights. We are using 3 node cluster and each cluster having 16cores and we have set timer driven thread count to 160. And seeing core utilization as 8%. when we are getting huge data like 2 GB in one flow, the ingestion is becoming dead slow though increase in threads.
... View more
07-05-2023
07:29 AM
Hi Team, We are facing Nifi performance issues form a while as we increased no of processors and processor groups. We have increased thread count but still facing the issue. CPU utilization is also not reaching minimum level it is utilizing less than 50%. How to increase the performance in Nifi. We have been using 13.2 version till now and migrated to 18.0 to see if there is performance improvement but still facing the same. Could anyone suggest how to improve performance.
... View more
Labels:
- Labels:
-
Apache NiFi
05-11-2023
07:05 AM
I need to convert timestamp value coming in flowfile of cst/cdt time or anytime to UTC in nifi . But I am unable to convert it is not working. Can anybody help on this
... View more
Labels:
- Labels:
-
Apache NiFi
01-04-2023
09:14 AM
Hi Team, We are trying to enable logging at each processor group level. But we are unable to do it. From nifi-app.log we are getting as a general but we need log for each processor in a processor group level. We cannot use bulletin as well as bulletin will stay only for 5 min interval. Can anyone can help achieving it.
... View more
Labels:
- Labels:
-
Apache NiFi
12-02-2020
03:49 AM
Connection Failed. Unable to retrieve any resources using given parameters. Status Code = 403 Unable to retrieve any resources using given parameters.I am unable to set /resources policy also.
... View more
Labels:
- Labels:
-
Apache NiFi
-
Apache Ranger