Member since
01-26-2022
82
Posts
2
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
702 | 09-08-2022 04:02 AM | |
1665 | 07-27-2022 03:29 AM | |
1228 | 06-28-2022 09:43 PM | |
1229 | 06-27-2022 08:42 AM | |
12749 | 06-16-2022 10:29 PM |
02-26-2024
08:27 AM
3 Kudos
@krishna123 @jameswookyz @rafy NiFi processor are configured with a Run Schedule, by default processors are configured with a Run Schedule of 0 secs. This tells NiFi core to schedule this processor to execute as often as possible. The Scheduling part of the processor handles checking if any of the inbound connections to the processor with queued data or last execution resulted in data. If there is no inbound queued FlowFiles, the NiFi controller will yield the processor scheduling. This yielding is designed to prevent the processor from just constantly trying to schedule when there is no work to do. If there is work to do, the processor will get scheduled to execute. The scheduling typically consumes microseconds of CPU time. And the built-in yielding prevents excessive cpu usage when no work exists to execute upon. Adjusting the run schedule does not change behavior of yielding, but when flow is constant for periods of time, changing the run schedule alters the throughput performance. Hope this clarifies things. If you found any of the suggestions/solutions provided helped you with your issue, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
09-13-2023
06:19 AM
I dont think you can use PutSQL for this. Try ExecuteSQL or you might have to use ExecuteScript processor as other posts suggest: https://community.cloudera.com/t5/Support-Questions/Does-ExecuteSQL-processor-allow-to-execute-stored-procedure/m-p/158922 https://stackoverflow.com/questions/72348844/get-output-of-stored-procedure-using-putsql-in-nifi If that helps please accept solution. Thanks
... View more
05-13-2023
03:41 AM
Thank you so much too. This also works. But i am actually a learner using Jolt.
... View more
04-19-2023
03:16 AM
Thank you sir @SAMSAL . I am very grateful, at the moment, your solution does the job. Also, i would love to learn JoltTransformation from you. Thanks once again.
... View more
03-21-2023
11:39 AM
@udayAle @ep_gunner When NiFi is brought down, the current state (stopped, started, enabled, disabled) of all components is retained and on startup that same state is set on the components. Only time this is not true is when the property "nifi.flowcontroller.autoResumeState" is set to false in the nifi.properties file. When set to false a restart of NiFi would result in all components in a stopped state. In a production environment, this property should be set to true. Perhaps you can share more details on the maintenance process you are using as I am not clear on how your maintenance is impacting the last known state of some components. If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped. Thank you, Matt
... View more
03-09-2023
08:49 AM
As @SAMSAL pointed out, queryrecord is the best and easiest method to use. Here, i have created a sample flow for your use as pix attached. I hope it helps.
... View more
10-14-2022
12:35 AM
Hello All, I would like to know if there is way i can send notification from Nifi to WhatsApp platform. Thank you.
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
09-28-2022
04:47 AM
Thank you all. I eventually evaluated the json path to extract the url. My mind was astray as i was using complex solution to a simple problem.
... View more
09-15-2022
12:45 PM
@rafy The ERROR shared seems unrelated to the action of emptying a connection queue. Are you trying to delete a connection or empty a connection queue? Can you share screenshots of the actions being performed? Can you collect the full stack trace produced in the nifi-app.log when you perform the action? Thank you, Matt
... View more
09-08-2022
12:41 PM
Hi All, Please can you kindly look into this issue i have with QueryNiFiReportingTask processor. PLATFORM: - WSL2 with Ubuntu 20.04 as OS - jdk-11.0.15 - NIFI 1.17.0 SCENERIO: I am trying to monitor all processors so as to know which one has stopped & sending notification through email sink. I configured gmail email sender appropriately. ISSUES: No email received & there was no error on the bulleting indicating failure. NOTE: I changed smtp to different ones but got errors. Also enabling ssl gives me error. Kindly find the pix below for my configurartions.
... View more
Labels: