Member since
11-17-2021
1128
Posts
256
Kudos Received
29
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2895 | 11-05-2025 10:13 AM | |
| 482 | 10-16-2025 02:45 PM | |
| 1040 | 10-06-2025 01:01 PM | |
| 821 | 09-24-2025 01:51 PM | |
| 629 | 08-04-2025 04:17 PM |
12-01-2023
08:57 AM
@Jisson I don't see ExecuteStream in the thread dump provided. Let's clarify first what you mean by "stuck"... When the processor is in this "stuck" state, does the processor indicate that it has an active thread? A NiFi processor will show a small number in its upper right corner when it has an active thread(s). Below example shows an ExecuteStreamCommand processor with "1" active thread: If your processor has no active threads, it is not stuck/hung. It is simply does not have a thread to execute the command. This could happen if all thread from the max timer driven thread pool in NiFi are already being used by other components. We would call this a thread starved processor. If your CPU load average is good, you could increase the size of the thread pool to see if that helps. NiFi out-of-the-box sets the "Maximum Timer Driven Thread Count" Pool to 10. You can change this from the NiFi Ui --> global menu (upper right corner) --> Controller Settings --> General tab. If your processor does show an active threads, i'd expect to see that thread in the thread dump. Also keep in mind that a single thread dump is not very useful. A thread may not be HUNG, but rather long running for example. So getting a series of thread dumps spread out to compare would allow you to see if the thread stack is changing over time indicating not hung but slow. In the case of your ExecuteStreamCommand processor, it is calling a custom python script and the waits for the return from that script. Then comes the challenge is the thread dump indicates it is waiting on your python script return to figure out why your python scripts is hanging or taking a very long time all of a sudden. Not something that can be troubleshot through NiFi. Hope this helps you in your troubleshooting journey. If you found any of the suggestions/solutions provided helped you with your issue, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
11-30-2023
03:21 PM
@yan439, Im not sure I understand. I thought you have the schema already defined in the registry with the correct column names and data types. Can you elaborate more on how the avro schema came about and if its the same thing you are using the in the registry?
... View more
11-29-2023
04:39 AM
CHeck out this link @joseomjr shared in another post: https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0-M1 And here is a great blog from Pierre Villard: https://medium.com/cloudera-inc/getting-ready-for-apache-nifi-2-0-5a5e6a67f450 Nifi 2.0 brings python native, where jython was very limited library set.
... View more
11-24-2023
09:23 AM
@Ciho Welcome to the Cloudera Community! To help you get the best possible solution, I have tagged our NiFi experts @SAMSAL @cotopaul who may be able to assist you further. Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
... View more
11-22-2023
09:31 AM
@soychago hard-stop and restarting the agents are done already ...But still not abl to add the data node to the cluster.... i have added other 4 nodes , but this node i am talking about cannot be added to the cluster.
... View more
11-22-2023
08:37 AM
@MR_KD As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks.
... View more
11-22-2023
08:32 AM
@ntuveri Welcome to the Cloudera Community! To help you get the best possible solution, I have tagged our MiNiFi expert @bbahamondes who may be able to assist you further Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
... View more
11-21-2023
12:14 AM
Hi @DianaTorres, I have seen below error in the logs: ERROR: org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'ambari-qa' (action=create). After providing the permissions to ambari-qa in Ranger hbase policy, service checks has been completed successfully. RCA: ambari-qa user is the super user and should have sufficient permissions. Thanks, MR_KD
... View more