About joseomjr

Elnozy · ‎01-10-2024

Hello, Here is the threaddump of last restart of node 2304. We took a threaddump every 5 minutes: threaddump I notice only "Cleanup Archive for contentX" that seems take more than 5 minutes for some content repo. Don't know if this cleaning can be a blocking point. And maybe I'm missing something on the interpretation of threaddump. I take also some screens of the cluster view to check if there is more usage of the 2 bad nodes (2304 and 2311). The 2 nodes has 40GB more flowfiles (6% of usage instead of 5% for others): Screen cluster Nifi is clustered and we have three zookeeper server nodes dedicated for Nifi. Do you know how we can check zookeeper actions: election of the Cluster and Primary role? Thanks for your help Best Regards

MattWho · ‎01-04-2024

@arutkwccu The Apache NiFi 2.0.0-M1 release notes have now been updated with a list of nars that have been moved to the Optional Build Profiles. https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0-M1 Thank you, Matt

arutkwccu · ‎01-02-2024

Thank you for the advisement. I understand what you are saying.

MattWho · ‎01-02-2024

@benimaru It is important to understand that NiFi does not replicate active FlowFiles (objects queued in connection between NiFi processor components) across multiple nodes. So in a five node NiFi cluster where you are load balancing FlowFiles across all nodes, each node has a unique subset of the full data received. This if node 1 goes down, the FlowFiles on node 1 will not be processed until node 1 is back up. 100% agree with @joseomjr that placing an external load balancer in front of the ListenUDP endpoint is the correct solution to ensure high availability of that endpoint across all your NiFi nodes. If you found any of the suggestions/solutions provided helped you with your issue, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt

Sadhana21 · ‎01-01-2024

Your input means a lot, and I appreciate your assistance @DianaTorres, @SAMSAL and @joseomjr. Thank you all for sharing your knowledge and insights!

MWM · ‎12-29-2023

Hi @SAMSAL your solution is workink, thank you so much!

joseomjr · ‎12-28-2023

Agree with @SAMSAL's approach and if you can provide a parameter or something in the header or request so your API returns a JSON response each time it'll make things a lot easier for you to parse and build the request for the next step in your flow.

ckumar · ‎12-28-2023

Looking at the thread, Ans is No, that's not the way NiFi Processor is meant to handle relationships, The Client Processor has to initialize /start properly with the given configuration then only it can try to write and then based on the write results flow files can be routed to failure or success, Here Processor can't even start properly.

Rohit1997jio · ‎12-12-2023

disconnect and reconnect again this functionality i want to achieve with Publish kafka processor . ConsumerKafka will consumer continuously .

SAMSAL · ‎12-12-2023

Can you post screenshot of the UpdateRecord processor configuration? Also you have to be careful with the provided input because there is an extra comma after last Garry value which makes the json invalid.

Online	Offline
Last Visited	‎12-17-2024 09:55 PM

Member Since	‎06-14-2023 12:02 PM
Last Visited	‎12-17-2024 09:55 PM
Posts	95
Kudos received	33

Cloudera Community

Re: Nifi 2.0.0 M1 Installation error with python

Re: how to replace empty string with null in neste...

Re: ListenUDP Fault tolerance

Re: terminating kafka connection if publish kafka ...

Re: unable to resolve class groovy.yaml.YamlSlurpe...

Re: Nifi - 2 nodes of the cluster take very long t...

Re: possible bug missing parquetreader version 2.0...

Re: nifi 2.0 bug with InvokeHTTP procdessor

Re: ListenUDP Fault tolerance

Re: Preparing nested JSON using SQL in NiFi

Re: how to replace empty string with null in neste...

Re: Request for Support with Passing Request Body ...

Re: PublishKafkaProcessor , request is not going t...

Re: terminate kafka connection if publish kafka pr...

Re: Avro to Json adding extra delemeters