I have a flow where we are receiving HTTP post request on Nifi cluster. I am using ListenHttp processor for the same. Once I receive the json payload I am splitting array of json into individual json objects (flowfile).
These individual jsons are then processed by series of downstream processors. (ETL)
But when we get a sudden spike of requests I see connector heading towards splitJson is growing in queue size. I can also see that CPU is in 20s for all nodes.
Attaching some screenshots of queue configuration and splitJson processor configuration.
How can I optimise the processing of this processor.
SplitJson propertiesConnection details1Connection details2SettingsFlow