Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

JsonQueryElasticSearch reads same data from elastic

avatar
Explorer

@mburgess --I am using JsonQueryElasticSearch  to fetch data from elastic .I am using query to fetch only  one record using a particular event_id the processor reads the same data and duplicate records are stored in Oracle DB

1 REPLY 1

avatar
Master Mentor

@Adyant001 

The JsonQueryElasticSearch processor does not store state.  If the processor has no inbound connection, it will be scheduled to execute its code using the configured properties and scheduling configured.  So upon every execution it is going to make the same same query to ElasticSearch.

This processor can also be triggered by an inbound FlowFile. So you would have some upstream dataflow to build a query in to its content and that FlowFile is fed to the JsonQueryElasticSearch processor to fetch that specific result.  The processor would then not execute again until it received another inbound FlowFile to trigger the execution.

Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.

Thank you,
Matt