Member since
08-22-2017
5
Posts
0
Kudos Received
0
Solutions
08-23-2017
08:21 AM
@Matt Burgess That worked Matt, Thanks a lot. I am facing one more problem here. My flow is like this: Twitter --> ElasticSearch --> Kafka Processor Flows: 1. GetTwitter --> PutElasticsearch5 2. ScrollElasticsearchHttp --> PublishKafka_0_10 ScrollElasticsearchHttp does fine job of fetching all the records from elastic index, but when the index content is changed(new tweets added to elasticsearch index from GetTwitter-->PutElasticsearch5), ScrollElasticsearchHttp not sending the updated content to Kafka. In ScrollElasticsearchHttp processor If I clear state, all the documents from Elasticsearch is been sent to kafka again (same documents sent again). Matt could you please help me out to sort this issue.
... View more
08-22-2017
08:50 AM
@Matt Burgess If I want to get all the documents in the Index, what is the query parameter I should be giving in QueryElasticsearchHTTP processor.
... View more