question Re: How to add a putelaticsearch5 processor in nifi on HDP 2.5? in Support Questions

How to add a putelaticsearch5 processor in nifi on HDP 2.5?

a_rajeshinfotec — Sun, 18 Aug 2019 03:24:38 GMT

I using HDP 2.5 and I add a NIFI service in it, I need to send a data to Elasticsearch 5.X, when i add a processor in NIFI, the putelasticsearch5 processor is missing but it has only putelasticsearch(it supports only elasticsearc 2.X version).How can I add the Putelasticsearch5 processor in nifi.

Re: How to add a putelaticsearch5 processor in nifi on HDP 2.5?

mburgess — Sat, 02 Dec 2017 23:50:12 GMT

What version of Hortonworks Data Flow NiFi are you using? As of Apache NiFi 1.1.0 (I'm not sure offhand which HDF NiFi release that corresponds to, possibly HDF 3.0), the Elasticsearch 5 processors are available.

Having said that, the ElasticsearchHttp processors (PutElasticsearchHttp in your screenshot above, e.g.) use the REST API rather than the Transport Client, so those processors are much more robust in the sense of which Elasticsearch versions they support. I believe the ElasticsearchHttp processors support at least 2.X through at least 5.0.1 (but I think they might work for all of 5.X). They are not quite as performant as the transport client versions (PutElasticsearch and PutElasticsearch5), but for your version of NiFi PutElasticsearchHttp should allow you to connect to your ES5 cluster.

Re: How to add a putelaticsearch5 processor in nifi on HDP 2.5?

a_rajeshinfotec — Tue, 05 Dec 2017 13:47:23 GMT

thanks, it works for me and also install nifi 1.1.0 version, in that I have the PutElasticsearch5 processor.that also works well with transport client.