https://community.cloudera.com/t5/Support-Questions/How-to-search-and-remove-null-values-in-elastic-search-index/m-p/226886#M188746 <P>Hi </P><P>I have elastic search index in below format. here the fields are populated with null values if the data are not supplied to fields .</P><P>Is there any way by using nifi we can remove null values contain fields before elastic search index loading </P><P>Details </P><P>Sample index</P><P> if all data populated </P><P> { "_index": "bookdb_index", "_type": "book", "_id": "1", "_score": 0.28168046, "title": "Elasticsearch: The Definitive Guide", "summary": "A distibuted real-time search and analytics engine", "publish_date": "2015-02-07", "num_reviews": 20, "publisher": "manning" } </P><P>Sample index if all not data populated</P><P>{ "_index": "bookdb_index", "_type": "book", "_id": "1", "_score": 0.28168046, "title": "Elasticsearch: The Definitive Guide", "summary": null, "publish_date": null, "num_reviews": 20, "publisher":null }</P><P>Avro Scheam registery </P><P>{ "namespace": "ingestion", "type": "record", "name": "quest", "fields": [ { "name": "_type", "type": "string" }, { "name": "_id", "type": "string" }, { "name": "_score", "type": ["string", "null"] }, { "name": "title", "type": ["string", "null"] }, { "name": "summary", "type": ["string", "null"] }, { "name": "publish_date", "type": ["null", "string"] }, { "name": "num_reviews", "type": ["string", "null"] }, { "name": "publisher", "type": ["string", "null"] }, ]</P><P>I am using Putelasticsearchhttprecord processor to load data to elasticsearch . In nifi 1.6 there is "<STRONG>Suppress Null Values" </STRONG>feature is available , but i am using nifi 1.5 version , Is there any way to resolve the issue </P><P>I am trying to change Avro schema registry but fields are populated null values some time and sometimes not.</P><P>Please help me to resolve the issue </P> Thu, 26 Apr 2018 23:51:36 GMT sdendukuri 2018-04-26T23:51:36Z