question Re: apache nifi to elasticsearch convert time to date in Support Questions

apache nifi to elasticsearch convert time to date

thuylevn — Fri, 31 Aug 2018 17:02:12 GMT

hi all,

I am trying to insert json elastichsearch use apache nifi

{"submit_date": "2017-09-11 12:28:57.0", "request_type": "change", "origin": "monitoring", "description": "Start Event Process from Zabbix", "timestamp":"2018-08-30 08:16:18.970+0000"}

I insert this to elastichsearch, however, elastichsearch can understand submit_date and timestamp is datetime. So, how to insert time to elastichsearch?

Many thanks

Re: apache nifi to elasticsearch convert time to date

stevenmatison — Fri, 31 Aug 2018 18:08:20 GMT

@Thuy Le

In order for the timestamp to work it has to be in the correct format which elasticsearch expects (default ISO 8601).

Here is a good article about timestamp manipulation in nifi:

https://community.hortonworks.com/questions/113959/use-nifi-to-change-the-format-of-numeric-date-and.html

Then in elasticsearch, you need to create a mapping which tells the index which field is the timestamp:

https://www.elastic.co/guide/en/elasticsearch/hadoop/current/mapping.html#mapping-date

https://www.elastic.co/guide/en/elasticsearch/reference/2.0/mapping-date-format.html#built-in-date-formats

If this answer is helpful, please click ACCEPT to mark your question resolved.

Re: apache nifi to elasticsearch convert time to date

thuylevn — Sat, 01 Sep 2018 01:12:18 GMT

Hi @Steven Matision,

Thank you so much for your suggestions. I fixed that issue.

Re: apache nifi to elasticsearch convert time to date

yaara66 — Mon, 03 Dec 2018 21:51:34 GMT

Can you please share how?