https://community.cloudera.com/t5/Support-Questions/How-to-convert-unix-timestamp-to-datetime-in-Apache-NiFi/m-p/224738#M186602 <P>Hi everyone! <BR />In my FlowFile, using components, I listen to logs from Squid in the form of txt. Then I add columns and separate the log elements. The output file is csv, because in the future it will be added to the Hive database. <BR />The problem occurs when I want to change the type of the "datetime" variable from unix timestamp to the usual date time.</P><P>Based on this solution: <A href="https://community.hortonworks.com/articles/131320/using-partitionrecord-grokreaderjsonwriter-to-pars.html">https://community.hortonworks.com/articles/131320/using-partitionrecord-grokreaderjsonwriter-to-pars.html</A></P><P>This is how the log sent by Squid looks like using a proxy:</P><P>1518442283.483 161 127.0.0.1 TCP_MISS/200 103701 GET <A href="http://www.cnn.com/" target="_blank">http://www.cnn.com/</A> matt DIRECT/199.27.79.73 text/html</P><P>This is Grok Expression (in <STRONG>GrokReader</STRONG><span class="lia-unicode-emoji" title=":disappointed_face:">😞</span><BR />%{NUMBER:timestamp}\s+%{NUMBER:duration}\s%{IP:client_address}\s%{WORD:cache_result}/%{POSINT:status_code}\s%{NUMBER:bytes}\s%{WORD:request_method}\s%{NOTSPACE:url}\s(%{NOTSPACE:user}|-)\s%{WORD:hierarchy_code}/%{IPORHOST:server}\s%{NOTSPACE:content_type}</P><P>The following links include:<BR />→ General appearance of components: <A href="https://imgur.com/a/fn2Q03N" target="_blank">https://imgur.com/a/fn2Q03N</A><BR />→ Settings for the UpdateRecord component: <A href="https://imgur.com/a/E8gfMj8" target="_blank">https://imgur.com/a/E8gfMj8</A><BR />→ Settings for the UpdateRecord/GrokReader(nifi_mid): <A href="https://imgur.com/a/l8He75D" target="_blank">https://imgur.com/a/l8He75D</A><BR />→ Settings for the UpdateRecord/CSVRecordSetWriter: <A href="https://imgur.com/a/aqiZ98M" target="_blank">https://imgur.com/a/aqiZ98M</A></P><P>My problem is described on stackoverflow: <A href="https://stackoverflow.com/questions/48885675/conversion-unix-timestamp-attribute-to-normal-date" target="_blank">https://stackoverflow.com/questions/48885675/conversion-unix-timestamp-attribute-to-normal-date</A></P> Fri, 20 Apr 2018 20:31:52 GMT wojciech_leszcz 2018-04-20T20:31:52Z