https://community.cloudera.com/t5/Archives-of-Support-Questions/Read-from-Kafka-convert-data-from-JSON-to-CSV-and-write-to/m-p/197350#M78276 <P>Thank you!</P> Wed, 16 May 2018 16:22:02 GMT yko84108 2018-05-16T16:22:02Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Read-from-Kafka-convert-data-from-JSON-to-CSV-and-write-to/m-p/197348#M78274 <P>Hi,</P><P>I'm looking for tutorial for the following flow:</P><P>1. Read message from Kafka (JSON format)</P><P>2. Convert the JSON format to CSV format</P><P>3. Write the CSV to Hadoop</P><P>It's possible to do it with Nifi?</P><P>Thanks.</P> Wed, 16 May 2018 15:48:32 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Read-from-Kafka-convert-data-from-JSON-to-CSV-and-write-to/m-p/197348#M78274 yko84108 2018-05-16T15:48:32Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Read-from-Kafka-convert-data-from-JSON-to-CSV-and-write-to/m-p/197349#M78275 <P><A rel="user" href="https://community.cloudera.com/users/80196/yko84108.html" nodeid="80196">@Ya ko</A></P><P>Yes,it's possible with record oriented processors(Convert Record) NiFi,</P><P><STRONG>Flow: </STRONG></P><PRE>1. Consume Kafka Processor //to read data from Kafka 2. Convert Record processor //to convert json format to csv format 3. PutHDFS //write the csv format data to HDFS</PRE><P>In ConvertRecord processor we are configuring Record Reader(<STRONG>Json Tree Reader</STRONG>) to read incoming Json format data and Record writer Controller service(<STRONG>CSVSetWriter</STRONG>) to write the output flowfile in CSV format, we need to define Avro schema for the Record Reader/Writer controller services.</P><P>Follow <A href="https://community.hortonworks.com/articles/115311/convert-csv-to-json-avro-xml-using-convertrecord-p.html" target="_blank">this</A> tutorial to know more details and configurations regarding Convert record processor.</P> Wed, 16 May 2018 16:08:07 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Read-from-Kafka-convert-data-from-JSON-to-CSV-and-write-to/m-p/197349#M78275 Shu_ashu 2018-05-16T16:08:07Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Read-from-Kafka-convert-data-from-JSON-to-CSV-and-write-to/m-p/197350#M78276 <P>Thank you!</P> Wed, 16 May 2018 16:22:02 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Read-from-Kafka-convert-data-from-JSON-to-CSV-and-write-to/m-p/197350#M78276 yko84108 2018-05-16T16:22:02Z