About medloh

medloh · ‎02-08-2021

Thanks, I set the same avro schema in both the reader and writer before reading this, and that worked after I set some optional fields. Last task is to gain a better understanding of how I can control the output filename. Maybe something like this: https://community.cloudera.com/t5/Support-Questions/Nifi-date-filename/m-p/172305

medloh · ‎02-05-2021

Thanks Matt, The author of that article recommended this, I'll give it a try. " Also, NiFi has now a Parquet Record that you can use outside of the PutParquet. I advise you to use ConvertRecord then PutHDFS directly. This is better." I'm a little unsure of how and where I need to configure the schemas but hopefully I'll figure it out.

medloh · ‎02-05-2021

I'm trying to convert local json file with getfile processor into parquet file on HDFS. I'm following this guide: https://medium.com/@abdelkrim.hadjidj/using-apache-nifi-for-json-to-parquet-conversion-945219d5caba I choose Record Reader of JsonTreeReader, but I don't see any of the schema properties in the putparquet processor? (Schema Access Strategy, Schema Text). How do I get those to show up, or how do I enter them manually?

Online	Offline
Last Visited	‎06-06-2022 11:57 AM

Member Since	‎12-01-2015 02:44 PM
Last Visited	‎06-06-2022 11:57 AM
Posts	13
Kudos received	2

Cloudera Community

Re: Nifi PutParquet processor, how to enter json s...

Re: Nifi PutParquet processor, how to enter json s...

Nifi PutParquet processor, how to enter json schem...