...lat data files, like CSV, and transform them into Avro.
So now that we have a little background lets get into the details about how we make this happen using Apache NiFi and InferAvroSchema. Before w...
Apache NiFi 1.0.0 has a lot of cool features, but no JSON-to-CSV converter yet. For my use case, I wanted to split one JSON file that had 5,000 records into 5,000 CSVs. You could also through a M...
...dditionally, the flow is modified to also convert the CSV file to Avro and XML formats.
Note: The record-oriented processors and controller services were introduced in NiFi 1.2.0. As such, the t...
Introduction
Parquet is a famous file format used with several tools such as Spark. NiFi can be used to easily convert data from different formats such as Avro, CSV or JSON to Parquet. This a...
My NiFi flow fails when encountering a CSV with a column containing a double quote within a string, such as: "Protection from Abuse Order on file against dad Raul Martinez Lopez." NO CONTACT WITH D...
We have a requirement to convert the CSV file content into a custom format. Please find the details of the input and expected output format below and help us with your expertise to achieve this u...
I am unable to find a processor which can convert Avro to CSV or Json to CSV .. any pointer on this .. ,
I am working on a data flow, where I am reading data from Redshift and then pushing data t...
Objective
This tutorial demonstrates how to use the
PutMongoRecord processor to easily put data from a CSV file into MongoDB.
Note: The PutMongoRecord processor was introduced in NiFi 1.4.0....
I need to create a flow that rejects csv files if there are invalid records determined using ValidateRecord processor. I would like to just report those invalid records and stop it there and d...
Hi, I have a csv file with dynamic columns and headers and there are multiple columns with same header name "SKIP" that needs to be removed from the file before ingesting them into t...
