...lat data files, like CSV, and transform them into Avro.
So now that we have a little background lets get into the details about how we make this happen using Apache NiFi and InferAvroSchema. Before w...
Apache NiFi 1.0.0 has a lot of cool features, but no JSON-to-CSV converter yet. For my use case, I wanted to split one JSON file that had 5,000 records into 5,000 CSVs. You could also through a M...
...dditionally, the flow is modified to also convert the CSV file to Avro and XML formats.
Note: The record-oriented processors and controller services were introduced in NiFi 1.2.0. As such, the t...
Introduction
Parquet is a famous file format used with several tools such as Spark. NiFi can be used to easily convert data from different formats such as Avro, CSV or JSON to Parquet. This a...
My NiFi flow fails when encountering a CSV with a column containing a double quote within a string, such as: "Protection from Abuse Order on file against dad Raul Martinez Lopez." NO CONTACT WITH D...
I am unable to find a processor which can convert Avro to CSV or Json to CSV .. any pointer on this .. ,
I am working on a data flow, where I am reading data from Redshift and then pushing data t...
Objective
This tutorial demonstrates how to use the
PutMongoRecord processor to easily put data from a CSV file into MongoDB.
Note: The PutMongoRecord processor was introduced in NiFi 1.4.0....
Hi, I have a csv file with dynamic columns and headers and there are multiple columns with same header name "SKIP" that needs to be removed from the file before ingesting them into t...
I need to create a flow that rejects csv files if there are invalid records determined using ValidateRecord processor. I would like to just report those invalid records and stop it there and d...
