I’m going to show you a neat way to work with CSV files and Apache Hive. Usually, you’d have to do some preparatory work on CSV data before you can consume it with Hive but I’d like to show you a b...
One of the first cases we get to see with Hbase is loading it up with Data, most of the time we will have some sort of data in some format like CSV availalble and we would like to load it in Hbase, l...
...lat data files, like CSV, and transform them into Avro.
So now that we have a little background lets get into the details about how we make this happen using Apache NiFi and InferAvroSchema. Before w...
Apache NiFi 1.0.0 has a lot of cool features, but no JSON-to-CSV converter yet. For my use case, I wanted to split one JSON file that had 5,000 records into 5,000 CSVs. You could also through a M...
...dditionally, the flow is modified to also convert the CSV file to Avro and XML formats.
Note: The record-oriented processors and controller services were introduced in NiFi 1.2.0. As such, the t...
Introduction
Parquet is a famous file format used with several tools such as Spark. NiFi can be used to easily convert data from different formats such as Avro, CSV or JSON to Parquet. This a...
This Article will show how to read csv file which do not have header information as the first row. We will then specify the schema for both DataFrames and then join them together.
import org.apache...
My NiFi flow fails when encountering a CSV with a column containing a double quote within a string, such as: "Protection from Abuse Order on file against dad Raul Martinez Lopez." NO CONTACT WITH D...
Hi friends I have csv files in local file system , they all have the same header i want to get one csv file with this header , is there a solution using spark-csv or any thing else nwant to loop a...
I am unable to find a processor which can convert Avro to CSV or Json to CSV .. any pointer on this .. ,
I am working on a data flow, where I am reading data from Redshift and then pushing data t...
