Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NIFI- CSV data and CSV schema in different files

Highlighted

NIFI- CSV data and CSV schema in different files

New Contributor

Hi, I am new to NIFI and I am still learning. My question is I have a CSV file where the data resides in pipe seperated and schema of this data is present in seperate file as below fromat

Schema: This is tab seperated

Tablename col1 datatype

Tablename col2 datatype

tablename col3 datayype


Datafile format: col1|col2|col3


I have to match schema and data accordingly and then load that data in sql db table. We will have several source files

and several header files.

Thanks,

Asmath

1 REPLY 1

Re: NIFI- CSV data and CSV schema in different files

New Contributor

Use InferAvroSchema Nifi Processor, which helps you to convert your csv file into avro schema, and then use that schema in your controller service registry.