https://community.cloudera.com/t5/Archives-of-Support-Questions/I-want-to-insert-data-into-the-database-without-converting/m-p/157348#M57105 <P>For CSV files, if you know the number and type of column values, you can use SplitText (to get one row per flow file) followed by ExtractText, supplying a regular expression to get the column values out into flow file attributes. Then you can use ReplaceText to manually enter a SQL INSERT statement (using <A target="_blank" href="https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html">NiFi Expression Language</A> to access the attributes). For other formats like Avro, as we don't currently have a ConvertAvroToSQL processor, you'd have to convert them for now. </P><P>Work is underway for a generic system of type conversions, such that you could specify Avro as your input format and perhaps "SQL INSERT" as your output format, thereby effectively making the generic processor work like a ConvertAvroToSQL processor.</P> Wed, 15 Mar 2017 19:52:59 GMT mburgess 2017-03-15T19:52:59Z https://community.cloudera.com/t5/Archives-of-Support-Questions/I-want-to-insert-data-into-the-database-without-converting/m-p/157347#M57104 <P>Hi....I have data in various kinds of files and i want to insert them into database but i don't want it to convert them first into JSON and then to SQL as it is very time consuming.Is there any way so that i can put my data into database from different kinds of files like CSV,Avro etc directly?</P> Wed, 15 Mar 2017 15:11:30 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/I-want-to-insert-data-into-the-database-without-converting/m-p/157347#M57104 prakharagrawal6 2017-03-15T15:11:30Z https://community.cloudera.com/t5/Archives-of-Support-Questions/I-want-to-insert-data-into-the-database-without-converting/m-p/157348#M57105 <P>For CSV files, if you know the number and type of column values, you can use SplitText (to get one row per flow file) followed by ExtractText, supplying a regular expression to get the column values out into flow file attributes. Then you can use ReplaceText to manually enter a SQL INSERT statement (using <A target="_blank" href="https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html">NiFi Expression Language</A> to access the attributes). For other formats like Avro, as we don't currently have a ConvertAvroToSQL processor, you'd have to convert them for now. </P><P>Work is underway for a generic system of type conversions, such that you could specify Avro as your input format and perhaps "SQL INSERT" as your output format, thereby effectively making the generic processor work like a ConvertAvroToSQL processor.</P> Wed, 15 Mar 2017 19:52:59 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/I-want-to-insert-data-into-the-database-without-converting/m-p/157348#M57105 mburgess 2017-03-15T19:52:59Z