question Creating a table in postgresql from a csv using nifi in Archives of Support Questions (Read Only)

Creating a table in postgresql from a csv using nifi

aduncan1 — Fri, 16 Sep 2022 12:02:09 GMT

I am pretty new to nifi so bear with me.

I am trying to use nifi to take a csv with data in it and create a table using nifi and upload it to a database. I have a grasp on the putsql processor and how to insert the data into an already existing table. Any help would be appreciated

Re: Creating a table in postgresql from a csv using nifi

ssahi — Wed, 02 Aug 2017 03:24:09 GMT

Hi @Austin Duncan

I believe that the PutSQL processor can also do DDL statements such as your CREATE TABLE statement (it just issues the statements). You can also use the ExecuteScript processor and do it via script you write.

Re: Creating a table in postgresql from a csv using nifi

aduncan1 — Wed, 02 Aug 2017 03:35:48 GMT

I think what im struggling with is if there is a way to have this make several different tables. Like whenever a csv is placed into a folder have it uploaded to a database.

Re: Creating a table in postgresql from a csv using nifi

ssahi — Wed, 02 Aug 2017 22:02:58 GMT

If you know how to split it up, you can split the file into others and route each file to its own PutSQL processor.

https://community.hortonworks.com/questions/48492/split-data-into-multiple-files-using-nifi-based-on.html

Re: Creating a table in postgresql from a csv using nifi

vijay_k_jegadee — Tue, 22 Jan 2019 05:56:40 GMT

@Austin Duncan Hope , you found a solution and I am struggling with the same problem and I am new to HDP nifi and Postgres sql . Can you please share the same . Thanks Vijay