Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Creating a table in postgresql from a csv using nifi

Solved Go to solution
Highlighted

Creating a table in postgresql from a csv using nifi

New Contributor

I am pretty new to nifi so bear with me.

I am trying to use nifi to take a csv with data in it and create a table using nifi and upload it to a database. I have a grasp on the putsql processor and how to insert the data into an already existing table. Any help would be appreciated

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Creating a table in postgresql from a csv using nifi

Guru

If you know how to split it up, you can split the file into others and route each file to its own PutSQL processor.

https://community.hortonworks.com/questions/48492/split-data-into-multiple-files-using-nifi-based-on...

View solution in original post

4 REPLIES 4
Highlighted

Re: Creating a table in postgresql from a csv using nifi

Guru

Hi @Austin Duncan

I believe that the PutSQL processor can also do DDL statements such as your CREATE TABLE statement (it just issues the statements). You can also use the ExecuteScript processor and do it via script you write.

Highlighted

Re: Creating a table in postgresql from a csv using nifi

New Contributor

I think what im struggling with is if there is a way to have this make several different tables. Like whenever a csv is placed into a folder have it uploaded to a database.

Highlighted

Re: Creating a table in postgresql from a csv using nifi

Guru

If you know how to split it up, you can split the file into others and route each file to its own PutSQL processor.

https://community.hortonworks.com/questions/48492/split-data-into-multiple-files-using-nifi-based-on...

View solution in original post

Highlighted

Re: Creating a table in postgresql from a csv using nifi

New Contributor

@Austin Duncan Hope , you found a solution and I am struggling with the same problem and I am new to HDP nifi and Postgres sql . Can you please share the same . Thanks Vijay

Don't have an account?
Coming from Hortonworks? Activate your account here