- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Creating a table in postgresql from a csv using nifi
- Labels:
-
Apache NiFi
Created on ‎08-01-2017 06:50 PM - edited ‎09-16-2022 05:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am pretty new to nifi so bear with me.
I am trying to use nifi to take a csv with data in it and create a table using nifi and upload it to a database. I have a grasp on the putsql processor and how to insert the data into an already existing table. Any help would be appreciated
Created ‎08-02-2017 03:02 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
If you know how to split it up, you can split the file into others and route each file to its own PutSQL processor.
Created ‎08-01-2017 08:24 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I believe that the PutSQL processor can also do DDL statements such as your CREATE TABLE statement (it just issues the statements). You can also use the ExecuteScript processor and do it via script you write.
Created ‎08-01-2017 08:35 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I think what im struggling with is if there is a way to have this make several different tables. Like whenever a csv is placed into a folder have it uploaded to a database.
Created ‎08-02-2017 03:02 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
If you know how to split it up, you can split the file into others and route each file to its own PutSQL processor.
Created ‎01-21-2019 09:56 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Austin Duncan Hope , you found a solution and I am struggling with the same problem and I am new to HDP nifi and Postgres sql . Can you please share the same . Thanks Vijay
