Created on 03-25-2024 02:43 AM - edited 04-02-2024 01:23 AM
Detect updates to S3 files and insert the updated files into Aurora PostgreSQL with NiFi
The finished dataflow
wget https://jdbc.postgresql.org/download/postgresql-42.7.3.jar mkdir /tmp/nifi mv postgresql-42.7.3.jar /tmp/nifi/
The values input was protected as access key/values are sensitive values.Only "Sensitive value set" be shown.
4.2) Start the controllver service AWSCredentialsProviderControllerService (for saving AWS sensitive values)
4.3) Start the CSVReader Controller service
4.4) Start the JDBC Connection pool(DBCPConnectionPool-postgreSQL)service
5.1) Fix the Bucket,Prefix values
5.2) Fix the PostgreSQL table name for INSERTPutDatabaseRecord setting: