Salesforce Lookup via NIFI

Question

I need your advice, I need to insert data into salesforce but I have a lookup to do to verify the existence of the data before adding it.
Me, I had considered creating a tempo database (PosgresSql) in order to put the contents of the salesforce object being the object of lookup to verify first and then to make the join to update the contents. in salesforce.
1- NIFI to PosgresSql
2- Salesforce to PosgreSql
3- Join data to Salesforce
What do you think? what do you think is the best method?

TimothySpann · Accepted Answer

You may want to look at Flink SQL for joining and lookups

Also look at nifi lookuprecord

https://www.datainmotion.dev/2019/03/properties-file-lookup-augmentation-of.html

https://www.datainmotion.dev/2020/12/simple-change-data-capture-cdc-with-sql.html lookuprecord to sql

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-lookup-services-nar/1.12.1/org.apache.nifi.lookup.db.DatabaseRecordLookupService/index.html

https://www.datainmotion.dev/2020/10/top-25-use-cases-of-cloudera-flow.html

TimothySpann · Answer

https://www.progress.com/tutorials/jdbc/ingest-salesforce-data-incrementally-into-hive-using-apache-nifi https://www.datainmotion.dev/2019/11/ingest-salesforce-data-into-hive-using.html

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.