Salesforce Lookup via NIFI

[#1]

I need your advice, I need to insert data into salesforce but I have a lookup to do to verify the existence of the data before adding it.
Me, I had considered creating a tempo database (PosgresSql) in order to put the contents of the salesforce object being the object of lookup to verify first and then to make the join to update the contents. in salesforce.
1- NIFI to PosgresSql
2- Salesforce to PosgreSql
3- Join data to Salesforce
What do you think? what do you think is the best method?

[#2 · Accepted solution]

You may want to look at Flink SQL for joining and lookups

Also look at nifi lookuprecord

https://www.datainmotion.dev/2019/03/properties-file-lookup-augmentation-of.html

https://www.datainmotion.dev/2020/12/simple-change-data-capture-cdc-with-sql.html lookuprecord to sql

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-lookup-services-nar/1.12.1/or...

https://www.datainmotion.dev/2020/10/top-25-use-cases-of-cloudera-flow.html

[#3]

https://www.progress.com/tutorials/jdbc/ingest-salesforce-data-incrementally-into-hive-using-apache-...

https://www.datainmotion.dev/2019/11/ingest-salesforce-data-into-hive-using.html 

[#4 · Accepted solution]

You may want to look at Flink SQL for joining and lookups

Also look at nifi lookuprecord

https://www.datainmotion.dev/2019/03/properties-file-lookup-augmentation-of.html

https://www.datainmotion.dev/2020/12/simple-change-data-capture-cdc-with-sql.html lookuprecord to sql

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-lookup-services-nar/1.12.1/or...

https://www.datainmotion.dev/2020/10/top-25-use-cases-of-cloudera-flow.html

[#5 · Accepted solution]

@TimothySpann thank for you ansewer

Finaly i have use a postgres Table