question Salesforce Lookup via NIFI in Support Questions

Salesforce Lookup via NIFI

Lamtoro — Sat, 26 Dec 2020 00:47:38 GMT

I need your advice, I need to insert data into salesforce but I have a lookup to do to verify the existence of the data before adding it.
Me, I had considered creating a tempo database (PosgresSql) in order to put the contents of the salesforce object being the object of lookup to verify first and then to make the join to update the contents. in salesforce.
1- NIFI to PosgresSql
2- Salesforce to PosgreSql
3- Join data to Salesforce
What do you think? what do you think is the best method?

Re: Salesforce Lookup via NIFI

TimothySpann — Tue, 05 Jan 2021 21:41:08 GMT

https://www.progress.com/tutorials/jdbc/ingest-salesforce-data-incrementally-into-hive-using-apache-nifi

https://www.datainmotion.dev/2019/11/ingest-salesforce-data-into-hive-using.html

Re: Salesforce Lookup via NIFI

TimothySpann — Tue, 05 Jan 2021 21:44:14 GMT

You may want to look at Flink SQL for joining and lookups

Also look at nifi lookuprecord

https://www.datainmotion.dev/2019/03/properties-file-lookup-augmentation-of.html

https://www.datainmotion.dev/2020/12/simple-change-data-capture-cdc-with-sql.html lookuprecord to sql

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-lookup-services-nar/1.12.1/org.apache.nifi.lookup.db.DatabaseRecordLookupService/index.html

https://www.datainmotion.dev/2020/10/top-25-use-cases-of-cloudera-flow.html

Re: Salesforce Lookup via NIFI

Lamtoro — Tue, 23 Feb 2021 19:28:50 GMT

@TimothySpann thank for you ansewer

Finaly i have use a postgres Table