question Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi) in Support Questions

Salesforce integration with Hortonworks Data Flow (Apache Nifi)

amcbarnett — Tue, 02 Feb 2016 01:07:31 GMT

The requirement is to extract data from Salesforce and to ingest into Hive. Is this a good use case for HDF?

The main requirement is to pull data from Salesforce. What processors are appropriate here?

The invokeHttp processor and/or ExtractText processor?

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

aervits — Tue, 02 Feb 2016 01:10:10 GMT

@Ancil McBarnett their API guide shows every which possible way. I'd use the rest processors in Nifi for that.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

MattWho — Tue, 02 Feb 2016 01:50:29 GMT

You could use the invokeHTTP processor to connect to a restAPI to pull data. Once NiFi has the data you could do things like extract parts of the data in to NiFi FlowFIle attributes using the extractText processor.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

jdavis1 — Tue, 02 Feb 2016 03:21:48 GMT

The invokeHTTP processor would work best, you would need to follow SalesForce authentication guidelines for the rest api: here.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

mgrabenstein — Tue, 02 Feb 2016 04:11:18 GMT

Salesforce requires SOAP login to access API, linking in another discussion about WSDL soap.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

SAsInSumit — Mon, 18 Sep 2017 09:54:50 GMT

I came across this thread and my colleague published a more recent option on the DataDirect blog with Salesforce JDBC and Apache Nifi

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

reddy_gayathri — Tue, 17 Jul 2018 20:36:10 GMT

Matt, if you have the detailed document on importing data from Salesforce to Hadoop using nifi, please share.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

saurabhbatra — Mon, 23 Jul 2018 13:47:51 GMT

Please refer: https://community.hortonworks.com/idea/203714/apache-nifi-fetching-event-log-files-from-salesfor.html

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

Roshannimble — Thu, 04 Apr 2024 12:07:47 GMT

Connecting Salesforce with Hortonworks Data Flow (powered by Apache NiFi) unlocks powerful data integration. Here's how:

NiFi Processors: Utilize processors like "InvokeHTTP" to call Salesforce APIs and retrieve data.
Real-Time or Batch: Move data bi-directionally (Salesforce to NiFi or vice versa) in real-time or batches.
Data Transformation: Cleanse, transform, and enrich data using NiFi's processors before storing it in your data lake.

This salesforce integration helps you leverage valuable Salesforce data for analytics, reporting, and deeper customer insights.