Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Salesforce integration with Hortonworks Data Flow (Apache Nifi)

Solved Go to solution

Salesforce integration with Hortonworks Data Flow (Apache Nifi)

The requirement is to extract data from Salesforce and to ingest into Hive. Is this a good use case for HDF?

The main requirement is to pull data from Salesforce. What processors are appropriate here?

The invokeHttp processor and/or ExtractText processor?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

Master Guru

You could use the invokeHTTP processor to connect to a restAPI to pull data. Once NiFi has the data you could do things like extract parts of the data in to NiFi FlowFIle attributes using the extractText processor.

7 REPLIES 7
Highlighted

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

Mentor

@Ancil McBarnett their API guide shows every which possible way. I'd use the rest processors in Nifi for that.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

Master Guru

You could use the invokeHTTP processor to connect to a restAPI to pull data. Once NiFi has the data you could do things like extract parts of the data in to NiFi FlowFIle attributes using the extractText processor.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

New Contributor

Matt, if you have the detailed document on importing data from Salesforce to Hadoop using nifi, please share.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

New Contributor

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

New Contributor

The invokeHTTP processor would work best, you would need to follow SalesForce authentication guidelines for the rest api: here.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

New Contributor

Salesforce requires SOAP login to access API, linking in another discussion about WSDL soap.

Re: Salesforce integration with Hortonworks Data Flow (Apache Nifi)

New Contributor

I came across this thread and my colleague published a more recent option on the DataDirect blog with Salesforce JDBC and Apache Nifi