Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to Read Files from Remote Hadoop HA cluster using spark + scala.

Solved Go to solution

How to Read Files from Remote Hadoop HA cluster using spark + scala.

Contributor

Hi,

I want to Read files from Remote Hadoop cluster (A) with HA and load it into Cluster(B), please let me know if there are ay options.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to Read Files from Remote Hadoop HA cluster using spark + scala.

@Manikandan Jeyabal

Here is a good hc post that goes over this setup

https://community.hortonworks.com/questions/192404/kerberos-cross-realm-hdfs-access-via-spark-applic...

HTH

*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

4 REPLIES 4

Re: How to Read Files from Remote Hadoop HA cluster using spark + scala.

@Manikandan Jeyabal

Are you asking about the code to read files or the configurations to connect to remote cluster?

Re: How to Read Files from Remote Hadoop HA cluster using spark + scala.

Contributor

How to configure it, i have the code part.

Re: How to Read Files from Remote Hadoop HA cluster using spark + scala.

@Manikandan Jeyabal

Here is a good hc post that goes over this setup

https://community.hortonworks.com/questions/192404/kerberos-cross-realm-hdfs-access-via-spark-applic...

HTH

*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

Re: How to Read Files from Remote Hadoop HA cluster using spark + scala.

Contributor

Tanx for your info @Felix Albani