How to Read Files from Remote Hadoop HA cluster using spark + scala.

[#1]

Hi,

I want to Read files from Remote Hadoop cluster (A) with HA and load it into Cluster(B), please let me know if there are ay options.

[#2]

@Manikandan Jeyabal

Are you asking about the code to read files or the configurations to connect to remote cluster?

[#3]

How to configure it, i have the code part.

[#4 · Accepted solution]

@Manikandan Jeyabal

Here is a good hc post that goes over this setup

https://community.hortonworks.com/questions/192404/kerberos-cross-realm-hdfs-access-via-spark-applic...

HTH

*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

[#5]

Tanx for your info @Felix Albani