https://community.cloudera.com/t5/Support-Questions/Spark-access-remote-HDFS-in-cross-realm-trust-setup/m-p/325220#M229561 <P>Hi&nbsp;<a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/11235">@Tomas79</a>&nbsp;</P><P>&nbsp;</P><P>While launching spark-shell, you need to add&nbsp;<STRONG>spark.yarn.access.hadoopFileSystems</STRONG> parameter. And also ensure to add&nbsp;<STRONG>dfs.namenode.kerberos.principal.pattern </STRONG>parameter value <STRONG>*</STRONG>&nbsp;in <STRONG>core-site.xml </STRONG>file.</P><P>&nbsp;</P><P>For example,</P><LI-CODE lang="java"># spark-shell --conf spark.yarn.access.hadoopFileSystems="hdfs://c1441-node2.coelab.cloudera.com:8020" Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 21/09/24 07:23:25 WARN cluster.YarnSchedulerBackend$YarnSchedulerEndpoint: Attempted to request executors before the AM has registered! Spark context Web UI available at http://c2441-node2.supportlab.cloudera.com:4040 Spark context available as 'sc' (master = yarn, app id = application_1632395260786_0004). Spark session available as 'spark'. Welcome to ____ __ / __/__ ___ _____/ /__ _\ \/ _ \/ _ `/ __/ '_/ /___/ .__/\_,_/_/ /_/\_\ version 2.4.0.7.1.6.0-297 /_/ Using Scala version 2.11.12 (OpenJDK 64-Bit Server VM, Java 1.8.0_232) Type in expressions to have them evaluated. Type :help for more information. scala&gt; val textDF = spark.read.textFile("hdfs://c1441-node2.coelab.cloudera.com:8020/tmp/ranga_clusterb_test.txt") textDF: org.apache.spark.sql.Dataset[String] = [value: string] scala&gt; textDF.show(false) +---------------------+ |value | +---------------------+ |Hello Ranga, | | | +---------------------+</LI-CODE><P>&nbsp;&nbsp;</P> Fri, 24 Sep 2021 10:53:26 GMT RangaReddy 2021-09-24T10:53:26Z