It looks like you are running Spark shell on a Windows machine, maybe your local laptop. Is there anywhere in the code you are mentioning the hostname, "dclvmsbigdmd01"? If not, where is your 172.30.294.196 (hive.metastore.uris)? Does this IP resolve the name dclvmsbigdmd01? Can you review if the host/domain is reachable from your local? ... View more

Hi @Logica .   I think you need keep hive-site.xml file into spark -   Please follow the below steps for running the hive query or accessing the hive table through pyspark-   https://acadgild.com/blog/how-to-access-hive-tables-to-spark-sql     Thanks HadoopHelp ... View more