Skip to main content
Nikhil44
Bronze ⭐️⭐️⭐️
Jan 18, 2023 7:20 AM UTC
Question

Read hive table from spark

Hive is present on different cluster and spark(Stand Alone) is installed on different machine.

In spark machine hadoop is not installed so, no direct access to hdfs. 

In this scenario how can i connect to hive using spark. What are the available ways?

1 reply

RangaReddy
Gold ⭐️
Gold ⭐️
Jan 18, 2023 9:07 AM UTC

Hi @Nikhil44 

First of all, Cloudera will not support Standalone Spark installation.

To access any hive table, we need a hive-site.xml and Hadoop-related configuration files like (core-site.xml, hdfs-site.xml and yarn-site.xml)

Translate