About cyrus_rezai25

cyrus_rezai25 · ‎10-25-2017

Thanks for the reply. Does this mean that spark object in spark-shell already has enableHiveSupport() enabled? or the spark.sql(), and spark.catalog that spark object provides are implemented by SparkSession even without enableHiveSupport()?

cyrus_rezai25 · ‎10-24-2017

I can use SparkSession to get the list of tables in Hive, or access a Hive table as shown in the code below. Now my question is if in this case, I'm using Spark with Hive Context? Or is it that to use hive context in Spark, I must directly use HiveContext object to access tables, and perform other Hive related functions? spark.catalog.listTables.show val personnelTable = spark.catalog.getTable("personnel")

Online	Offline
Last Visited	‎10-25-2017 05:52 PM

Member Since	‎10-24-2017 09:26 PM
Last Visited	‎10-25-2017 05:52 PM
Posts	2

Cloudera Community

Re: Spark: If I use SparkSession, Am I Using Hive ...

Spark: If I use SparkSession, Am I Using Hive Cont...