- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Hive on spark2
- Labels:
-
Apache Spark
Created on ‎12-09-2017 02:35 PM - edited ‎09-16-2022 05:37 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi All,
Is Hive on spark2 supported?
If yes, im trying to configuring Hive on spark 2 ..the documentation says "Search for the Spark On YARN Service. To configure the Spark service, select the Spark service name. To remove the dependency, select none."
but my hive configureation has only one option which is "none". I dont have an option to choose spark service.Am i missing anything in my configurations?
Created ‎01-04-2018 01:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello Abhi,
At the time of this writing (latest version are CDH 5.13.1 / Spark 2.2.x) Hive on Spark2 is not supported. See our documentation:
"Hive-on-Spark is a CDH component that has a dependency on Spark 1.6. Because CDH components do not have any dependencies on Spark 2, Hive-on-Spark does not work with the Cloudera Distribution of Apache Spark 2."
I hope this answers your question.
Regards
Miklos Szurap
Customer Operations Engineer
Created ‎01-04-2018 01:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello Abhi,
At the time of this writing (latest version are CDH 5.13.1 / Spark 2.2.x) Hive on Spark2 is not supported. See our documentation:
"Hive-on-Spark is a CDH component that has a dependency on Spark 1.6. Because CDH components do not have any dependencies on Spark 2, Hive-on-Spark does not work with the Cloudera Distribution of Apache Spark 2."
I hope this answers your question.
Regards
Miklos Szurap
Customer Operations Engineer
