- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Hive on Spark
- Labels:
-
Apache Hive
-
Apache Spark
Created ‎01-18-2017 03:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Do Hortonworks plan supporting Hive on Spark ? or Is Hive on Spark a cloudera direction - and Hive LLAP Hortonworks' ?
Created ‎01-18-2017 03:34 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hortonworks fully supports Spark but we do not support Hive on Spark. There are couple of reasons for this:
1. Performance: Hive on Tez showed a 50x or greater improvement than Hive on MR, while Hive on Spark only showed a 3x improvement over Hive on MR.
2. Scale: Hive on Tez has been proven to scale at data sets well exceeding what is capable by Hive on Spark.
Here is a presentation discussing some of the differences: http://www.slideshare.net/hortonworks/hive-on-spark-is-blazing-fast-or-is-it-final
With LLAP, Hive speed is increased even further but LLAP is not a replacement for Tez. In fact, LLAP still leverages the Tez engine.
Hope this helps!
Created ‎01-18-2017 03:34 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hortonworks fully supports Spark but we do not support Hive on Spark. There are couple of reasons for this:
1. Performance: Hive on Tez showed a 50x or greater improvement than Hive on MR, while Hive on Spark only showed a 3x improvement over Hive on MR.
2. Scale: Hive on Tez has been proven to scale at data sets well exceeding what is capable by Hive on Spark.
Here is a presentation discussing some of the differences: http://www.slideshare.net/hortonworks/hive-on-spark-is-blazing-fast-or-is-it-final
With LLAP, Hive speed is increased even further but LLAP is not a replacement for Tez. In fact, LLAP still leverages the Tez engine.
Hope this helps!
Created ‎05-05-2019 05:05 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you for valuable information.
Created ‎01-18-2017 03:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks @Scott Shaw. It does help. Do we know when Hortonworks would fully support LLAP ? As of 2.5.3 which i assume is latest - its still in tech preview mode ?
Created ‎01-18-2017 03:43 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks @Scott Shaw. This helps. Do you know when Hortonworks would fully support LLAP in production ? I see as of 2.5.3 its still in tech preview ? Is there any advantage in terms of hive from moving from HDP 2.3 to HD 2.5...as i see both are using Hive 1.2.1.
Created ‎01-18-2017 04:08 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I believe LLAP will be GA in 2.6 which is due out sometime in Q2. The advantage of HDP 2.5 would be to test LLAP and Hive 2.0. Also, HDP 2.5 also includes a number fixes to Hive 1.2.1 1.2.1 http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_release-notes/content/fixed_issues.html
Created ‎01-15-2019 07:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello, I just want to know do Hortonworks plan supporting Hive on Spark now?
Thanks very much!
@Scott Shaw
,Hello,I just want to know do Hortonworks support Hive on Spark now?Tanks very much! @Scott Shaw
Created ‎02-10-2020 09:37 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I would also like to know this. Is Hive on Spark currently supported by HortonWorks? Since which version?
Thanks in advance,
David Resende
