Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does anyone know a good source (book, tutorial etc) that explains the translation process of a hive query to Tez/MRv2 execution plan?

Does anyone know a good source (book, tutorial etc) that explains the translation process of a hive query to Tez/MRv2 execution plan?

Contributor

title says it all really but i'd like to know if anyone can link me to a comprehensive explanation with an example ideally of the process from hive query statement to underlying mapper and reducer tasks.

Thanks,

M

3 REPLIES 3
Highlighted

Re: Does anyone know a good source (book, tutorial etc) that explains the translation process of a hive query to Tez/MRv2 execution plan?

Contributor

I should add im particularly intrested in the underlying mechanisms involved in a JOIN statement, and how this is translated into a TEZ /MR job.

Highlighted

Re: Does anyone know a good source (book, tutorial etc) that explains the translation process of a hive query to Tez/MRv2 execution plan?

Mentor

Take a look at our documentation on using Ambari Tez View, it has detailed information http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-views/content/section_using_tez_vi...

Another good doc is our Hive performance guide but it is more about Hive than just Tez or MR http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_hive-performance-tuning/content/ch_hive_h...

Highlighted

Re: Does anyone know a good source (book, tutorial etc) that explains the translation process of a hive query to Tez/MRv2 execution plan?

Rising Star

@MPH if you are interested in the internals, here is a good presentation on it: http://www.slideshare.net/recruitcojp/internal-hive

Don't have an account?
Coming from Hortonworks? Activate your account here