question Re: How to set: Tez Job Name? in Support Questions

How to set: Tez Job Name?

wfloyd — Mon, 07 Dec 2015 23:15:39 GMT

MapReduce allowed us to set a unique job name with mapred.job.name. This allowed us to easily track jobs after execution via searching for this name in JobTracker UI and logs.

With Tez there doesn't appear to be a tez.job.name which can be set. Is there another similar config setting we can use to set a unique Tez job name/tag?

Thanks

Re: How to set: Tez Job Name?

drice1 — Mon, 07 Dec 2015 23:58:19 GMT

Hey @Wes Floyd , not that I'm aware of but if you look at RMP-3737 looks like this is coming in DAL-M20 or HDP 2.3.4

Re: How to set: Tez Job Name?

nsabharwal — Tue, 08 Dec 2015 01:05:20 GMT

@gopal @yzhang

Re: How to set: Tez Job Name?

aervits — Wed, 03 Feb 2016 23:49:22 GMT

@Wes Floyd are you still having issues with this? Can you accept best answer or provide your own solution?

Re: How to set: Tez Job Name?

regina_m_mcewen — Thu, 10 Mar 2016 04:05:13 GMT

@Dan Rice

Is this in HDP 2.4?

Re: How to set: Tez Job Name?

aervits — Sun, 13 Mar 2016 08:27:03 GMT

It was fixed in HDP 2.3.4 so yes it's in HDP 2.4 also http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_HDP_RelNotes/content/patch_hive.html

Re: How to set: Tez Job Name?

chengyong — Tue, 15 Mar 2016 15:38:50 GMT

Hi @Artem Ervits, what is the configuration name to set the tez job name? is it --hiveconf hive.query.name=myjobname ?

Re: How to set: Tez Job Name?

snukavarapu — Wed, 12 Oct 2016 23:38:36 GMT

Just wanted to give an update on this thread.

This feature is available in HDP 2.3.4. However, the value set for hive.query.name will not show up in Resource Manager UI instead it will show in Tez UI because Hive re-uses YARN applications to run multiple diff queries by different users.

RM UI displays the yarn application name and in Hive/tez we reuse applications heavily so there is no 1-1 relationship between application and DAG or query.