How to set: Tez Job Name?

[#1]

MapReduce allowed us to set a unique job name with mapred.job.name. This allowed us to easily track jobs after execution via searching for this name in JobTracker UI and logs.

With Tez there doesn't appear to be a tez.job.name which can be set. Is there another similar config setting we can use to set a unique Tez job name/tag?

Related Jira: https://issues.apache.org/jira/browse/HIVE-12357

Thanks

[#2 · Accepted solution]

Hey @Wes Floyd , not that I'm aware of but if you look at RMP-3737 looks like this is coming in DAL-M20 or HDP 2.3.4

[#3]

@Dan Rice

Is this in HDP 2.4?

[#4]

It was fixed in HDP 2.3.4 so yes it's in HDP 2.4 also http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_HDP_RelNotes/content/patch_hive.html

[#5]

@gopal @yzhang

[#6]

@Wes Floyd are you still having issues with this? Can you accept best answer or provide your own solution?

[#7]

Hi @Artem Ervits, what is the configuration name to set the tez job name? is it --hiveconf hive.query.name=myjobname ?

[#8]

Just wanted to give an update on this thread.

This feature is available in HDP 2.3.4. However, the value set for hive.query.name will not show up in Resource Manager UI instead it will show in Tez UI because Hive re-uses YARN applications to run multiple diff queries by different users.

RM UI displays the yarn application name and in Hive/tez we reuse applications heavily so there is no 1-1 relationship between application and DAG or query.