Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to set: Tez Job Name?

Solved Go to solution
Highlighted

How to set: Tez Job Name?

Contributor

MapReduce allowed us to set a unique job name with mapred.job.name. This allowed us to easily track jobs after execution via searching for this name in JobTracker UI and logs.

With Tez there doesn't appear to be a tez.job.name which can be set. Is there another similar config setting we can use to set a unique Tez job name/tag?

Related Jira: https://issues.apache.org/jira/browse/HIVE-12357

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to set: Tez Job Name?

Rising Star

Hey @Wes Floyd , not that I'm aware of but if you look at RMP-3737 looks like this is coming in DAL-M20 or HDP 2.3.4

7 REPLIES 7

Re: How to set: Tez Job Name?

Rising Star

Hey @Wes Floyd , not that I'm aware of but if you look at RMP-3737 looks like this is coming in DAL-M20 or HDP 2.3.4

Re: How to set: Tez Job Name?

New Contributor
@Dan Rice

Is this in HDP 2.4?

Re: How to set: Tez Job Name?

Mentor

Re: How to set: Tez Job Name?

Re: How to set: Tez Job Name?

Mentor

@Wes Floyd are you still having issues with this? Can you accept best answer or provide your own solution?

Re: How to set: Tez Job Name?

New Contributor

Hi @Artem Ervits, what is the configuration name to set the tez job name? is it --hiveconf hive.query.name=myjobname ?

Re: How to set: Tez Job Name?

New Contributor

Just wanted to give an update on this thread.

This feature is available in HDP 2.3.4. However, the value set for hive.query.name will not show up in Resource Manager UI instead it will show in Tez UI because Hive re-uses YARN applications to run multiple diff queries by different users.

RM UI displays the yarn application name and in Hive/tez we reuse applications heavily so there is no 1-1 relationship between application and DAG or query.

Don't have an account?
Coming from Hortonworks? Activate your account here