Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 04-23-2018 12:08 PM
When I run Pig scripts in Tez execution mode, they appear in the Tez UI as expected. But when I call those same scripts from a Pig action, they don't appear in the Tez UI. I can see them running from the Resource Manager screens, but clicking on the "Tracking UI" link displays the following message:
Tez UI Url is not defined. To enable tracking url pointing to Tez UI, set the config tez.tez-ui.history-url.base in the tez-site.xml.
I have defined tez.tez-ui.history-url.base in the tez-site config in Ambari, so I'm guessing there's some sort of Oozie configuration needed? I tried adding a tez.tez-ui.history-url.base property to the global configuration of my Oozie workflows, set to the same value as found in the tez-site config, but that didn't resolve the issue.
Created 04-25-2018 01:55 AM
@Jeff Rosenberg - Did you try passing tez-site.xml to pig action?
Created 04-25-2018 01:24 AM
You will have to pass -x tez as an argument in your workflow.xml to run pig job via TEZ
... Your workflow.xml ... <script>yourscript.pig</script> <argument>-x</argument> <argument>tez</argument> ... Your workflow.xml ...
Created 04-25-2018 01:50 AM
Thanks, but I'm already doing this. I can confirm that my script runs in Tez mode, but it doesn't appear in the Tez UI.
Created 04-25-2018 01:55 AM
@Jeff Rosenberg - Did you try passing tez-site.xml to pig action?
Created 04-25-2018 01:59 AM
No, I didn't try that. I did pass in the tez.tez-ui.history-url.base property, but not the whole tez-site.xml. How do I manage that from within the Oozie Pig Action?
Created 04-25-2018 03:42 PM
Passing tez-site.xml to the Pig action resolved my issue. I was able to do that by adding a <file> element to my workflow:
<file>/path/to/tez-site.xml</file>
Created 04-25-2018 04:07 PM
@Kuldeep Kulkarni if you post the tez-site solution as a separate answer, I'll mark it as accepted so folks can easily find it. 🙂
Created 04-25-2018 04:57 PM
@Jeff Rosenberg - Done. Please accept my answer when you get a chance! Glad to know that your issue is resolved 🙂