- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Setting execution type as tez inside pig script.
- Labels:
-
Apache Pig
-
Apache Tez
Created ‎07-12-2016 03:19 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Is there any way setting up execution mode as tez inside pig script.
i have tried various variation of set exectype=tez to use inside pig script but its not working.
I know it can be done through command line as pig -x tez -f filename
But in the HDPCD certification preparation task, question is asked like
Question: Write a pig script that satsifies following criteria
1. run the pig query using tez as execution engine
2. load data from hive table to pig using hcatalog
So i am confused whether we have to set something inside pig script that will make script run through TEZ.
Created ‎08-04-2016 08:54 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@pankaj chaturvedi You cannot make Pig run with the Tez execution engine via a Pig script. The "Pig Script" row in the first table of Running Pig with the Tez Execution Engine is wrong.
Instead, look at the same doc link and configure Pig to run with Tez by following the information in the "Command Line" or "Pig Properties" row of the table.
I will file a doc bug to have this fixed.
Let me know if this post does not solve your problem.
Created ‎08-05-2016 12:23 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Also, you can use Java, as @daijy notes. So in summary you should be able to make Pig run on Tez by one of the methods in the first 3 rows of table 1 in Running Pig with the Tez Execution Engine (command line, the pig.properties file, or Java).
Created ‎08-07-2016 03:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for the clarification, if possible let us know once documentation is corrected.
Created ‎08-04-2016 10:37 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
This is a mistake in document. You cannot "set exectype=tez;" in a pig script. You will need to set it in pig.properties, pig command line or JVM option.

- « Previous
-
- 1
- 2
- Next »