Created 07-12-2016 03:19 AM
Is there any way setting up execution mode as tez inside pig script.
i have tried various variation of set exectype=tez to use inside pig script but its not working.
I know it can be done through command line as pig -x tez -f filename
But in the HDPCD certification preparation task, question is asked like
Question: Write a pig script that satsifies following criteria
1. run the pig query using tez as execution engine
2. load data from hive table to pig using hcatalog
So i am confused whether we have to set something inside pig script that will make script run through TEZ.
Created 08-04-2016 08:54 PM
@pankaj chaturvedi You cannot make Pig run with the Tez execution engine via a Pig script. The "Pig Script" row in the first table of Running Pig with the Tez Execution Engine is wrong.
Instead, look at the same doc link and configure Pig to run with Tez by following the information in the "Command Line" or "Pig Properties" row of the table.
I will file a doc bug to have this fixed.
Let me know if this post does not solve your problem.
Created 08-05-2016 12:23 AM
Also, you can use Java, as @daijy notes. So in summary you should be able to make Pig run on Tez by one of the methods in the first 3 rows of table 1 in Running Pig with the Tez Execution Engine (command line, the pig.properties file, or Java).
Created 08-07-2016 03:04 AM
Thanks for the clarification, if possible let us know once documentation is corrected.
Created 08-04-2016 10:37 PM
This is a mistake in document. You cannot "set exectype=tez;" in a pig script. You will need to set it in pig.properties, pig command line or JVM option.