Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Does pig uses mapreduce in backend in tezmode?

avatar
Expert Contributor
 
1 ACCEPTED SOLUTION

avatar
Master Mentor

There are four modes available, mapreduce, local, tez and tez_local. You pass the mode with -x switch. With version 0.15 of pig, tez and tez_local are recommended for better performance, in tez modes pig uses tez execution engine and by default it is still mapreduce mode, in which pig uses MR as execution engine. At some point tez will be a default engine.

View solution in original post

5 REPLIES 5

avatar
Master Guru

Its configurable, run pig -x tez and it will use tez.

Tez is a processing engine not too unlikely to spark that can run mapreduce tasks but many other tasks as well. For Pig tez executes the mapreduce code that is generated by pig but it handles the shuffle etc. in its own way.

avatar
Master Mentor

There are four modes available, mapreduce, local, tez and tez_local. You pass the mode with -x switch. With version 0.15 of pig, tez and tez_local are recommended for better performance, in tez modes pig uses tez execution engine and by default it is still mapreduce mode, in which pig uses MR as execution engine. At some point tez will be a default engine.

avatar
Master Mentor
@Mahesh Deshmukh

Short answer is Yes and you can configure pig as you like

Please see this tutorial http://hortonworks.com/hadoop-tutorial/faster-pig-tez/

avatar
Expert Contributor

thanks all for your response.

avatar
Master Mentor

@Mahesh Deshmukh You can close the thread as looks like all the answers are almost same.