Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does pig uses mapreduce in backend in tezmode?

SOLVED Go to solution
Highlighted

Does pig uses mapreduce in backend in tezmode?

Rising Star
 
1 ACCEPTED SOLUTION

Accepted Solutions

Re: Does pig uses mapreduce in backend in tezmode?

Mentor

There are four modes available, mapreduce, local, tez and tez_local. You pass the mode with -x switch. With version 0.15 of pig, tez and tez_local are recommended for better performance, in tez modes pig uses tez execution engine and by default it is still mapreduce mode, in which pig uses MR as execution engine. At some point tez will be a default engine.

5 REPLIES 5

Re: Does pig uses mapreduce in backend in tezmode?

Its configurable, run pig -x tez and it will use tez.

Tez is a processing engine not too unlikely to spark that can run mapreduce tasks but many other tasks as well. For Pig tez executes the mapreduce code that is generated by pig but it handles the shuffle etc. in its own way.

Re: Does pig uses mapreduce in backend in tezmode?

Mentor

There are four modes available, mapreduce, local, tez and tez_local. You pass the mode with -x switch. With version 0.15 of pig, tez and tez_local are recommended for better performance, in tez modes pig uses tez execution engine and by default it is still mapreduce mode, in which pig uses MR as execution engine. At some point tez will be a default engine.

Re: Does pig uses mapreduce in backend in tezmode?

@Mahesh Deshmukh

Short answer is Yes and you can configure pig as you like

Please see this tutorial http://hortonworks.com/hadoop-tutorial/faster-pig-tez/

Re: Does pig uses mapreduce in backend in tezmode?

Rising Star

thanks all for your response.

Re: Does pig uses mapreduce in backend in tezmode?

@Mahesh Deshmukh You can close the thread as looks like all the answers are almost same.