Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Counters of Job - no Reduced?

Solved Go to solution
Highlighted

Counters of Job - no Reduced?

Rising Star

Hi all, I runned my job which is an importation to hbase with sqoop, and in resource manager my job has no "Reduce Phase". Is it possible? 14036-job-stats2.png

14035-job-stats.png

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Counters of Job - no Reduced?

Super Mentor

@Francisco Pires

The purpose of the Reducer is to aggregate the input values and return a single output value. By default sqoop job is a map only job. It does not utilize the reducer by default, unless .... mentioned in the following link: https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+MR+Execution+Engine#SqoopMRExecutionEngine-C...

Another old blog with some example to explain the similar scenario: https://dataandstats.wordpress.com/2014/12/04/apache-sqoop-only-mappers-with-no-reducers/

2 REPLIES 2

Re: Counters of Job - no Reduced?

Super Mentor

@Francisco Pires

The purpose of the Reducer is to aggregate the input values and return a single output value. By default sqoop job is a map only job. It does not utilize the reducer by default, unless .... mentioned in the following link: https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+MR+Execution+Engine#SqoopMRExecutionEngine-C...

Another old blog with some example to explain the similar scenario: https://dataandstats.wordpress.com/2014/12/04/apache-sqoop-only-mappers-with-no-reducers/

Re: Counters of Job - no Reduced?

Rising Star