Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Counters of Job - no Reduced?

avatar
Rising Star

Hi all, I runned my job which is an importation to hbase with sqoop, and in resource manager my job has no "Reduce Phase". Is it possible? 14036-job-stats2.png

14035-job-stats.png

Thanks

1 ACCEPTED SOLUTION

avatar
Master Mentor

@Francisco Pires

The purpose of the Reducer is to aggregate the input values and return a single output value. By default sqoop job is a map only job. It does not utilize the reducer by default, unless .... mentioned in the following link: https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+MR+Execution+Engine#SqoopMRExecutionEngine-C...

Another old blog with some example to explain the similar scenario: https://dataandstats.wordpress.com/2014/12/04/apache-sqoop-only-mappers-with-no-reducers/

View solution in original post

2 REPLIES 2

avatar
Master Mentor

@Francisco Pires

The purpose of the Reducer is to aggregate the input values and return a single output value. By default sqoop job is a map only job. It does not utilize the reducer by default, unless .... mentioned in the following link: https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+MR+Execution+Engine#SqoopMRExecutionEngine-C...

Another old blog with some example to explain the similar scenario: https://dataandstats.wordpress.com/2014/12/04/apache-sqoop-only-mappers-with-no-reducers/

avatar
Rising Star