Created on 03-25-2017 11:34 AM - edited 08-18-2019 03:25 AM
Hi all, I runned my job which is an importation to hbase with sqoop, and in resource manager my job has no "Reduce Phase". Is it possible?
Thanks
Created 03-25-2017 11:40 AM
The purpose of the Reducer is to aggregate the input values and return a single output value. By default sqoop job is a map only job. It does not utilize the reducer by default, unless .... mentioned in the following link: https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+MR+Execution+Engine#SqoopMRExecutionEngine-C...
Another old blog with some example to explain the similar scenario: https://dataandstats.wordpress.com/2014/12/04/apache-sqoop-only-mappers-with-no-reducers/
Created 03-25-2017 11:40 AM
The purpose of the Reducer is to aggregate the input values and return a single output value. By default sqoop job is a map only job. It does not utilize the reducer by default, unless .... mentioned in the following link: https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+MR+Execution+Engine#SqoopMRExecutionEngine-C...
Another old blog with some example to explain the similar scenario: https://dataandstats.wordpress.com/2014/12/04/apache-sqoop-only-mappers-with-no-reducers/
Created 03-25-2017 11:48 AM
Thanks @Jay SenSharma