Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 03-25-2017 11:34 AM - edited 08-18-2019 03:25 AM
Hi all,
I runned my job which is an importation to hbase with sqoop, and in resource manager my job has no "Reduce Phase". Is it possible?
Thanks
Created 03-25-2017 11:40 AM
The purpose of the Reducer is to aggregate the input values and return a single output value. By default sqoop job is a map only job. It does not utilize the reducer by default, unless .... mentioned in the following link: https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+MR+Execution+Engine#SqoopMRExecutionEngine-C...
Another old blog with some example to explain the similar scenario: https://dataandstats.wordpress.com/2014/12/04/apache-sqoop-only-mappers-with-no-reducers/
Created 03-25-2017 11:40 AM
The purpose of the Reducer is to aggregate the input values and return a single output value. By default sqoop job is a map only job. It does not utilize the reducer by default, unless .... mentioned in the following link: https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+MR+Execution+Engine#SqoopMRExecutionEngine-C...
Another old blog with some example to explain the similar scenario: https://dataandstats.wordpress.com/2014/12/04/apache-sqoop-only-mappers-with-no-reducers/
Created 03-25-2017 11:48 AM
Thanks @Jay SenSharma