Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 03-22-2016 06:08 AM
Created 03-22-2016 01:39 PM
The command set hive.enforce.bucketing = true; allows the correct number of reducers and the cluster by column to be automatically selected based on the table. Otherwise, you would need to set the number of reducers to be the same as the number of buckets.
Created 03-22-2016 11:40 AM
As per hive documentation what you have specified at the time of creation of bucket table with no.of buckets is become the number of reducers.If you have huge data single file contains different data.
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL+BucketedTables
Created 03-22-2016 01:39 PM
@ thanks Kazan, there is bit correction with your ans,The command set hive.enforce.bucketing = true; allows the correct number of reducers and the cluster by column to be automatically selected based on the table. Otherwise, you would need to set the number of reducers to be the same as the number of buckets.
Created 03-22-2016 01:39 PM
The command set hive.enforce.bucketing = true; allows the correct number of reducers and the cluster by column to be automatically selected based on the table. Otherwise, you would need to set the number of reducers to be the same as the number of buckets.