Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 12-11-2015 11:41 AM
Sometimes I insert data to hive table using two ways:Hive and Hive on Tez.The HDFS output file size is twice when using hive on Tez. It take up more hdfs space.Is there any configurations to reduce the size?
Created 12-11-2015 02:50 PM
Have you looked into CompressedStorage features on Hive?
You should be able to use this (for Snappy at least):
SET hive.exec.compress.output=true; SET mapred.output.compression.codec=org.apache.hadoop.io.compress.SnappyCodec; SET mapred.output.compression.type=BLOCK;
Created 12-11-2015 02:50 PM
Have you looked into CompressedStorage features on Hive?
You should be able to use this (for Snappy at least):
SET hive.exec.compress.output=true; SET mapred.output.compression.codec=org.apache.hadoop.io.compress.SnappyCodec; SET mapred.output.compression.type=BLOCK;
Created 02-03-2016 03:46 PM
@Jun Chen are you still having issues with this? Can you accept best answer or provide your own solution?