Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 07-21-2016 09:59 AM
I have create table in hive and specified compression as gzip during table creation
I am not able to find way that gzip has been applied on newly created table
is there any command which specify compression technique applied on hive.
Created 07-21-2016 10:37 AM
I am able to resolve it. issue with create and select together.
I've created table first then inserted data, now able to see gzip as tableproperties in desc command
Created 07-21-2016 10:01 AM
The compression of the table can be validated by checking the definition of the hive table using the command:
hive> describe formatted <hive_table>;
Created 07-21-2016 10:23 AM
I am able to see that compressed as No. I think I need to set configuration for compression separately in hive
Created 07-21-2016 10:36 AM
able to run ..Thanks
Created 07-21-2016 10:04 AM
What you see when you run show create table <tablename>; ?
Created 07-21-2016 10:23 AM
there is message only that query runs "succeed"
Created 07-21-2016 10:20 AM
I am running hive query using HIve view of Ambari and executing below query
CREATE TABLE t11 STORED AS parquet TBLPROPERTIES("parquet.COMPRESS"="gzip") AS SELECT * FROM abc;
Here abc table already contain some dataPost execution, it shows that query status as "Succeed"
then I verified data by executing "select * from t11".I am able to see data.
I want to verify that gzip has been applied or not.so I did not find way yet
Created 07-21-2016 10:25 AM
show create table t11;
What you get in output?
Created 07-21-2016 06:07 PM
getting below output
CREATE TABLE `t11`( `organisation` string, `org_skill` string, `emp_name` string, `pageurl` string, `cookie` string, `referurl` string, `time` string, `employeeid` string) ROW FORMAT SERDE 'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe' STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat' LOCATION 'hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/t11' TBLPROPERTIES ( 'COLUMN_STATS_ACCURATE'='true', 'numFiles'='1', 'numRows'='55', 'parquet.COMPRESS'='gzip', 'rawDataSize'='440', 'totalSize'='2046', 'transient_lastDdlTime'='1469095673')
Created 07-21-2016 10:37 AM
I am able to resolve it. issue with create and select together.
I've created table first then inserted data, now able to see gzip as tableproperties in desc command