Created 07-21-2016 09:59 AM
I have create table in hive and specified compression as gzip during table creation
I am not able to find way that gzip has been applied on newly created table
is there any command which specify compression technique applied on hive.
Created 07-21-2016 10:37 AM
I am able to resolve it. issue with create and select together.
I've created table first then inserted data, now able to see gzip as tableproperties in desc command
Created 07-21-2016 10:01 AM
The compression of the table can be validated by checking the definition of the hive table using the command:
hive> describe formatted <hive_table>;
Created 07-21-2016 10:23 AM
I am able to see that compressed as No. I think I need to set configuration for compression separately in hive
Created 07-21-2016 10:36 AM
able to run ..Thanks
Created 07-21-2016 10:04 AM
What you see when you run show create table <tablename>; ?
Created 07-21-2016 10:23 AM
there is message only that query runs "succeed"
Created 07-21-2016 10:20 AM
I am running hive query using HIve view of Ambari and executing below query
CREATE TABLE t11 STORED AS parquet TBLPROPERTIES("parquet.COMPRESS"="gzip") AS SELECT * FROM abc;
Here abc table already contain some dataPost execution, it shows that query status as "Succeed"
then I verified data by executing "select * from t11".I am able to see data.
I want to verify that gzip has been applied or not.so I did not find way yet
Created 07-21-2016 10:25 AM
show create table t11;
What you get in output?
Created 07-21-2016 06:07 PM
getting below output
CREATE TABLE `t11`( `organisation` string, `org_skill` string, `emp_name` string, `pageurl` string, `cookie` string, `referurl` string, `time` string, `employeeid` string) ROW FORMAT SERDE 'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe' STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat' LOCATION 'hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/t11' TBLPROPERTIES ( 'COLUMN_STATS_ACCURATE'='true', 'numFiles'='1', 'numRows'='55', 'parquet.COMPRESS'='gzip', 'rawDataSize'='440', 'totalSize'='2046', 'transient_lastDdlTime'='1469095673')
Created 07-21-2016 10:37 AM
I am able to resolve it. issue with create and select together.
I've created table first then inserted data, now able to see gzip as tableproperties in desc command