Member since
07-19-2016
14
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6221 | 07-21-2016 10:37 AM |
07-21-2016
06:17 PM
Thanks for reply.. I've one more question the table properties showing that gzip has been applied,so i've created table post disabled hive compression.(disabled partition by setting as parquet.compress="none" in create table syntax and set hive.exec.compress.output"="false" ) but when i execute below command on both tables then i dont see any difference for size of withcompression or withoutcompression hive table. command: $> hadoop fs -du -h hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/tt1. I've set below property in hive while enabling compression $>hive.exec.compress.output","true"
... View more
07-21-2016
06:07 PM
getting below output CREATE TABLE `t11`(
`organisation` string,
`org_skill` string,
`emp_name` string,
`pageurl` string,
`cookie` string,
`referurl` string,
`time` string,
`employeeid` string)
ROW FORMAT SERDE
'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe'
STORED AS INPUTFORMAT
'org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat'
LOCATION
'hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/t11'
TBLPROPERTIES (
'COLUMN_STATS_ACCURATE'='true',
'numFiles'='1',
'numRows'='55',
'parquet.COMPRESS'='gzip',
'rawDataSize'='440',
'totalSize'='2046',
'transient_lastDdlTime'='1469095673')
... View more
07-21-2016
10:37 AM
I am able to resolve it. issue with create and select together. I've created table first then inserted data, now able to see gzip as tableproperties in desc command
... View more
07-21-2016
10:36 AM
able to run ..Thanks
... View more
07-21-2016
10:23 AM
there is message only that query runs "succeed"
... View more
07-21-2016
10:23 AM
I am able to see that compressed as No. I think I need to set configuration for compression separately in hive
... View more
07-21-2016
10:20 AM
I am running hive query using HIve view of Ambari and executing below query CREATE TABLE t11
STORED AS parquet
TBLPROPERTIES("parquet.COMPRESS"="gzip")
AS SELECT * FROM abc; Here abc table already contain some data Post execution, it shows that query status as "Succeed" then I verified data by executing "select * from t11".I am able to see data. I want to verify that gzip has been applied or not.so I did not find way yet
... View more
07-21-2016
10:09 AM
Thanks its working fine now..able to view partitioned data in hive
... View more
07-21-2016
09:59 AM
I have create table in hive and specified compression as gzip during table creation I am not able to find way that gzip has been applied on newly created table is there any command which specify compression technique applied on hive.
... View more
Labels:
- Labels:
-
Apache Hive
07-20-2016
12:12 PM
Thanks..I'll lookinto it
... View more