Reply
Explorer
Posts: 32
Registered: ‎09-29-2016
Accepted Solution

Hive explain Table Parameters: totalSize doesn't match actual file size

I have a parquet managerd table

When i run du command it give me below size of table 

33.1 GB hdfs dfs -du -s -h /data/warehouse/test.db/test

But when i run 

describe formatted test.test it shows 

DataSize 4449777684
totalSize 11998371425

 

I already run 

ANALYZE TABLE  COMPUTE STATISTICS

ANALYZE TABLE  COMPUTE STATISTICS FOR COLUMNS

 

Why the size are not match

Cloudera Employee
Posts: 294
Registered: ‎03-23-2015

Re: Hive explain Table Parameters: totalSize doesn't match actual file size

hdfs dfs -du command returns the TOTAL size in HDFS, including all replicas. By default the replica is 3.

The totalSize returned in Hive is only the actual size of the table itself, which is only 1 copy, so 11998371425 * 3 = 35995114275 = 33GB.
Explorer
Posts: 32
Registered: ‎09-29-2016

Re: Hive explain Table Parameters: totalSize doesn't match actual file size

Thank you for your reply Eric 

Du return 2 number. 99.4 is replica of the data right

hdfs dfs -du -s -h /data/warehouse/test.db/test
33.1 G 99.4 G /data/warehouse/test.db/test

Explorer
Posts: 32
Registered: ‎09-29-2016

Re: Hive explain Table Parameters: totalSize doesn't match actual file size

Du return 2 number. 99.4 is replica of the data

hdfs dfs -du -s -h /data/warehouse/test.db/test
33.1 G 99.4 G /data/warehouse/test.db/test

Please help 

Highlighted
Explorer
Posts: 32
Registered: ‎09-29-2016

Re: Hive explain Table Parameters: totalSize doesn't match actual file size

Please correct me if i am wrong 

Cloudera Employee
Posts: 294
Registered: ‎03-23-2015

Re: Hive explain Table Parameters: totalSize doesn't match actual file size

Yeah, you are correct. After 3 replicas it is 99.4GB.

Can you please share the output of

SHOW CREATE TABLE test.test?

and output of:

hdfs dfs -ls -R /data/warehouse/test.db/test
Explorer
Posts: 32
Registered: ‎09-29-2016

Re: Hive explain Table Parameters: totalSize doesn't match actual file size

CREATE TABLE `test.test`(
)
ROW FORMAT SERDE
'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe'
STORED AS INPUTFORMAT
'org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat'
LOCATION
'hdfs://usasprd1/data/warehouse/test.db/test'
TBLPROPERTIES (
'COLUMN_STATS_ACCURATE'='true',
'last_modified_by'='hive',
'last_modified_time'='1530552484',
'numFiles'='54',
'numRows'='134841748',
'rawDataSize'='4449777684',
'totalSize'='11998371425',
'transient_lastDdlTime'='1531324826')

 

repopulate so size is different but still not match 11998371425.

Already did analyze 

hdfs dfs -du -s -h /data/warehouse/test.db/test/
22.5 G 67.4 G /data/warehouse/test.db/test

 

-rwxrwx--x+ 3 hive hive 367910722 2018-07-02 19:31 /data/warehouse/test.db/test/000000_0
-rwxrwx--x+ 3 hive hive 367471711 2018-07-02 19:31 /data/warehouse/test.db/test/000001_0
-rwxrwx--x+ 3 hive hive 367046633 2018-07-02 19:31 /data/warehouse/test.db/test/000002_0
-rwxrwx--x+ 3 hive hive 316203889 2018-07-02 19:30 /data/warehouse/test.db/test/000003_0
-rwxrwx--x+ 3 hive hive 316181782 2018-07-02 19:30 /data/warehouse/test.db/test/000004_0
-rwxrwx--x+ 3 hive hive 315975500 2018-07-02 19:30 /data/warehouse/test.db/test/000005_0
-rwxrwx--x+ 3 hive hive 315922390 2018-07-02 19:30 /data/warehouse/test.db/test/000006_0
-rwxrwx--x+ 3 hive hive 315912232 2018-07-02 19:30 /data/warehouse/test.db/test/000007_0
-rwxrwx--x+ 3 hive hive 315885689 2018-07-02 19:30 /data/warehouse/test.db/test/000008_0
-rwxrwx--x+ 3 hive hive 315619051 2018-07-02 19:30 /data/warehouse/test.db/test/000009_0
-rwxrwx--x+ 3 hive hive 289731869 2018-07-02 19:30 /data/warehouse/test.db/test/000010_0
-rwxrwx--x+ 3 hive hive 261527233 2018-07-02 19:30 /data/warehouse/test.db/test/000011_0
-rwxrwx--x+ 3 hive hive 261535458 2018-07-02 19:30 /data/warehouse/test.db/test/000012_0
-rwxrwx--x+ 3 hive hive 261509341 2018-07-02 19:30 /data/warehouse/test.db/test/000013_0
-rwxrwx--x+ 3 hive hive 261542760 2018-07-02 19:30 /data/warehouse/test.db/test/000014_0
-rwxrwx--x+ 3 hive hive 261584890 2018-07-02 19:30 /data/warehouse/test.db/test/000015_0
-rwxrwx--x+ 3 hive hive 261550533 2018-07-02 19:30 /data/warehouse/test.db/test/000016_0
-rwxrwx--x+ 3 hive hive 261539025 2018-07-02 19:30 /data/warehouse/test.db/test/000017_0
-rwxrwx--x+ 3 hive hive 261516408 2018-07-02 19:30 /data/warehouse/test.db/test/000018_0
-rwxrwx--x+ 3 hive hive 261904082 2018-07-02 19:30 /data/warehouse/test.db/test/000019_0
-rwxrwx--x+ 3 hive hive 261522663 2018-07-02 19:30 /data/warehouse/test.db/test/000020_0
-rwxrwx--x+ 3 hive hive 261570466 2018-07-02 19:30 /data/warehouse/test.db/test/000021_0
-rwxrwx--x+ 3 hive hive 261536035 2018-07-02 19:30 /data/warehouse/test.db/test/000022_0
-rwxrwx--x+ 3 hive hive 261490152 2018-07-02 19:30 /data/warehouse/test.db/test/000023_0
-rwxrwx--x+ 3 hive hive 261512588 2018-07-02 19:30 /data/warehouse/test.db/test/000024_0
-rwxrwx--x+ 3 hive hive 261515184 2018-07-02 19:30 /data/warehouse/test.db/test/000025_0
-rwxrwx--x+ 3 hive hive 261515829 2018-07-02 19:30 /data/warehouse/test.db/test/000026_0
-rwxrwx--x+ 3 hive hive 261545935 2018-07-02 19:30 /data/warehouse/test.db/test/000027_0
-rwxrwx--x+ 3 hive hive 261568153 2018-07-02 19:30 /data/warehouse/test.db/test/000028_0
-rwxrwx--x+ 3 hive hive 261881698 2018-07-02 19:30 /data/warehouse/test.db/test/000029_0
-rwxrwx--x+ 3 hive hive 233055511 2018-07-02 19:30 /data/warehouse/test.db/test/000030_0
-rwxrwx--x+ 3 hive hive 233060147 2018-07-02 19:30 /data/warehouse/test.db/test/000031_0
-rwxrwx--x+ 3 hive hive 232552454 2018-07-02 19:30 /data/warehouse/test.db/test/000032_0
-rwxrwx--x+ 3 hive hive 181403967 2018-07-02 19:30 /data/warehouse/test.db/test/000033_0
-rwxrwx--x+ 3 hive hive 181423669 2018-07-02 19:30 /data/warehouse/test.db/test/000034_0
-rwxrwx--x+ 3 hive hive 181260203 2018-07-02 19:30 /data/warehouse/test.db/test/000035_0
-rwxrwx--x+ 3 hive hive 181226055 2018-07-02 19:30 /data/warehouse/test.db/test/000036_0
-rwxrwx--x+ 3 hive hive 181211848 2018-07-02 19:30 /data/warehouse/test.db/test/000037_0
-rwxrwx--x+ 3 hive hive 127307473 2018-07-02 19:29 /data/warehouse/test.db/test/000038_0
-rwxrwx--x+ 3 hive hive 127324022 2018-07-02 19:29 /data/warehouse/test.db/test/000039_0
-rwxrwx--x+ 3 hive hive 98865763 2018-07-02 19:29 /data/warehouse/test.db/test/000040_0
-rwxrwx--x+ 3 hive hive 98650885 2018-07-02 19:29 /data/warehouse/test.db/test/000041_0
-rwxrwx--x+ 3 hive hive 240568542 2018-07-02 19:29 /data/warehouse/test.db/test/000042_0
-rwxrwx--x+ 3 hive hive 240384660 2018-07-02 19:29 /data/warehouse/test.db/test/000043_0
-rwxrwx--x+ 3 hive hive 47556388 2018-07-02 19:29 /data/warehouse/test.db/test/000044_0
-rwxrwx--x+ 3 hive hive 47553467 2018-07-02 19:29 /data/warehouse/test.db/test/000045_0
-rwxrwx--x+ 3 hive hive 47214429 2018-07-02 19:29 /data/warehouse/test.db/test/000046_0
-rwxrwx--x+ 3 hive hive 47008567 2018-07-02 19:29 /data/warehouse/test.db/test/000047_0
-rwxrwx--x+ 3 hive hive 116398133 2018-07-02 19:29 /data/warehouse/test.db/test/000048_0
-rwxrwx--x+ 3 hive hive 116264278 2018-07-02 19:29 /data/warehouse/test.db/test/000049_0
-rwxrwx--x+ 3 hive hive 116108618 2018-07-02 19:29 /data/warehouse/test.db/test/000050_0
-rwxrwx--x+ 3 hive hive 116102337 2018-07-02 19:29 /data/warehouse/test.db/test/000051_0
-rwxrwx--x+ 3 hive hive 116197882 2018-07-02 19:29 /data/warehouse/test.db/test/000052_0
-rwxrwx--x+ 3 hive hive 115942226 2018-07-02 19:29 /data/warehouse/test.db/test/000053_0
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000000_2105670738_dir
-rwxrwx--x+ 3 hive hive 198160 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000000_2105670738_dir/c6473ef4a4aff1c5-97654d1e00000000_372249781_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000001_539358072_dir
-rwxrwx--x+ 3 hive hive 191858 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000001_539358072_dir/c6473ef4a4aff1c5-97654d1e00000001_497911501_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000003_201543806_dir
-rwxrwx--x+ 3 hive hive 198255 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000003_201543806_dir/c6473ef4a4aff1c5-97654d1e00000003_1954232146_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000004_430812106_dir
-rwxrwx--x+ 3 hive hive 196661 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000004_430812106_dir/c6473ef4a4aff1c5-97654d1e00000004_1303838926_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000006_1445626883_dir
-rwxrwx--x+ 3 hive hive 198692 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000006_1445626883_dir/c6473ef4a4aff1c5-97654d1e00000006_427021246_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000007_2105670738_dir
-rwxrwx--x+ 3 hive hive 189234 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000007_2105670738_dir/c6473ef4a4aff1c5-97654d1e00000007_372249781_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000008_1712792446_dir
-rwxrwx--x+ 3 hive hive 191664 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000008_1712792446_dir/c6473ef4a4aff1c5-97654d1e00000008_2033565865_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000009_889847462_dir
-rwxrwx--x+ 3 hive hive 191028 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000009_889847462_dir/c6473ef4a4aff1c5-97654d1e00000009_455426067_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000a_2105670738_dir
-rwxrwx--x+ 3 hive hive 191804 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000a_2105670738_dir/c6473ef4a4aff1c5-97654d1e0000000a_372249781_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000b_1200230056_dir
-rwxrwx--x+ 3 hive hive 188807 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000b_1200230056_dir/c6473ef4a4aff1c5-97654d1e0000000b_154797175_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000c_41928458_dir
-rwxrwx--x+ 3 hive hive 190041 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000c_41928458_dir/c6473ef4a4aff1c5-97654d1e0000000c_2105670738_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000e_430812106_dir
-rwxrwx--x+ 3 hive hive 190247 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000e_430812106_dir/c6473ef4a4aff1c5-97654d1e0000000e_1303838926_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000f_818141150_dir
-rwxrwx--x+ 3 hive hive 189097 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000000f_818141150_dir/c6473ef4a4aff1c5-97654d1e0000000f_430812106_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000010_430812106_dir
-rwxrwx--x+ 3 hive hive 189674 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000010_430812106_dir/c6473ef4a4aff1c5-97654d1e00000010_1303838926_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000011_430812106_dir
-rwxrwx--x+ 3 hive hive 188682 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000011_430812106_dir/c6473ef4a4aff1c5-97654d1e00000011_1303838926_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000012_504389356_dir
-rwxrwx--x+ 3 hive hive 199549 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000012_504389356_dir/c6473ef4a4aff1c5-97654d1e00000012_35243077_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000013_204459993_dir
-rwxrwx--x+ 3 hive hive 189081 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000013_204459993_dir/c6473ef4a4aff1c5-97654d1e00000013_289499470_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000014_818141150_dir
-rwxrwx--x+ 3 hive hive 189618 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000014_818141150_dir/c6473ef4a4aff1c5-97654d1e00000014_430812106_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000015_818141150_dir
-rwxrwx--x+ 3 hive hive 187391 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000015_818141150_dir/c6473ef4a4aff1c5-97654d1e00000015_430812106_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000016_1470504203_dir
-rwxrwx--x+ 3 hive hive 188783 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000016_1470504203_dir/c6473ef4a4aff1c5-97654d1e00000016_818141150_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000017_1908337438_dir
-rwxrwx--x+ 3 hive hive 190917 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000017_1908337438_dir/c6473ef4a4aff1c5-97654d1e00000017_1642311642_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000018_89561857_dir
-rwxrwx--x+ 3 hive hive 191811 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000018_89561857_dir/c6473ef4a4aff1c5-97654d1e00000018_504389356_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000019_89561857_dir
-rwxrwx--x+ 3 hive hive 199804 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000019_89561857_dir/c6473ef4a4aff1c5-97654d1e00000019_504389356_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001a_430812106_dir
-rwxrwx--x+ 3 hive hive 189869 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001a_430812106_dir/c6473ef4a4aff1c5-97654d1e0000001a_1303838926_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001b_89561857_dir
-rwxrwx--x+ 3 hive hive 189359 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001b_89561857_dir/c6473ef4a4aff1c5-97654d1e0000001b_504389356_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001c_1594731110_dir
-rwxrwx--x+ 3 hive hive 190337 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001c_1594731110_dir/c6473ef4a4aff1c5-97654d1e0000001c_909335710_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001d_909335710_dir
-rwxrwx--x+ 3 hive hive 198520 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001d_909335710_dir/c6473ef4a4aff1c5-97654d1e0000001d_89561857_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001f_204459993_dir
-rwxrwx--x+ 3 hive hive 189651 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000001f_204459993_dir/c6473ef4a4aff1c5-97654d1e0000001f_289499470_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000020_204459993_dir
-rwxrwx--x+ 3 hive hive 190786 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000020_204459993_dir/c6473ef4a4aff1c5-97654d1e00000020_289499470_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000021_1303838926_dir
-rwxrwx--x+ 3 hive hive 187068 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000021_1303838926_dir/c6473ef4a4aff1c5-97654d1e00000021_889847462_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000023_1592629146_dir
-rwxrwx--x+ 3 hive hive 191021 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000023_1592629146_dir/c6473ef4a4aff1c5-97654d1e00000023_1508635095_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000024_909335710_dir
-rwxrwx--x+ 3 hive hive 189046 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000024_909335710_dir/c6473ef4a4aff1c5-97654d1e00000024_89561857_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000025_1594731110_dir
-rwxrwx--x+ 3 hive hive 198569 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000025_1594731110_dir/c6473ef4a4aff1c5-97654d1e00000025_909335710_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000026_1594731110_dir
-rwxrwx--x+ 3 hive hive 190048 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000026_1594731110_dir/c6473ef4a4aff1c5-97654d1e00000026_909335710_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000028_1071593251_dir
-rwxrwx--x+ 3 hive hive 189253 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000028_1071593251_dir/c6473ef4a4aff1c5-97654d1e00000028_656030523_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000029_289499470_dir
-rwxrwx--x+ 3 hive hive 198856 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e00000029_289499470_dir/c6473ef4a4aff1c5-97654d1e00000029_2082616914_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000002b_89561857_dir
-rwxrwx--x+ 3 hive hive 190164 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/c6473ef4a4aff1c5_97654d1e00000000/.c6473ef4a4aff1c5-97654d1e0000002b_89561857_dir/c6473ef4a4aff1c5-97654d1e0000002b_504389356_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000000_103358247_dir
-rwxrwx--x+ 3 hive hive 189672 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000000_103358247_dir/ee49ddc9ea1e6ab3-db0ad5100000000_64130302_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000001_103358247_dir
-rwxrwx--x+ 3 hive hive 198081 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000001_103358247_dir/ee49ddc9ea1e6ab3-db0ad5100000001_64130302_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000002_1775557661_dir
-rwxrwx--x+ 3 hive hive 198713 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000002_1775557661_dir/ee49ddc9ea1e6ab3-db0ad5100000002_208644362_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000003_366965898_dir
-rwxrwx--x+ 3 hive hive 198255 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000003_366965898_dir/ee49ddc9ea1e6ab3-db0ad5100000003_1095655744_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000004_1658557076_dir
-rwxrwx--x+ 3 hive hive 196661 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000004_1658557076_dir/ee49ddc9ea1e6ab3-db0ad5100000004_2080684887_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000005_2080684887_dir
-rwxrwx--x+ 3 hive hive 189399 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000005_2080684887_dir/ee49ddc9ea1e6ab3-db0ad5100000005_2132751012_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000006_299885815_dir
-rwxrwx--x+ 3 hive hive 198692 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000006_299885815_dir/ee49ddc9ea1e6ab3-db0ad5100000006_2138387494_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000007_103358247_dir
-rwxrwx--x+ 3 hive hive 189856 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000007_103358247_dir/ee49ddc9ea1e6ab3-db0ad5100000007_64130302_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000008_208644362_dir
-rwxrwx--x+ 3 hive hive 191664 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000008_208644362_dir/ee49ddc9ea1e6ab3-db0ad5100000008_749395383_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000009_1742846925_dir
-rwxrwx--x+ 3 hive hive 191028 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000009_1742846925_dir/ee49ddc9ea1e6ab3-db0ad5100000009_249944867_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000a_1658557076_dir
-rwxrwx--x+ 3 hive hive 191804 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000a_1658557076_dir/ee49ddc9ea1e6ab3-db0ad510000000a_2080684887_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000b_1232039013_dir
-rwxrwx--x+ 3 hive hive 188339 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000b_1232039013_dir/ee49ddc9ea1e6ab3-db0ad510000000b_1724061052_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000c_2110769147_dir
-rwxrwx--x+ 3 hive hive 190041 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000c_2110769147_dir/ee49ddc9ea1e6ab3-db0ad510000000c_1658557076_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000d_2080684887_dir
-rwxrwx--x+ 3 hive hive 190027 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000d_2080684887_dir/ee49ddc9ea1e6ab3-db0ad510000000d_2132751012_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000e_459194874_dir
-rwxrwx--x+ 3 hive hive 198859 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000e_459194874_dir/ee49ddc9ea1e6ab3-db0ad510000000e_1794854069_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000f_1509661478_dir
-rwxrwx--x+ 3 hive hive 189097 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000000f_1509661478_dir/ee49ddc9ea1e6ab3-db0ad510000000f_459194874_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000010_459194874_dir
-rwxrwx--x+ 3 hive hive 189674 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000010_459194874_dir/ee49ddc9ea1e6ab3-db0ad5100000010_1794854069_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000011_459194874_dir
-rwxrwx--x+ 3 hive hive 191388 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000011_459194874_dir/ee49ddc9ea1e6ab3-db0ad5100000011_1794854069_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000012_2055542707_dir
-rwxrwx--x+ 3 hive hive 192191 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000012_2055542707_dir/ee49ddc9ea1e6ab3-db0ad5100000012_486520041_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000013_1981261782_dir
-rwxrwx--x+ 3 hive hive 189091 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000013_1981261782_dir/ee49ddc9ea1e6ab3-db0ad5100000013_1397523618_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000014_1224861606_dir
-rwxrwx--x+ 3 hive hive 189618 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000014_1224861606_dir/ee49ddc9ea1e6ab3-db0ad5100000014_2015483939_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000015_1509661478_dir
-rwxrwx--x+ 3 hive hive 187391 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000015_1509661478_dir/ee49ddc9ea1e6ab3-db0ad5100000015_459194874_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000016_1240087244_dir
-rwxrwx--x+ 3 hive hive 188783 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000016_1240087244_dir/ee49ddc9ea1e6ab3-db0ad5100000016_1509661478_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000017_1348280926_dir
-rwxrwx--x+ 3 hive hive 190917 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000017_1348280926_dir/ee49ddc9ea1e6ab3-db0ad5100000017_1999868437_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000019_1501051347_dir
-rwxrwx--x+ 3 hive hive 190498 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000019_1501051347_dir/ee49ddc9ea1e6ab3-db0ad5100000019_1653124156_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001a_1397523618_dir
-rwxrwx--x+ 3 hive hive 189869 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001a_1397523618_dir/ee49ddc9ea1e6ab3-db0ad510000001a_1501051347_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001b_292368280_dir
-rwxrwx--x+ 3 hive hive 189359 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001b_292368280_dir/ee49ddc9ea1e6ab3-db0ad510000001b_196274898_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001c_1379540145_dir
-rwxrwx--x+ 3 hive hive 189653 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001c_1379540145_dir/ee49ddc9ea1e6ab3-db0ad510000001c_195689393_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001d_802814478_dir
-rwxrwx--x+ 3 hive hive 189700 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001d_802814478_dir/ee49ddc9ea1e6ab3-db0ad510000001d_292368280_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001e_196274898_dir
-rwxrwx--x+ 3 hive hive 198079 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001e_196274898_dir/ee49ddc9ea1e6ab3-db0ad510000001e_1775035924_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001f_1379540145_dir
-rwxrwx--x+ 3 hive hive 192717 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000001f_1379540145_dir/ee49ddc9ea1e6ab3-db0ad510000001f_195689393_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000020_1686465697_dir
-rwxrwx--x+ 3 hive hive 190786 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000020_1686465697_dir/ee49ddc9ea1e6ab3-db0ad5100000020_802814478_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000021_1501051347_dir
-rwxrwx--x+ 3 hive hive 191368 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000021_1501051347_dir/ee49ddc9ea1e6ab3-db0ad5100000021_1653124156_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000023_1672430085_dir
-rwxrwx--x+ 3 hive hive 191021 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000023_1672430085_dir/ee49ddc9ea1e6ab3-db0ad5100000023_827383921_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000024_195689393_dir
-rwxrwx--x+ 3 hive hive 190190 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000024_195689393_dir/ee49ddc9ea1e6ab3-db0ad5100000024_145298882_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000025_1071593251_dir
-rwxrwx--x+ 3 hive hive 198569 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000025_1071593251_dir/ee49ddc9ea1e6ab3-db0ad5100000025_656030523_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000026_1379540145_dir
-rwxrwx--x+ 3 hive hive 190048 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000026_1379540145_dir/ee49ddc9ea1e6ab3-db0ad5100000026_195689393_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000027_656030523_dir
-rwxrwx--x+ 3 hive hive 189612 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000027_656030523_dir/ee49ddc9ea1e6ab3-db0ad5100000027_2139712501_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000028_372249549_dir
-rwxrwx--x+ 3 hive hive 189253 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000028_372249549_dir/ee49ddc9ea1e6ab3-db0ad5100000028_89180712_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000029_656030523_dir
-rwxrwx--x+ 3 hive hive 191232 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad5100000029_656030523_dir/ee49ddc9ea1e6ab3-db0ad5100000029_2139712501_data.0.
drwxrwx--x+ - hive hive 0 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000002b_145298882_dir
-rwxrwx--x+ 3 hive hive 189856 2018-05-04 18:56 /data/warehouse/test.db/test/_impala_insert_staging/ee49ddc9ea1e6ab3_db0ad5100000000/.ee49ddc9ea1e6ab3-db0ad510000002b_145298882_dir/ee49ddc9ea1e6ab3-db0ad510000002b_1950458973_data.0.

Explorer
Posts: 32
Registered: ‎09-29-2016

Re: Hive explain Table Parameters: totalSize doesn't match actual file size

Got it!!. The size of real data files is matched 11998371425.

There are some hidden intermediate file so it doesn't match du number

Announcements