Member since
11-11-2019
3
Posts
0
Kudos Received
0
Solutions
12-11-2019
02:46 PM
exporting a table with the following command in hive. Unfortunately data is exporting to delta folders inside the partitionse. export table test_2 to '/hive/test_2'; Data successfully exported but to delta folders like below: hadoop fs -ls /hive/test_2 Found 3 items -rw-r--r-- 3 hive hdfs 18187 2019-12-11 16:29/hive/test_2_metadata drwxr-xr-x - hive hdfs 0 2019-12-11 16:29 /hive/test_2/idx=0 drwxr-xr-x - hive hdfs 0 2019-12-11 16:29 /hive/test_2/idx=1 hadoop fs -ls /hive/test_2/idx=0/delta_0000000_0000000_0000 -rw-r--r-- 3 hive hdfs 1943267 2019-12-11 16:29/hive/test_2/idx=0/delta_0000000_0000000_0000/000000_0 How can i avoid creating and writing to folder "delta_0000000_0000000_0000" ? If its created then how to make sure Import runs correctly to read from that delta folder?
... View more
11-11-2019
12:58 PM
Hi, Even though we modified the stripe size to custom value - "orc.stripe.size"="248435456" there are many files which are still with 5MB , 9 MB. Any reason for this behavior?
... View more