Member since
04-26-2018
4
Posts
0
Kudos Received
0
Solutions
04-11-2019
03:27 PM
can some help me on this as well? https://community.hortonworks.com/questions/243908/major-compaction-failure.html
... View more
04-03-2019
04:43 PM
Hi All, we maintian our table table compactions manual by enabling 'NO_AUTO_COMPACTION' = 'TRUE' and we run ALTER TABLE table_name COMPACT 'major'; after each new delta load we do this manual compaction though our compaction is failing due an unkown reason but in HDFS directory we see two base files as of my knowledge I am sure having two base files is not an issue, but one of the file name is differently syntaxed as this base_-9223372036854775808 is this the reason for compaction failure. drwxrwxrwx - 502590450 502590450 0 2019-04-02 14:34 s3a://av-dl-hwx-prod-anhffp02-purpose/hive/x1_env/geair_aerosol_data_pivot_5x/base_-9223372036854775808 drwxrwxrwx - 502590450 502590450 0 2019-04-02 14:34 s3a://av-dl-hwx-prod-anhffp02-purpose/hive/x1_env/geair_aerosol_data_pivot_5x/base_0012120 drwxrwxrwx - 502590450 502590450 0 2019-04-02 14:34 s3a://av-dl-hwx-prod-anhffp02-purpose/hive/x1_env/geair_aerosol_data_pivot_5x/delta_0012120_0012120_0000
... View more
08-20-2018
07:36 PM
Hi, we are facing the same issue.... can you help us on how to rename the delta file names. to workout on top of this! Thank you very much.
... View more
08-20-2018
07:36 PM
Hi, we are facing the same issue.... can you help us on how to rename the delta file names. to workout on top of this! Thank you very much.
... View more