Something weird. With the 'hive' used to insert data it works but instead of using this user to insert data, I've found that if the base directory (/apps/hive/warehouse/test.db/mytab/base_0000013) belongs to the 'hive' user, then the compaction succeeds (cleaning step is ok). Even if the delta_ directories don't belong to hive. Weird, isn't it ? Thus, this is a workaround but a little bit crappy. But I'm open to any more suitable solution. ... View more

Here after a link related to Hive 3: http://www.adaltas.com/en/2019/07/25/hive-3-features-tips-tricks/ The author suggests the use of the   hive   user. So the   hive   keytab to execute merge query due to kerberos on my side. Is it the only way to make compaction work properly ? I use Hive 2 (HDP 2.6.5) on my side but I face to the same issue. ... View more

Debug mode activated. Logs on the metastore side when major compaction is activated. The process of cleaning fails (kerberos issue)   2019-08-25 21:42:51,729 INFO [Thread-24]: hive.metastore (HiveMetaStoreClient.java:open(451)) - Trying to connect to metastore with URI thrift://XXX:9083 2019-08-25 21:42:51,747 DEBUG [Thread-24]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1896)) - PrivilegedAction as:myuser (auth:PROXY) via hive/XXXX (auth:KERBEROS) from:org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) 2019-08-25 21:42:51,748 DEBUG [Thread-24]: transport.TSaslTransport (TSaslTransport.java:open(261)) - opening transport org.apache.thrift.transport.TSaslClientTransport@58fdf6d4 2019-08-25 21:42:51,750 ERROR [Thread-24]: transport.TSaslTransport (TSaslTransport.java:open(315)) - SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) ... View more

Same, Exactly the same issue for me. Any update ? ... View more