Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 01-17-2024 01:35 AM
the platform is : CDH 5.14.4
after setting federation, the hdfs entrypoint is: viewfs://cluster6/ , the back namenode entrypoint is : hdfs://nameservice/ and hdfs://nameservice2/
add new warehouse directory is /user2/hive/warehouse and managed by nameservice2.
but i found the strange things is if i create database using hdfs://nameservice2, sentry can sync ACL with hdfs, but if i used viewfs://cluster6/ , sentry can not sync ACL.
for example:
create database test location '/user2/hive/warehouse/test.db' can not sync ACL
but create database test location 'hdfs://nameservice2/user2/hive/warehouse/test.db' is ok.
who knows why ?
Created 01-24-2024 10:45 PM
Created on 01-24-2024 10:17 PM - edited 01-24-2024 10:23 PM
recently, i was starting to investigate this issue by debug information, the root cause is sentry didn't add the path to sentry table when using viewfs://clusterX, but sentry did add the path when using hdfs://nameservice or hdfs://nameservice2
the debug information is below:
1. DEBUG org.apache.sentry.service.thrift.NotificationProcessor: HMS Path Update [OP : addPath, authzObj : jlwang18, path : hdfs://nameservice/user/hive/warehouse/jlwang18.db, notification event ID: 103361576]
2.DEBUG org.apache.sentry.service.thrift.NotificationProcessor: HMS Path Update [OP : addPath, authzObj : jlwang17, path : viewfs://cluster6/user/hive/warehouse/jlwang17.db] - nothing to add, notification event ID: 103361563]
but i still don't know why nothing to add when using viewfs://cluster6 .
Created 01-24-2024 10:45 PM