Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Hive Metastore Token Store

avatar
Explorer

 

What is the advantage of below in Hive Metastore Delegation Token Store and use of it

 

org.apache.hadoop.hive.thrift.MemoryTokenStore

org.apache.hadoop.hive.thrift.DBTokenStore

org.apache.hadoop.hive.thrift.ZooKeeperTokenStore

 

 

Thanks,

1 REPLY 1

avatar
Champion
I have not found good information on the ZK store but HMS HA requires at a minimium the DB Token store. Something from the users sessions, presumably the delegation token, is saved in either memory, the metastore db, or ZK. The first means that you would need a new token/session if you ended up connecting to a different HMS instance. The other two allow for HA and I image ZK just adds more fault tolerance as most installs have a minimum of 3 versus 1 RDBMS. I don't think the latter is used or tested extensively though and have seen other people have issues with it, specifically when Kerberos is enabled.