question Re: why do we need to configure seperate DB for hive, flume, and others. in Archives of Support Questions (Read Only)

why do we need to configure seperate DB for hive, flume, and others.

mvssaravana — Wed, 28 Mar 2018 16:47:16 GMT

Hi All,

I had setup HDP cluster using ambari UI.

Here I'm using postgres DB and would need to know why the DB to be configured for particular services only like hive, oozie and so on.

Please experts clarify more.

Thanks in advance.

Re: why do we need to configure seperate DB for hive, flume, and others.

Avi — Wed, 28 Mar 2018 17:02:20 GMT

Some of the services such as HIVE, OOZIE, Ranger need a back end database to store Meta-data, you can pick one DB such as mariadb/mysql for all these metadata stores and configure through ambari.

Re: why do we need to configure seperate DB for hive, flume, and others.

mvssaravana — Wed, 28 Mar 2018 20:15:33 GMT

@adash thanks for your comment. Why these particular services are getting connected with DB. pls could you explain in detail like what happens exactly when we are using Hive, Oozie, and Ranger.

Re: why do we need to configure seperate DB for hive, flume, and others.

Avi — Wed, 28 Mar 2018 20:19:59 GMT

HIVE needs to store meta data such as Table structures, OOZIE needs to store Job details etc. you can go into the db schemas of each product and see what they store. Its a persistent mechanism for storing meta data, please look at the internal architecture of each component, it will be clear.