Support Questions

Find answers, ask questions, and share your expertise

Ambari shows HiveServer2 and Hive Metastore is stopped but they are running

avatar
Explorer

Ambari dashboard is showing HiveServer2 and Hive Metastore is stopped, but from the command line I am able to login into hive cli and hiveserver2 using beeline client also.

I have 6 node cluster in which I have installed hive server in 2 nodes and hive client is installed in all 6 nodes. In node1 ambari dashboard it was showing hiveserver2 and hive metastore is stopped but in node2 it was started.

In node1:

6381-hive-node1.png

In node2:

6382-hive-node2.png

When checked the process id which was available in /var/run/hive/hive.pid and hive-server.pid, they are same.

[node1 ~]$ cd /var/run/hive
[node1.staging.iad hive]$ ls
hive.pid  hive-server.pid
[node1 hive]$ cat hive.pid
14037
[node1 hive]$ cat hive-server.pid
16654
[node1 hive]$ ps -ef| grep 14037
dinesh     564 32124  0 15:10 pts/0    00:00:00 grep 14037
hive     14037     1  0 Aug03 ?        00:01:45 /usr/lib/jvm/jre/bin/java -Xmx1024m -Dhdp.version=2.3.4.0-3485 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.3.4.0-3485 -Dhadoop.log.dir=/var/log/hadoop/hive -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/hdp/2.3.4.0-3485/hadoop -Dhadoop.id.str=hive -Dhadoop.root.logger=INFO,console -Djava.library.path=:/usr/hdp/current/hadoop-client/lib/native/Linux-amd64-64:/usr/hdp/2.3.4.0-3485/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx1024m -XX:MaxPermSize=512m -Xmx1024m -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar /usr/hdp/2.3.4.0-3485/hive/lib/hive-service-1.2.1.2.3.4.0-3485.jar org.apache.hadoop.hive.metastore.HiveMetaStore -hiveconf hive.log.file=hivemetastore.log -hiveconf hive.log.dir=/var/log/hive
[node1 hive]$ ps -ef| grep 16654
dinesh     621 32124  0 15:10 pts/0    00:00:00 grep 16654
hive     16654     1  0 Aug03 ?        00:01:32 /usr/lib/jvm/jre/bin/java -Xmx1024m -Dhdp.version=2.3.4.0-3485 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.3.4.0-3485 -Dhadoop.log.dir=/var/log/hadoop/hive -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/hdp/2.3.4.0-3485/hadoop -Dhadoop.id.str=hive -Dhadoop.root.logger=INFO,console -Djava.library.path=:/usr/hdp/current/hadoop-client/lib/native/Linux-amd64-64:/usr/hdp/2.3.4.0-3485/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx1024m -XX:MaxPermSize=512m -Xmx512m -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar /usr/hdp/2.3.4.0-3485/hive/lib/hive-service-1.2.1.2.3.4.0-3485.jar org.apache.hive.service.server.HiveServer2 --hiveconf hive.aux.jars.path=file:///usr/hdp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar -hiveconf hive.metastore.uris=  -hiveconf hive.log.file=hiveserver2.log -hiveconf hive.log.dir=/var/log/hive
1 ACCEPTED SOLUTION

avatar
Expert Contributor

@Dinesh E Here is an article on why this could happen. It explains why and steps to take when such a scenario occurs :

https://community.hortonworks.com/articles/18088/ambari-shows-hdp-services-to-be-down-whereas-they.h...

Hope this helps!

View solution in original post

11 REPLIES 11

avatar
New Contributor

@Dinesh, This is problem resolved after upgrading the HDP from 2.3.4 to 2.4.2

avatar
Explorer

@Jayanta Das Thanks for the update.