- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
how to check uptime of hadoop services
- Labels:
-
Apache Hadoop
Created ‎04-09-2018 06:52 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I want to check from when hadoop services are up or running . is there some command to check same ?
for e.g if there is hbase service i want to check its uptime in other way its last start time . in the same way I want to check for other hadoop services as well.
Thanks in advance
Created ‎04-09-2018 11:24 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The HDFS Service is a combination of various components like NameNoides, DataNodes, ZKFC, JournalNodes ..etc So the Service Up time really does not make much sense because in a Service 90% components might be UP but some of them (10%) might be down ... So i will suggest you to check the "Service Component" UP time instead of finding the "Service" up time.
The easiest option to capture the "Service Component" uptime will be to see the "uptime" field in the following command for the component:
For example finding DataNode Uptime:
# ps -ef | grep `cat /var/run/hadoop/hdfs/hadoop-hdfs-datanode.pid` | awk 'NR==1{print $5 " - " $7}' Mar02 - 03:43:47
.
Similarly you can run the following commands to find NameNode, JournalNode Uptime ...etc
# ps -ef | grep `cat /var/run/hadoop/hdfs/hadoop-hdfs-journalnode.pid` | awk 'NR==1{print $5 " - " $7}' # ps -ef | grep `cat /var/run/hadoop/hdfs/hadoop-hdfs-namenode.pid` | awk 'NR==1{print $5 " - " $7}'
.
The output of Column 5 and column 7 shows the Uptime (date & time)
Example:
# ps -ef | grep `cat /var/run/hadoop/hdfs/hadoop-hdfs-namenode.pid` root 519 31846 0 23:23 pts/0 00:00:00 grep --color=auto 17262 hdfs 17262 1 0 Mar02 ? 07:55:29 /usr/jdk64/jdk1.8.0_112/bin/java -Dproc_namenode -Xmx1024m -Dhdp.version=2.6.1.0-129 -Djava.net.preferIPv4Stack=true -Dhdp.version= -Djava.net.preferIPv4Stack=true -Dhdp.version= -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/var/log/hadoop/hdfs.......... -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.NameNode
.
Created ‎04-09-2018 11:24 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The HDFS Service is a combination of various components like NameNoides, DataNodes, ZKFC, JournalNodes ..etc So the Service Up time really does not make much sense because in a Service 90% components might be UP but some of them (10%) might be down ... So i will suggest you to check the "Service Component" UP time instead of finding the "Service" up time.
The easiest option to capture the "Service Component" uptime will be to see the "uptime" field in the following command for the component:
For example finding DataNode Uptime:
# ps -ef | grep `cat /var/run/hadoop/hdfs/hadoop-hdfs-datanode.pid` | awk 'NR==1{print $5 " - " $7}' Mar02 - 03:43:47
.
Similarly you can run the following commands to find NameNode, JournalNode Uptime ...etc
# ps -ef | grep `cat /var/run/hadoop/hdfs/hadoop-hdfs-journalnode.pid` | awk 'NR==1{print $5 " - " $7}' # ps -ef | grep `cat /var/run/hadoop/hdfs/hadoop-hdfs-namenode.pid` | awk 'NR==1{print $5 " - " $7}'
.
The output of Column 5 and column 7 shows the Uptime (date & time)
Example:
# ps -ef | grep `cat /var/run/hadoop/hdfs/hadoop-hdfs-namenode.pid` root 519 31846 0 23:23 pts/0 00:00:00 grep --color=auto 17262 hdfs 17262 1 0 Mar02 ? 07:55:29 /usr/jdk64/jdk1.8.0_112/bin/java -Dproc_namenode -Xmx1024m -Dhdp.version=2.6.1.0-129 -Djava.net.preferIPv4Stack=true -Dhdp.version= -Djava.net.preferIPv4Stack=true -Dhdp.version= -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/var/log/hadoop/hdfs.......... -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.NameNode
.
Created ‎04-09-2018 11:27 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Similarly for HBase processes you can run the following command to find the Uptime of HBase Master & HBase Region Server.
# ps -ef | grep `cat /var/run/hbase/hbase-hbase-master.pid`| awk 'NR==1{print $5 " - " $7}' # ps -ef | grep `cat /var/run/hbase/hbase-hbase-regionserver.pid`| awk 'NR==1{print $5 " - " $7}'
