Reply
New Contributor
Posts: 5
Registered: ‎08-08-2014

it always appears "--process information unavailable" after running mapreduce V2 each time

Hi

I have study CDH for over a year from cdh4.2 to cdh5.0.3.

Now I Meet a problem.

Each time,I run mapreduce(V2), which is successful,but it always appears one unavailable process,as follow

28236 DataNode
25262 QuorumPeerMain
28793 Jps
28638 -- process information unavailable
28399 NodeManager

I kill it under /tmp/hsperfdata_yarn/,but it still appears after runing mapreduce for each time.

I found the YarnChild didn't shut down automatic after mapreduce.

but it don't appear deploymenting by tarball with the same configuration file.

I have studied this problem for two weeks, but it doesn't work.

Posts: 1,565
Kudos: 287
Solutions: 239
Registered: ‎07-31-2013

Re: it always appears "--process information unavailable" after running mapreduce V2 each

Can you post more information about the "process information unavailable" state of a Java PID?

For example, please post the output of "ps auxww | grep 28638" if the unkilled PID is detected as 28638.
Backline Customer Operations Engineer
Highlighted
New Contributor
Posts: 2
Registered: ‎04-10-2015

Re: it always appears "--process information unavailable" after running mapreduce V2 each

 

Hi Harsh,

 

I see jps command gives process information unavailable.

 

[root@Master ~]# jps
20146 -- process information unavailable
15099 -- process information unavailable
20092 -- process information unavailable
15601 Jps
20116 -- process information unavailable
18912 -- process information unavailable
19814 -- process information unavailable
19920 -- process information unavailable
20129 -- process information unavailable
17464 -- process information unavailable
14750 -- process information unavailable
20162 -- process information unavailable
20070 -- process information unavailable
14742 -- process information unavailable
4398 -- process information unavailable
[root@Master ~]#
[root@Master ~]#
[root@Master ~]#
[root@Master ~]#
[root@Master ~]# ps auxww | grep 20146
root     15640  0.0  0.0 103252   860 pts/3    S+   20:07   0:00 grep 20146
493      20146  0.4  3.3 2970892 270484 ?      Sl   Apr10  18:40 /usr/java/jdk1.6.0_31/bin/java -server -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:+UseParNewGC -Dmgmt.log.file=mgmt-cmf-mgmt1-ACTIVITYMONITOR-Master.blr.asicdesigners.com.log.out -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -Dfirehose.schema.dir=/usr/share/cmf/schema -Xms555485557 -Xmx555485557 -cp /var/run/cloudera-scm-agent/process/40-cloudera-mgmt-ACTIVITYMONITOR:/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/lib/* com.cloudera.cmon.firehose.Main --pipeline-type ACTIVITY_MONITORING_TREE --mgmt-home /usr/share/cmf

 

 

Explorer
Posts: 33
Registered: ‎07-15-2015

Re: it always appears "--process information unavailable" after running mapreduce V2 each

Hi BalaKrishna,
to see the processes running by hdfs, yarn, hbase use the following commands

sudo -u hdfs jps--->if it gives jps not found error
then use this --
# su hdfs
#jps
[root@singlenode tmp]# su hdfs
bash-4.1$ jps
2064 NameNode
26028 Jps
2269 SecondaryNameNode
1903 DataNode
bash-4.1$ exit;
exit

sudo -u yarn /usr/lib/jvm/jdk1.8.0_51/bin/jps
3008 WebAppProxyServer
3168 ResourceManager
2705 NodeManager
26066 Jps


sudo -u hbase /usr/lib/jvm/jdk1.8.0_51/bin/jps
4531 HRegionServer
3670 RESTServer
3862 ThriftServer
26249 Jps
3497 HMaster

Announcements