After restarting services again stoped repatedly but keep running on background

[#1]

I m trying to start services in ambari at a time start the all services but after few minutes again stop but still keep running on background as like

[root@D-9063 ~]# ps aux | grep kafka kafka 15868 0.7 4.7 5353180 385024 ? Sl 15:02 0:09 /usr/jdk64/jdk1.8.0_40/bin/java -Xmx1G -Xms1G -server -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/var/log/kafka/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/var/log/kafka -Dlog4j.configuration=file:/usr/hdp/2.3.4.7-4/kafka/bin/../config/log4j.properties -cp :/usr/hdp/2.3.4.7-4/kafka/bin/../libs/* kafka.Kafka /usr/hdp/2.3.4.7-4/kafka/config/server.properties root 22346 0.0 0.0 112648 952 pts/1 S+ 15:23 0:00 grep --color=auto kafka

and as like same another

please give me helpful answer.

[#2 · Accepted solution]

i have check if those services are running in background and still Ambari is showing them stopped?

Say for datanode, check these:

1. ps -ef | grep -i datanode

2. cat /var/run/hadoop/hdfs/hadoop-hdfs-datanode.pid

3. See if both id's are matching. If not, kill process, remove /var/run/hadoop/hdfs/hadoop-hdfs-datanode.pid, and start service from Ambari.

If above is not the case, check ambari-agent log for message:

1. {'msg':'Unable to read structured output from /var/lib/ambari-agent/data/structured-out-status.json'}

If you are able to see this message,

stop ambari agent

move /var/lib/ambari-agent/data/structured-out-status.json to /tmp.

Start ambari agent.