02-13-2018 11:32 PM
Our CDH cluster on cloud sometimes fail to start.
Version of CM: Cloudera Express 5.13.0
Version of CDH: 5.13.0-1.cdh5.13.0.p0.29
Contrary to CM Start Command message "All services successfully started", the cluster is not going to start.
Inspecting the logs, all the DataNodes failed to start role, showing wierd message below.
"This role requires the following additional parcels to be activated before it can start: [cdh]."
(on CM Start Command view)
> Execute command Start on service HDFS
Successfully started HDFS service
> Start HDFS service
Successfully started service.
> Starting 14 roles on service
Successfully started service, but only 10/14 roles started.
> Execute command Start this DataNode on role DataNode (dn-x)
Failed to start role.
> Start a role
This role requires the following additional parcels to be activated before it can start: [cdh].
(the same for other DataNodes)
There seems to be no log output on DataNodes, and I suspect a CM issue.
Parcels are distributed and activated properly including cdh parcel.
Current workaround is to restart the cluster.
At second try, it goes well.
I want to give fundamental solution to this issue.
I would appreciate any helpful information. Thank you.