Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

Solved Go to solution
Highlighted

Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

Explorer

Custom add on service stuck in starting state and now cannot start,stop or delete the service itself. 

When I try to start I get the error "Command Start is not currently available for execution."

Whey I try to stop the service I get the error "At least one role must be started."

When I try to delete the service I get the error "The following roles roles need to be stopped before deleted."

 

Please advise.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

Community Manager
Follow Cloudera Knowledge Article: "Cloudera Manager managed role stuck in stopping or starting state" resolved the issue.

Li Wang, Technical Resolution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

9 REPLIES 9

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

Community Manager
Follow Cloudera Knowledge Article: "Cloudera Manager managed role stuck in stopping or starting state" resolved the issue.

Li Wang, Technical Resolution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

New Contributor
Looks like I have the same issue, can you post the url of the article in question please?

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

Community Manager

Hi,

 

I am copying the solution here in case you don't have access to the KB article.

 

Please make sure you have a Cloudera Manager database backup.

 

Perform the following actions:
1. Log into the Cloudera Manager database and run a query against all the services in the Roles table.

select role_id, name, configured_status from ROLES where configured_status = "STOPPING"; -- Replace STOPPED with STARTING depending on the use case.

2. Note any roles that you know for certain are stopped but are indicated as "STOPPING" or any roles you know for certain are started but are indicated as "STARTING"
3. Execute an update statement to set the role to the correct state.

update ROLES set configured_status = "STOPPED" where role_id = #; -- Replace STOPPED with STARTING depending on the use case. Replace the role_id with the value got from step 1.
4. Re-execute the select statement to check to ensure the configured_status is now indicating the correct state.

5. Start or stop the role as required.

 

Hope this helps.

Li Wang, Technical Resolution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

New Contributor

This is exactly what I needed. Many thanks. Solved.

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

Explorer

Hi @lwang,

 

Thanks a lot to share this information with us! This is an odd behavior, could you tell me what is the root cause of this, please? Wich CDH version are impacted? At the moment I have found this problem with CDH 5.8 only.

 

Many thanks in advance for the kind cooperation/availability.

 

Regards,

 

Alex

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

Community Manager

Hi @AlexPQ,

 

The issue was mostly seen during cluster upgrade. Rarely it can oocur in below scenarios:

- backend CM database connectivity going down during command execution

- agent stopping while the command was running

- some unknown reasons

 

We have some internal jiras associated with the issue. Based on the discussions there, it looks like there were a couple of bugs involved state transition. Both bugs were resolved in CM5.12.0 and higher. This may explain why in your cluster (assuming you have CM 5.8.x as same as your CDH version) you are seeing this issue.

 

Thanks and hope this helps.

 

 

 

Li Wang, Technical Resolution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

New Contributor

.

 

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

Explorer

Hi @lwang


thank you very much for your kind feedback, I'm preparing the CDH and CM upgrade to 5.13.1, in order to avoid this issue.

 

Thanks again!

 

Regards,

 

Alex

Re: Custom add on service stuck in starting state, and now cannot start,stop,delete this service.

New Contributor

It should restart cloudera-scm-server services after updated the DB.

Don't have an account?
Coming from Hortonworks? Activate your account here