Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark History Server stuck infinity loop

Spark History Server stuck infinity loop

Explorer

Hello,

 

i have a problem with my Spark History Server.
It stucks in the "starting position" forever.

 

The history server is not running and im not able to start it because CM says it is starting!
Reboot the whole singlenode machine did not even help.

Is it possible to resset the Status there?

Im not able to remove the history server because CM thinks it is in "running/starting " status.

CM.5.13
CentOS7

 

Thanks in advanve

 

 

 

spark.png

4 REPLIES 4

Re: Spark History Server stuck infinity loop

Expert Contributor

Try to shut down the running commands.

 

Regards.

Manu.

Re: Spark History Server stuck infinity loop

Explorer

how when there is no running command in the list?

Re: Spark History Server stuck infinity loop

Cloudera Employee

Hi,

 

Try to stop and start the Spark History Server instances present in the Spark Service

 

 

Thanks

AKR

Re: Spark History Server stuck infinity loop

Guru
@kfc

You can try to manually update the status in CM database for spark history server, by logging into CM's backend database and run below query:

1. confirm how many rows returned from below query:
SELECT CONFIGURED_STATUS from ROLES WHERE ROLE_TYPE = 'SPARK_YARN_HISTORY_SERVER'

2. if only one, then run below query:
UPDATE ROLES SET CONFIGURED_STATUS = 'STOPPED' WHERE ROLE_TYPE = 'SPARK_YARN_HISTORY_SERVER';

This will reset the status, to match with the real status of the service on the host. Then try to start history server again to see if it helps.

Cheers
Eric
Don't have an account?
Coming from Hortonworks? Activate your account here