question Re: Job status Scheduling in Cloudera in Support Questions

Job status Scheduling in Cloudera

MadhuNP — Wed, 30 Mar 2022 21:02:27 GMT

What does it mean when a manually triggered job is in "Scheduling" job status? What happens behind the scenes during this Scheduling phase? Recently I have been noticing my job getting stuck in this phase for more than 10 minutes or so which is concerning.

Re: Job status Scheduling in Cloudera

drule — Wed, 30 Mar 2022 21:44:27 GMT

Hi Madhu,

Thank you for contacting us! I understand that your CDSW engine spent 10 minutes

in the scheduling phase and you would like to understand the phases a little better. Is this

correct?

The happy path for these phases is usually scheduling -> starting -> running -> succeeded. Other phases can in include stopped, timeout and failed. In general, the time spend in scheduling is waiting for resource availability for the engine's pod.

If this is a persistent issue with your CDSW engines, recommend opening a support case so that we can take a closer look at the logs around the time of one of the occurrences.

Re: Job status Scheduling in Cloudera

Mike — Wed, 30 Mar 2022 22:33:04 GMT

When this is happening, are you able to start Sessions as well?

Do you have access to the Admin -> Usage page or kubectl access? You should look to see if there are enough resources available for the engine that you have chosen to use when running the job.

Re: Job status Scheduling in Cloudera

MadhuNP — Wed, 30 Mar 2022 23:41:46 GMT

Thanks for your advice, I have raised a support case.

Re: Job status Scheduling in Cloudera

MadhuNP — Wed, 30 Mar 2022 23:43:09 GMT

Unfortunately I do not have admin access. I have raised a support case to understand the details better. Thanks for your response.