Support Questions
Find answers, ask questions, and share your expertise

TaskSchedulerImpl: Initial job has not accepted any resources

Highlighted

TaskSchedulerImpl: Initial job has not accepted any resources

Explorer

Hi Srowen,

 

I am facing the same things.

YarnClientClusterScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory

 

I cant see any config for worker in my CM. I am using CDH 5.3.3 and CM 5.4.0

2 REPLIES 2
Highlighted

Re: TaskSchedulerImpl: Initial job has not accepted any resources

Super Collaborator

You would I would recommend that you always start a new thread for an issue you have. Specially if the old thread is marked as answered.

There is a high probability that we will miss your question if you use the same thread.

 

For the issue you are seeing: check the settings in YARN as per the tuning guide and make sure that the request you make from Spark is smaller than the maximum container size you can accomodate. Also keep in mind you need 1 extra container on top of the executors for the YARN AM (which can also host the driver when you use deploymeode cluster.

 

Wilfred

Re: TaskSchedulerImpl: Initial job has not accepted any resources

Community Manager

I have seperated this out into a new thread for you both. :)


Cy Jervis, Community Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:
Community Guidelines
How to use the forum
Don't have an account?