Created 02-06-2023 04:28 AM
When I submitted a job through Yarn rest api , It is being in accepted state which is with user dr.who and after 5-10 seconds a new job with new application Id is initiating with my username and the new job is being succeeded. dr.who job is being failed I am new to hadoop can anyone experienced this issue before suggest me to come out of this.
Created 02-06-2023 07:50 AM
@Kirankathe Could you please share error message reflecting application log and diagnostic message as well. Click on Accepted state application_id you will be able see diagnostic message
Created on 02-06-2023 08:29 AM - edited 02-06-2023 08:34 AM
Created 02-07-2023 07:13 AM
For yarn initiated job
- - -> Application node label expression: <DEFAULT_PARTITION>
- - ->Am container node label expression : <DEFAULT_PARTITION>
For job submitted from local :
- - -> Application node label expression: <Not set>
- - ->Am container node label expression : <DEFAULT_PARTITION>
I think if I change the 'application node label expression' for the yarn submitted application problem may be solved, I tried to change that but there is no use of it , if anyone knows how to change the 'application node label expression' please do suggest how to do that
Created 02-07-2023 07:07 AM
Created 02-26-2023 05:30 AM
Have you checked for any application initiation being done within the code that you are trying to submit?
Created 02-26-2023 07:05 AM
No the code is not submitting the job it might any configurations bro
Created 03-12-2023 06:31 AM
Did you get to check the application logs? This should give you more information to determine the exact flow.
Created 03-15-2023 11:26 PM
Sorry for late reply , in logs it is running but the actual final status in the resource manager is UI is failed.