Support Questions
Find answers, ask questions, and share your expertise

Ingestion jobs are getting killed

Explorer

Team ,

Some of our production jobs are being killed ,when i collected yarn logs i found below info

application_14880028******_*** does not exist. Log aggregation has not completed or is not enabled.

The jobs are killed before launching the containers or before nodes are assigned.

HDP version =2.3.4

Ambari=2.2

3 REPLIES 3

Explorer

13146-capture.png

13147-capture-1.png

Jobs are killed before assigning any containers to it

Guru

@Vijay, It looks like containers are not getting launched. If AM is failing to launch, log aggregation is expected to not work. In such failures, Resource manager and Node manager logs can help. Please look at RM and NM logs for above application. The stack trace from these logs can help further debug this issue.

Guru

@Vijay, Can you please share what is the stack trace in job client log ? It must show you diagnostic for failure. Also can you please share RM / NM log for this application ?