Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Issue when Querying YARN application information via REST API

avatar
Explorer

Hi everybody,

I have a problem when querying the job info via the REST api. In the past, when I need to see the list of containers that are created for one specific job, I can query it like below and it shows me all the container information.

curl -XGET http://svr02.spo:8188/ws/v1/applicationhistory/apps/application_1445602639127_0365/appattempts/appat...
{"container":[
{
  "containerId":"container_e68_1445602639127_0365_01_000003",
  "allocatedMB":2048,
  "allocatedVCores":1,
  "assignedNodeId":"svr15.spo:45454",
  "priority":10,
  "startedTime":1446131587303,
  "finishedTime":1446131593180,
  "elapsedTime":5877,
  "diagnosticsInfo":"Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\nContainer exited with a non-zero exit code 143\n",
  "logUrl":"http://svr02.spo:8188/applicationhistory/logs/svr15.spo:45454/container_e68_1445602639127_0365_01_000003/container_e68_1445602639127_0365_01_000003/annemarie",
  "containerExitStatus":-105,
  "containerState":"COMPLETE",
  "nodeHttpAddress":"http://svr15.spo:8042"
},
{
  "containerId":"container_e68_1445602639127_0365_01_000002",
  "allocatedMB":2048,
  "allocatedVCores":1,
  "assignedNodeId":"svr12.spo:45454",
  "priority":20,
  "startedTime":1446131578209,
  "finishedTime":1446131586479,
  "elapsedTime":8270,
  "diagnosticsInfo":"Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\nContainer exited with a non-zero exit code 143\n",
  "logUrl":"http://svr02.spo:8188/applicationhistory/logs/svr12.spo:45454/container_e68_1445602639127_0365_01_000002/container_e68_1445602639127_0365_01_000002/annemarie",
  "containerExitStatus":-105,
  "containerState":"COMPLETE",
  "nodeHttpAddress":"http://svr12.spo:8042"
},
{
  "containerId":"container_e68_1445602639127_0365_01_000001",
  "allocatedMB":1024,
  "allocatedVCores":1,
  "assignedNodeId":"svr04.spo:45454",
  "priority":0,
  "startedTime":1446131572596,
  "finishedTime":1446131599631,
  "elapsedTime":27035,
  "diagnosticsInfo":"",
  "logUrl":"http://svr02.spo:8188/applicationhistory/logs/svr04.spo:45454/container_e68_1445602639127_0365_01_000001/container_e68_1445602639127_0365_01_000001/annemarie",
  "containerExitStatus":0,
  "containerState":"COMPLETE",
  "nodeHttpAddress":"http://svr04.spo:8042"
}]} 

However, later, when I use the same query, the response only displays the information of ONE and ONLY ONE container: the application master. The other container information disappears mythically:

curl -XGET http://svr02.spo:8188/ws/v1/applicationhistory/apps/application_1445602639127_0365/appattempts/appat...
{"container":[
{
  "containerId":"container_e68_1445602639127_0365_01_000001",
  "allocatedMB":1024,
  "allocatedVCores":1,
  "assignedNodeId":"svr04.spo:45454",
  "priority":0,
  "startedTime":1446131572596,
  "finishedTime":1446131599631,
  "elapsedTime":27035,
  "diagnosticsInfo":"",
  "logUrl":"http://svr02.spo:8188/applicationhistory/logs/svr04.spo:45454/container_e68_1445602639127_0365_01_000001/container_e68_1445602639127_0365_01_000001/annemarie",
  "containerExitStatus":0,
  "containerState":"COMPLETE",
  "nodeHttpAddress":"http://svr04.spo:8042"
}
]
} 
 

Does anyone have the same problem or experience this before? I really need to see the list of container information because I would like to query its starttime and endtime.

Thank you for your help!!

1 ACCEPTED SOLUTION

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
1 REPLY 1

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login