Member since
09-07-2016
4
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1188 | 10-26-2016 05:53 PM |
10-26-2016
05:37 PM
Running HDP 2.4.2 and yarn-yarn-timelineserver.log is full of this sort of messages. Anyone else experiencing them? What could be the misconfiguration that is causing the timeline server to not find the application attempt? 2016-10-26 16:56:15,991 INFO applicationhistoryservice.ApplicationHistoryManagerOnTimelineStore (ApplicationHistoryManagerOnTimelineStore.java:generateApplicationReport(566)) - No application attempt found for application_1463393713130_0008. Use a placeholder for its latest attempt id.
org.apache.hadoop.yarn.exceptions.ApplicationAttemptNotFoundException: The entity for application attempt appattempt_1463393713130_0008_000001 doesn't exist in the timeline store
at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerOnTimelineStore.getApplicationAttempt(ApplicationHistoryManagerOnTimelineStore.java:176)
at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerOnTimelineStore.generateApplicationReport(ApplicationHistoryManagerOnTimelineStore.java:552)
at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryManagerOnTimelineStore.getApplications(ApplicationHistoryManagerOnTimelineStore.java:120)
at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryClientService.getApplications(ApplicationHistoryClientService.java:187)
... View more
Labels:
10-26-2016
04:02 PM
I am able to get aggregate usage information for a given application using yarn CLI: [yarn@c14-1 ~]$ yarn application -status application_1477415253067_0001 ... Aggregate Resource Allocation : 1656349 MB-seconds, 755 vcore-seconds ...
I would like to get the same information using the REST API but the aggregated resource allocation is missing in the response: [root@node1 ~]# http localhost:8188/ws/v1/applicationhistory/apps/application_1477415253067_0001 {
"allocatedCpuVcores": 0,
"allocatedMemoryMB": 0,
"appId": "application_1477415253067_0001",
"appState": "FINISHED",
"currentAppAttemptId": "appattempt_1477415253067_0001_000001",
"diagnosticsInfo": "",
"elapsedTime": 45252,
"finalAppStatus": "SUCCEEDED",
"finishedTime": 1477415872877,
"host": "node2",
"name": "TeraGen",
"originalTrackingUrl": "http://node1:19888/jobhistory/job/job_1477415253067_0001",
"progress": 100.0,
"queue": "default",
"rpcPort": 60515,
"runningContainers": 0,
"startedTime": 1477415827625,
"submittedTime": 1477415827625,
"trackingUrl": "http://node1:8088/proxy/application_1477415253067_0001/",
"type": "MAPREDUCE",
"user": "test112"
} Most of the info is available in the JSON response, but not the aggregated resource information and the allocatedCpuVcores and allocatedMemoryMB are reported as 0. I am running HDP 2.4.2.
... View more
Labels: