My cluster seems to be having a problem with the App Timeline Server (ATS) and Resource Manager running at the same time. As a test, I stopped both services, cleared out the log files, and just started RM. Ambari shows RM has started fine, but... Here's what I found in the logs. yarn-yarn-resourcemanager-<server>.log 2018-05-31 15:57:42,336 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(779)) - application_1527213246626_3635 State change from NEW to FAILED
2018-05-31 15:57:42,336 WARN rmapp.RMAppImpl (RMAppImpl.java:<init>(423)) - The specific max attempts: 0 for application: 3636 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead.
2018-05-31 15:57:42,336 INFO rmapp.RMAppImpl (RMAppImpl.java:recover(792)) - Recovering app: application_1527213246626_3636 with 0 attempts and final state = FAILED rm-audit.log 2018-05-31 15:57:49,435 WARN resourcemanager.RMAuditLogger: USER=dr.who OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=org.apache.hadoop.security.AccessControlException: Queue root.default already has 1 applications, cannot accept submission of application: application_1527213246626_3508 APPID=application_1527213246626_3508 What's going on here?
... View more
