Starting Agents To start Agents, the supervisord process, and all managed service processes, use the following command: Start sudo service cloudera-scm-agent start Stop sudo service cloudera-scm-agent stop Restart sudo service cloudera-scm-agent restart   **Hard Stopping and Restarting Agents** To stop or restart Agents, the supervisord process, and all managed service processes, use one of the following commands: Note: The hard_stop and hard_restart commands kill all running managed service processes on the host(s) where the command is run.   1)Hard Stop For RHEL 7, SLES 12, Debian 8, Ubuntu 16.04: sudo systemctl stop cloudera-scm-supervisord.service For RHEL 5 or 6, SLES 11, Debian 6 or 7, Ubuntu 12.04, 14.04: sudo service cloudera-scm-agent hard_stop   2)Hard Restart For RHEL 7, SLES 12, Debian 8, Ubuntu 16.04 and higher: sudo systemctl stop cloudera-scm-supervisord.service sudo systemctl start cloudera-scm-agent For RHEL 5 or 6, SLES 11, Debian 6 or 7, Ubuntu 12.04, 14.04: sudo service cloudera-scm-agent hard_restart   3)Checking Agent Status To check the status of the Agent process, use the command: sudo service cloudera-scm-agent status ... View more

yarn application -list           This is the command that will list only the applications that are either         in submitted, running or accepted state. There is a log aggregation that collects each container's logs and moves these logs onto the directory configured in yarn.nodemanager.remote-app-log-dir only after the completion of the application. So the applicationId listed by the command isn't completed yet and the logs are not yet collected and this is why you cant see the logs. **TO ENABLE LOG AGGREGATION:** Log aggregation is enabled in the yarn-site.xml file. The yarn.log-aggregation-enable property enables log aggregation for running applications. <property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property> Use this command yarn logs -applicationId <application ID> to view the logs of the application once it gets completed. To list all finished applications use yarn application -list -appstates FINISHED To list all the applications yarn application -list -appstates ALL ... View more