Can you isolate any connection issues between your NN and DN pods? Maybe you can try doing an nc or telnet to the NN port from the DN pod? ... View more

Sorry for late reply , in logs it is running but the actual final status in the resource manager is UI is failed. ... View more

In case you have a valid kerberos ticket, kindly use --negotiate and submit again. H!nt curl -X GET "https://master-servere.com:8090/ws/v43/cluster/apps/new-application" -H "accept: application/json" -k -v --negotiate -u admin   You may check for a valid Kerberos ticket using #klist  ... View more

Try analyzing the jstacks for the container in a stuck state. To identify and capture the jstacks for a stuck container you may follow this article  ... View more

It is worth looking at the application logs here and checking user permissions for your queue here ... View more

In addition to looking at the application logs here You can check for user permissions for your queue a. In the "Queue Details" section (YARN Queue Manager UI), scroll down to the "Access Control" subsection. In the "Access Control" section, you will see a table that lists the users and groups that have been granted permissions to submit jobs to the queue, and the type of permissions that have been granted (e.g. "Submit Application", "Administer Queue", etc.). ... View more

I see a disabled log aggregation for these applications. You can enable the log aggregation and look for possible reasons in the application logs. To view the entire log for an application yarn logs -applicationId <application-id> Below is a sample snippet of yarn-site.xml to enable log aggregation. You can look up or add these properties in the Hadoop management application (like cloudera-manager) as well. <property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property> <property> <name>yarn.log-aggregation.retain-seconds</name> <value>604800</value> </property> <property> <name>yarn.log-aggregation.retain-check-interval-seconds</name> <value>3600</value> </property> ... View more

Go to the settings of your VM and click on "Shared Folders". This will open a dialog box where you can specify which folders on your host machine you want to share with the virtual machine. Click on the "Add" button to add a new shared folder. In the "Folder Path" field, browse to the directory containing the files you want to upload on your host machine. In the "Folder Name" field, specify a name for the shared folder. Check the "Auto-mount" and "Make permanent" checkboxes to ensure that the shared folder is automatically mounted every time the virtual machine starts up. Click "OK" to save the settings and close the dialog box. ... View more

Hi @Tellyou6bu6  Did you got chance to check capacity-schedular.xml file? ... View more

Hello @ywu Thank you for the links. This one helps. So, if I understand correctly, there is not much we can do to control the size of the logs from the YARN but from the application itself since the application log files will continue to grow until the disk gets filled and the NodeManager goes into the decommissioned state, is it right?   ... View more