I am able to access the container logs from history server for hadoop mapreduce related jobs. But while i run the spark jobs in yarn-cluster i am not able to see the logs once the job is over. If the job is in progress then i am able to see the logs.

This logs are retrieved by the port 8042. History server working fine in 19888.

I did set this property ,

    <property>
                <name>yarn.nodemanager.delete.debug-delay-sec</name>
                <value>600</value>
        </property>

Logs are exist in local but i am not able to see it in UI. Can anyone please help me to resolve this issue. Thanks in advance.