Support Questions

Find answers, ask questions, and share your expertise

yarn containter log file

Explorer

Hi ,

 

I am getting below error when i ran the below command 

 

1st question

bash-4.1$ yarn logs -applicationId application_55261206146721_39976
18/05/23 23:10:20 INFO client.RMProxy: Connecting to ResourceManager at

xxxxxxxxxxxxxxxxxxxxxxxxx
/tmp/logs/yarn/logs/application_55261206146721_39976 does not exist.
Log aggregation has not completed or is not enabled.

 

i already enabled 

 

yarn.log-aggregation-enable=true
yarn.nodemanager.remote-app-log-dir=/tmp/logs
yarn.log-aggregation.retain-seconds=3 days

 

 

2nd question:

does below command syntax  supported in cloudera? 

 

yarn logs -applicationId application_332332323073474_0002 -show_application_log_info
yarn logs -applicationId application_1332332323073474_0002 -show_container_log_info

 

Regards

Jacqueline

 

2 REPLIES 2

Champion

I am not sure which version of CDH version you runining but based on the documenation looks like you can use the yarn logs command in the mentioned version of CDH 

 

https://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/YarnCommands.html

 

Try enabling this property in the server side configuration in cloudera manager. Client do not have access to this property in case if you had enabled in the client side .

Explorer
Hi Guna,

who should be the owner of the below hdfs directory ?
yarn.nodemanager.remote-app-log-dir=/tmp/logs

What hdfs chmod permission should we set on above directory

Right now i am getting below error

[root@node5.dataquest.reno.com 37884-yarn-NODEMANAGER]# yarn logs -applicationId application_152612073594_15218
18/05/26 13:27:05 INFO client.RMProxy: Connecting to ResourceManager at node5.dataquest.reno.com/192.188.7.8:8032
/tmp/logs/yarn/logs/application_152612073594_15218 does not exist.
Log aggregation has not completed or is not enabled.

We are CDH 5.13

Regards
JJ
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.