Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

yarn containter log file

yarn containter log file

New Contributor

Hi ,

 

I am getting below error when i ran the below command 

 

1st question

bash-4.1$ yarn logs -applicationId application_55261206146721_39976
18/05/23 23:10:20 INFO client.RMProxy: Connecting to ResourceManager at

xxxxxxxxxxxxxxxxxxxxxxxxx
/tmp/logs/yarn/logs/application_55261206146721_39976 does not exist.
Log aggregation has not completed or is not enabled.

 

i already enabled 

 

yarn.log-aggregation-enable=true
yarn.nodemanager.remote-app-log-dir=/tmp/logs
yarn.log-aggregation.retain-seconds=3 days

 

 

2nd question:

does below command syntax  supported in cloudera? 

 

yarn logs -applicationId application_332332323073474_0002 -show_application_log_info
yarn logs -applicationId application_1332332323073474_0002 -show_container_log_info

 

Regards

Jacqueline

 

2 REPLIES 2

Re: yarn containter log file

Champion

I am not sure which version of CDH version you runining but based on the documenation looks like you can use the yarn logs command in the mentioned version of CDH 

 

https://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/YarnCommands.html

 

Try enabling this property in the server side configuration in cloudera manager. Client do not have access to this property in case if you had enabled in the client side .

Re: yarn containter log file

New Contributor
Hi Guna,

who should be the owner of the below hdfs directory ?
yarn.nodemanager.remote-app-log-dir=/tmp/logs

What hdfs chmod permission should we set on above directory

Right now i am getting below error

[root@node5.dataquest.reno.com 37884-yarn-NODEMANAGER]# yarn logs -applicationId application_152612073594_15218
18/05/26 13:27:05 INFO client.RMProxy: Connecting to ResourceManager at node5.dataquest.reno.com/192.188.7.8:8032
/tmp/logs/yarn/logs/application_152612073594_15218 does not exist.
Log aggregation has not completed or is not enabled.

We are CDH 5.13

Regards
JJ
Don't have an account?
Coming from Hortonworks? Activate your account here