Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Unable to view application logs on EC2 in HDP 2.3.4

Solved Go to solution

Unable to view application logs on EC2 in HDP 2.3.4

Rising Star

Hi,

I am newbee to EC2 and HDP 2.3.4 .

When I try to view the application logs as its taking the internal IP of EC2 of one of the datanode,I get "web page cant be displayed error".

When I searched the yarn-site.xml I couldnt find the port 8042 where I can make changes for log files.

Can somebody could help me configuring the Application log address.

Refer to the screenshot attached

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Unable to view application logs on EC2 in HDP 2.3.4

This address is available on all nodes that have a Yarn Nodemanager installed (usually they are running on the same nodes as the Datanodes). You might have to use the external address that Amazon EC2 provides.

http://<nodemanager-address>:8042/node shows the following information:

1607-screen-shot-2016-01-28-at-83907-am.png

6 REPLIES 6

Re: Unable to view application logs on EC2 in HDP 2.3.4

Mentor

@Divya Gehlot replace the Internal address in browser with external and keep the rest of the URL as is

Highlighted

Re: Unable to view application logs on EC2 in HDP 2.3.4

Rising Star

@Artem Ervits

I tried doing that but still getting page cannot be displayed .

Do I need to make any settings in config files aka YARN-default.xml ,etc..

I try to look up for port 8042 in configuration files of YARN but could not find the property itself

arn.nodemanager.webapp.address ${yarn.nodemanager.hostname}:8042

Re: Unable to view application logs on EC2 in HDP 2.3.4

Rising Star

@Artem Ervits : Can you please help me with issue.

What settings should I change to view the logs in Web UI ?

Thanks

Re: Unable to view application logs on EC2 in HDP 2.3.4

Mentor

@Divya Gehlot try to open a new question, commenting on an already accepted thread only confuses more people. I am not sure I follow, you asked this question and then the answer by Jonas was accepted, did it not solve your problem?

Re: Unable to view application logs on EC2 in HDP 2.3.4

Rising Star

@Artem Ervits : I had to configure SSH Tunnel as my cluster was running on EC2.

Thanks a lot.

Re: Unable to view application logs on EC2 in HDP 2.3.4

This address is available on all nodes that have a Yarn Nodemanager installed (usually they are running on the same nodes as the Datanodes). You might have to use the external address that Amazon EC2 provides.

http://<nodemanager-address>:8042/node shows the following information:

1607-screen-shot-2016-01-28-at-83907-am.png