Support Questions

Find answers, ask questions, and share your expertise

Unable to view application logs on EC2 in HDP 2.3.4

avatar
Expert Contributor

Hi,

I am newbee to EC2 and HDP 2.3.4 .

When I try to view the application logs as its taking the internal IP of EC2 of one of the datanode,I get "web page cant be displayed error".

When I searched the yarn-site.xml I couldnt find the port 8042 where I can make changes for log files.

Can somebody could help me configuring the Application log address.

Refer to the screenshot attached

1 ACCEPTED SOLUTION

avatar

This address is available on all nodes that have a Yarn Nodemanager installed (usually they are running on the same nodes as the Datanodes). You might have to use the external address that Amazon EC2 provides.

http://<nodemanager-address>:8042/node shows the following information:

1607-screen-shot-2016-01-28-at-83907-am.png

View solution in original post

6 REPLIES 6

avatar
Master Mentor

@Divya Gehlot replace the Internal address in browser with external and keep the rest of the URL as is

avatar
Expert Contributor

@Artem Ervits

I tried doing that but still getting page cannot be displayed .

Do I need to make any settings in config files aka YARN-default.xml ,etc..

I try to look up for port 8042 in configuration files of YARN but could not find the property itself

arn.nodemanager.webapp.address ${yarn.nodemanager.hostname}:8042

avatar
Expert Contributor

@Artem Ervits : Can you please help me with issue.

What settings should I change to view the logs in Web UI ?

Thanks

avatar
Master Mentor

@Divya Gehlot try to open a new question, commenting on an already accepted thread only confuses more people. I am not sure I follow, you asked this question and then the answer by Jonas was accepted, did it not solve your problem?

avatar
Expert Contributor

@Artem Ervits : I had to configure SSH Tunnel as my cluster was running on EC2.

Thanks a lot.

avatar

This address is available on all nodes that have a Yarn Nodemanager installed (usually they are running on the same nodes as the Datanodes). You might have to use the external address that Amazon EC2 provides.

http://<nodemanager-address>:8042/node shows the following information:

1607-screen-shot-2016-01-28-at-83907-am.png