Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Unable to view application logs on EC2 in HDP 2.3.4

avatar
Expert Contributor

Hi,

I am newbee to EC2 and HDP 2.3.4 .

When I try to view the application logs as its taking the internal IP of EC2 of one of the datanode,I get "web page cant be displayed error".

When I searched the yarn-site.xml I couldnt find the port 8042 where I can make changes for log files.

Can somebody could help me configuring the Application log address.

Refer to the screenshot attached

1 ACCEPTED SOLUTION

avatar

This address is available on all nodes that have a Yarn Nodemanager installed (usually they are running on the same nodes as the Datanodes). You might have to use the external address that Amazon EC2 provides.

http://<nodemanager-address>:8042/node shows the following information:

1607-screen-shot-2016-01-28-at-83907-am.png

View solution in original post

6 REPLIES 6

avatar
Master Mentor

@Divya Gehlot replace the Internal address in browser with external and keep the rest of the URL as is

avatar
Expert Contributor

@Artem Ervits

I tried doing that but still getting page cannot be displayed .

Do I need to make any settings in config files aka YARN-default.xml ,etc..

I try to look up for port 8042 in configuration files of YARN but could not find the property itself

arn.nodemanager.webapp.address ${yarn.nodemanager.hostname}:8042

avatar
Expert Contributor

@Artem Ervits : Can you please help me with issue.

What settings should I change to view the logs in Web UI ?

Thanks

avatar
Master Mentor

@Divya Gehlot try to open a new question, commenting on an already accepted thread only confuses more people. I am not sure I follow, you asked this question and then the answer by Jonas was accepted, did it not solve your problem?

avatar
Expert Contributor

@Artem Ervits : I had to configure SSH Tunnel as my cluster was running on EC2.

Thanks a lot.

avatar

This address is available on all nodes that have a Yarn Nodemanager installed (usually they are running on the same nodes as the Datanodes). You might have to use the external address that Amazon EC2 provides.

http://<nodemanager-address>:8042/node shows the following information:

1607-screen-shot-2016-01-28-at-83907-am.png