ResourceManager Web UI is unreachable alert eventhough we are to able access RM web UI.

[#1]

We are getting the altert with the following response details. Even though the web UI is working accessible. I am using HDP 2.5. Please help me to resolved the altert.

HTTP 401 response from http://xxxxxxxxnnnn.aaaa.bbb..corpintra.net:8088 in 0.000s ( % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 43 0 43 0 0 16468 0 --:--:-- --:--:-- --:--:-- 43000 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1400 100 1400 0 0 179k 0 --:--:-- --:--:-- --:--:-- 179k 100 1400 100 1400 0 0 156k 0 --:--:-- --:--:-- --:--:-- 156k)

[#2]

@Narasimha K

How long have you bee receiving the alerts? Please try to clear the alert be deactivating and activating see attached screenshot

[#3]

@Geoffrey Shelton Okot,

I am facing this issue since last two days. I have deactivated and activated the state of this alert. But no luck. The alert is triggered after couple of minutes. Please help me.

[#4]

@Narasimha K from the resource manager can you please check if there is any old process of RM is hanging around? you can find it using :

jps -l | grep -i resourcemanager

if you see multiple processes running then you need to kill the old process that is hanging around.

Thanks

Venkat

[#5]

@Venkat,

I have already checked . Only one RM process is running. Please help me any other ideas to resolve this issue.

root@xxxxxxxxxnnnn:/root : jps -l | grep -i resourcemanager

11550 org.apache.hadoop.yarn.server.resourcemanager.ResourceManager

[#6]

@Narasimha K , 401 error seems to be related to authentication. Is ResourceManager Web UI requires authentication ? Can you try to check from log who is trying to access ResourceManger web UI ?

Regards,

Fahim

[#7]

@Narasimha K

can you please check from the Ambari Alerts if this is coming up as a Stale alert? it could have been hanging around, you can try to delete the alerts from the Ambari DB and see if this alert is coming up if not the issue is resolved and it could happen if there are any changes in the hostname's/ip's or it is not able to find the process that triggered this alert.

please let me know how it gives after fixing it from the DB.

Thanks

Venkat

[#8]

@Venkat,

I have delete the alert from ambari.alert_current table. But this alert row is created after couple of minutes and the alert is present on the ambari. Please help me any other ideas to resolve this issue.

Thanks

Narasimha k.

[#9]

@Venkat,

I have delete the alert from ambari.alert_current table. But this alert row is created after couple of minutes and the alert is present on the ambari. Please help me any other ideas to resolve this issue.

Thanks

Narasimha k.

[#10]

Recently ran into same issue where we were getting alerts for all the UIs. The root cause ended up being the times on the nodes were not correct. After fixing the time and restarting ambari server/agents and all services, the alerts went away