@Harsh J  On further investigation i found that there is one property "hbase.master.infoserver.redirect" which if set as false in hbase-site.xml will only expose two ports instead of 3(which were coming earlier as i mentioned in the above comment) .  One is TCP and other is HTTP web UI port (say P1). Here 3rd port (say P2) is not coming which was getting redirected to the main one. But in region server web ui there is Hmaster web UI link with the port P2, as P2 is not coming in this case so it showing -1 as the port. This means we can not go from region server to Hmaster directly. So i have 2 queries now: 1. What could be the side effect of setting hbase.master.infoserver.redirect property as false? 2. Currently we are no running Hbase in HA, so is it safe to use this property?   Floowing are the regionServer webUIs with the difference after setting the property to false and before that After setting the property value to false Before setting the property value to false. ... View more

Yes the file location for InfoServer.java file is different in Hbase1.3.1 as it is at location org.apache.hadoop.hbase.http.InfoServer now. But this file does not have constraint method code in it anymore although it there for Hbase Rest Server. So is it possible that code to Constraint methods got removed for Hmaster in hbsae1.3.1 version.   Regarding the ports, when i try  35216  port on browser it gets redirected to 46645 port and gives Hmaster Infoserver UI.   Also , i tried to explicilty invoke HttpServerUtil.constrainHttpMethods() in Hmaster.putUpJettyServer() . And after that i bring up hbase then port 35216  is also giving 403. This seems fine as it is not giving 200 status anymore. But my concern is, i have checked that if Http TRACE method is diabled then it should gove 405 status not 403. So Is this change fine or not? ... View more

Following are the steps i performed: 1. Firstly i run the command ps -ef | grep org.apache.hadoop.hbase.master.HMaster to get the process Id of Hmaster. 2.Then i ran netstat -tulpn | grep 24532 to fetch all the ports for Hmaster. This gave 3 ports for Hmaster: tcp6 0 0 :::35216 :::* LISTEN 24532/java tcp6 0 0 :::46645 :::* LISTEN 24532/java tcp6 0 0 10.65.157.61:19389 :::* LISTEN 24532/java   3. Http Trace o/p for first port is curl -v -X TRACE http://vmforpriyanka:35216 * About to connect() to vmforpriyanka port 35216 (#0) * Trying 10.65.157.61... * Connected to vmforpriyanka (10.65.157.61) port 35216 (#0) > TRACE / HTTP/1.1 > User-Agent: curl/7.29.0 > Host: vmforpriyanka:35216 > Accept: */* > < HTTP/1.1 200 OK < Content-Type: message/http < Content-Length: 83 < Server: Jetty(6.1.26) < TRACE / HTTP/1.1 User-Agent: curl/7.29.0 Host: vmforpriyanka:35216 Accept: */* * Connection #0 to host vmforpriyanka left intact curl o/p for second port is  curl -v -X TRACE http://vmforpriyanka:46645 * About to connect() to vmforpriyanka port 46645 (#0) * Trying 10.65.157.61... * Connected to vmforpriyanka (10.65.157.61) port 46645 (#0) > TRACE / HTTP/1.1 > User-Agent: curl/7.29.0 > Host: vmforpriyanka:46645 > Accept: */* > < HTTP/1.1 403 Forbidden < Content-Length: 0 < Server: Jetty(6.1.26) < * Connection #0 to host vmforpriyanka left intact   Also regarding jira https://issues.apache.org/jira/browse/HBASE-10473, It seems that Inforserver.java does not even exist at the mentioned path /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/InfoServer.java. Although in hbase1.3.1 it does exist in hbase-server project. But that piece of code which is mentioned in the jirs is not there in the file. ... View more

Following are the commands that i am using : 1. Firstly i fetch Hmaster processId  by following command: ps -ef | grep org.apache.hadoop.hbase.master.HMaster   2.Using the process id captured in first step i run the following command to fetch master ports: netstat -tulpn | grep 24532 tcp6 0 0 :::35216 :::* LISTEN 24532/java tcp6 0 0 :::46645 :::* LISTEN 24532/java tcp6 0 0 10.65.157.61:19389 :::* LISTEN 24532/java   3. It is giving 3 ports. Curl O/p of first port is : curl -v -X TRACE http://vmforpriyanka:35216 * About to connect() to vmforpriyanka port 35216 (#0) * Trying 10.65.157.61... * Connected to vmforpriyanka (10.65.157.61) port 35216 (#0) > TRACE / HTTP/1.1 > User-Agent: curl/7.29.0 > Host: vmforpriyanka:35216 > Accept: */* > < HTTP/1.1 200 OK < Content-Type: message/http < Content-Length: 83 < Server: Jetty(6.1.26) < TRACE / HTTP/1.1 User-Agent: curl/7.29.0 Host: vmforpriyanka:35216 Accept: */* * Connection #0 to host vmforpriyanka left intact   Curl o/p of second port is: curl -v -X TRACE http://vmforpriyanka:46645 * About to connect() to vmforpriyanka port 46645 (#0) * Trying 10.65.157.61... * Connected to vmforpriyanka (10.65.157.61) port 46645 (#0) > TRACE / HTTP/1.1 > User-Agent: curl/7.29.0 > Host: vmforpriyanka:46645 > Accept: */* > < HTTP/1.1 403 Forbidden < Content-Length: 0 < Server: Jetty(6.1.26) < * Connection #0 to host vmforpriyanka left intact     Also regarding the Jira ticket https://issues.apache.org/jira/browse/HBASE-10473, is this Hbase rest server only or for Hmaster also? The mentioned InfoServer class does not exist at path /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/InfoServer.java in hbase 1.3.1.  ... View more

I am using HBase 1.3.1 version of hbase. Is there a way i can disable Trace method? ... View more

@Harsh J  Thanks for the reply. Yes http://cm-host.com:7180/api/v15/clusters/MyClusterName/services/YARN-1/roleConfigGroups/YARN-1-GATEWAY-BASE/config?view=full api is giving all the mapreduce properties. So If i want to fetch all defined mapreduce properties,can i use this Api or it does have any pre-requisites? By prerequisites i mean, as in my cluster there was no role of gateway type for YARN service, even then using above api is giving me all mapred properties. Also does it require any privileges to access this api? ... View more

Hi Harsh, In my case, i am trying to fetch all mapreduce related properties. But in the yarn, there is no role of type Gateway for my cluster.  So is there any other way to fetch mapreduce properties? Also if i try to fetch mapreduce-site.xm file from other roles like node manager or resourcemanager, it is just givivng the xml file with 2 properties only: mapreduce.jobhistory.webapp.address mapreduce.jobhistory.webapp.https.address Could you please explain what could be the reason for that? And how can i fetch all the properties. ... View more