About jsensharma

jsensharma · ‎12-28-2018

@Nihal Shelke As we see the error : File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 424, in post_start raise Fail("Pid file {0} doesn't exist after starting of the component.".format(pid_file))resource_management.core.exceptions.Fail: Pid file /var/run/hbase/hbase-hbase-master.pid doesn't exist after starting of the component. . So can you please check if you are able to create an Empty file with user "hbase" as following with the mentioned permission? And then try starting the HBase again. # su - hbase # ls -l /var/run/hbase/hbase-hbase-master.pid -rw-r--r--. 1 hbase hadoop 5 Dec 23 23:30 /var/run/hbase/hbase-hbase-master.pid . If you still face any issue then please try the following approach to start the HBase process and if it starts successfully Manually then next time you can try restarting it from Ambari UI and it should work. # su -l hbase -c "/usr/hdp/current/hbase-master/bin/hbase-daemon.sh start master; sleep 25" . See: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_reference/content/starting_hdp_services.html

jsensharma · ‎12-24-2018

@Atharva Vadapurkar If the port 8020 is not opened then the best place will be to look at the NameNode startup logs to findout if there are any errors logged or if any tuning needed for NameNode. Please share the NameNode logs as well.

jsensharma · ‎12-23-2018

@Atharva Vadapurkar You are getting error as following, Hence please check "dfs.namenode.rpc-address" (in Advanced hdfs-site) and "fs.defaultFS" in (Advanced core-site) property ports and hostname. Call From localhost/127.0.0.1 to localhost:8020 failed on connection exception: java.net.ConnectException: Connection refused; Notice that the port 8020 is not being accessible on "localhost". So please check your HDFS configuration to find out if your NameNode is listening to "localhost:8020" address or not? Ambari UI --> HDFS --> Configs --> Advanced --> Advanced hdfs-site --> "dfs.namenode.rpc-address" Please verify your "/etc/hosts" file as well to confirm that you have the "localhost" entry properly setup (See the Note from Link: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.0/bk_ambari-installation-ppc/content/edit_the_host_file.html) and the NameNode port 8020 is opened and listening on "localhost" # cat /etc/hosts # netstat -tnlpa | grep 8020 .

jsensharma · ‎12-18-2018

@Nihal Shelke As you are getting error: java.lang.AbstractMethodError: org.apache.hadoop.metrics2.sink.timeline.HadoopTimelineMetricsSink.init(Lorg/apache/commons/configuration/SubsetConfiguration;)V at . Hence first of all please make sure that your Ambari Metrics Service and Ambari Server version are same? # rpm -qa | grep -i ambari Normally it can happen if the Ambari Metrics Collector service (Hadoop Sinks) is not upgraded after ambari upgrade. ### On All cluster hosts # yum upgrade ambari-metrics-monitor ambari-metrics-hadoop-sink ### On AMS collector host: # yum upgrade ambari-metrics-collector https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.0/bk_ambari-upgrade/content/upgrade_ambari_metrics.html .

jsensharma · ‎12-14-2018

Sometimes it is desired to see what kind of Http request ambari server makes to the outside works for troubleshooting purpose and to know the value of various http headers (like: User-Agent, Accept, Last-Modified, Content-Type, Content-Length, Connection, ETag, Server, X-Cache ...etc) which ambari-server uses to make calls to Ambari Public repo ...etc. So in order to achieve the Http Logging of ambari server made http requests we can do the following: Step-1). Create a file "/etc/ambari-server/conf/http.logging.properties" with the following content: .level=INFO handlers=java.util.logging.ConsoleHandler java.util.logging.ConsoleHandler.level=ALL sun.net.www.protocol.level=ALL sun.net.www.protocol.http.HttpURLConnection.level=ALL debug.level=ALL . Step-2). Inside the "/var/lib/ambari-server/ambari-env.sh" file variable "AMBARI_JVM_ARGS" make sure to add the following parameter "-Djava.util.logging.config.file=/etc/ambari-server/conf/http.logging.properties" to enable the http logging. Example: export AMBARI_JVM_ARGS="$AMBARI_JVM_ARGS -Xms512m -Xmx2048m -XX:MaxPermSize=128m -Djava.security.auth.login.config=$ROOT/etc/ambari-server/conf/krb5JAASLogin.conf -Djava.security.krb5.conf=/etc/krb5.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dcom.sun.jndi.ldap.connect.pool.protocol=\"plain ssl\" -Dcom.sun.jndi.ldap.connect.pool.maxsize=20 -Dcom.sun.jndi.ldap.connect.pool.timeout=300000 -Djava.util.logging.config.file=/etc/ambari-server/conf/http.logging.properties" . Step-3). Restart Ambari Server. # ambari-server restart . Step-4). Now check the "/var/log/ambari-server/ambari-server.out" file to see the http logging. Example Output: Dec 14, 2018 4:52:29 AM sun.net.www.protocol.http.HttpURLConnection plainConnect0 FINEST: ProxySelector Request for http://public-repo-1.hortonworks.com/HDP/ubuntu14/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml Dec 14, 2018 4:52:29 AM sun.net.www.http.HttpClient logFinest FINEST: KeepAlive stream retrieved from the cache, sun.net.www.http.HttpClient(http://public-repo-1.hortonworks.com/HDP/centos7/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml) Dec 14, 2018 4:52:29 AM sun.net.www.protocol.http.HttpURLConnection plainConnect0 FINEST: Proxy used: DIRECT Dec 14, 2018 4:52:29 AM sun.net.www.protocol.http.HttpURLConnection writeRequests FINE: sun.net.www.MessageHeader@5b3d7d395 pairs: {GET /HDP/ubuntu14/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml HTTP/1.1: null}{User-Agent: Java/1.8.0_112}{Host: public-repo-1.hortonworks.com}{Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2}{Connection: keep-alive} Dec 14, 2018 4:52:29 AM sun.net.www.http.HttpClient logFinest FINEST: KeepAlive stream used: http://public-repo-1.hortonworks.com/HDP/ubuntu14/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml Dec 14, 2018 4:52:29 AM sun.net.www.protocol.http.HttpURLConnection getInputStream0 FINE: sun.net.www.MessageHeader@7854dac13 pairs: {null: HTTP/1.1 200 OK}{Content-Type: application/xml}{Content-Length: 2597}{Connection: keep-alive}{Last-Modified: Thu, 12 Jul 2018 23:45:36 GMT}{Accept-Ranges: bytes}{Server: AmazonS3}{Date: Thu, 13 Dec 2018 12:28:28 GMT}{ETag: "abcdefgh42ffdc96d0ab1de61e0dc36cd3"}{Age: 59042}{X-Cache: Hit from cloudfront}{Via: 1.1 frontend_cloud.example.net (CloudFront)}{X-Amz-Cf-Id: Sn-ABCDEFGH8xvcOmkqoeHg_UCYmwyRU9tgDonWfAd4TMXoPdMabcdefgh==} Dec 14, 2018 4:52:29 AM sun.net.www.protocol.http.HttpURLConnection plainConnect0 FINEST: ProxySelector Request for http://public-repo-1.hortonworks.com/HDP/centos7-ppc/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml Dec 14, 2018 4:52:29 AM sun.net.www.http.HttpClient logFinest FINEST: KeepAlive stream retrieved from the cache, sun.net.www.http.HttpClient(http://public-repo-1.hortonworks.com/HDP/ubuntu14/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml) Dec 14, 2018 4:52:29 AM sun.net.www.protocol.http.HttpURLConnection plainConnect0 FINEST: Proxy used: DIRECT Dec 14, 2018 4:52:29 AM sun.net.www.protocol.http.HttpURLConnection writeRequests FINE: sun.net.www.MessageHeader@32b9674a5 pairs: {GET /HDP/centos7-ppc/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml HTTP/1.1: null}{User-Agent: Java/1.8.0_112}{Host: public-repo-1.hortonworks.com}{Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2}{Connection: keep-alive} Dec 14, 2018 4:52:29 AM sun.net.www.http.HttpClient logFinest FINEST: KeepAlive stream used: http://public-repo-1.hortonworks.com/HDP/centos7-ppc/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml Dec 14, 2018 4:52:29 AM sun.net.www.protocol.http.HttpURLConnection getInputStream0 FINE: sun.net.www.MessageHeader@606955ef13 pairs: {null: HTTP/1.1 200 OK}{Content-Type: application/xml}{Content-Length: 2609}{Connection: keep-alive}{Date: Mon, 10 Dec 2018 09:44:35 GMT}{Last-Modified: Fri, 13 Jul 2018 04:43:55 GMT}{ETag: "abcdefgh42ffdc96d0ab1de61e0dc36cd3"}{Accept-Ranges: bytes}{Server: AmazonS3}{Age: 59042}{X-Cache: Hit from cloudfront}{Via: 1.1 frontend_cloud.example.net (CloudFront)}{X-Amz-Cf-Id: ABCDEFGHb3LeLucDbVt5BgHNJmhZRjQPUYPMZS7zHO7oqR1Kabcdefgh==} .

jsensharma · ‎12-06-2018

@Michael Bronson Following API call will tell us how many DataNodes are live. # curl -H "X-Requested-By: ambari" -u admin:admin -X GET http://newhwx1.example.com:8080/api/v1/clusters/NewCluster/services/HDFS/components/DATANODE?fields=ServiceComponentInfo/started_count,ServiceComponentInfo/total_count "started_count": Shows the live (running) DataNodes. "total_count" : Shows how many DataNodes are there in the cluster. In order to find out the Individual DataNode Status you will need to supply the hostnames where the DataNodes are installed in the following API call. # curl -H "X-Requested-By: ambari" -u admin:admin -X GET http://newhwx1.example.com:8080/api/v1/clusters/NewCluster/hosts/newhwx4.example.com/host_components/DATANODE?fields=HostRoles/host_name,HostRoles/state (OR other host) # curl -H "X-Requested-By: ambari" -u admin:admin -X GET http://newhwx1.example.com:8080/api/v1/clusters/NewCluster/hosts/newhwx1.example.com/host_components/DATANODE?fields=HostRoles/host_name,HostRoles/state

jsensharma · ‎11-26-2018

@Veera Mundra Please make sure that you are using correct MySQL root user credentials and able to logint o mysql using the "mysql client" as following: # mysql -u root -p Enter Password: <What_Ever_Is_Your_Root_Password> . If you do not know your root user password for mysql then you can reset it as mentioned in: https://dev.mysql.com/doc/refman/8.0/en/resetting-permissions.html Stop the MySQL server if necessary, then restart it with the --skip-grant-tables option. This enables anyone to connect without a password and with all privileges, and disables account-management statements such as ALTER USER and SET PASSWORD . Because this is insecure, if the server is started with the --skip-grant-tables option, it enables --skip-networking automatically to prevent remote connections Connect to the MySQL server using themysqlclient; no password is necessary because the server was started with --skip-grant-tables : shell> mysql In the mysql client, tell the server to reload the grant tables so that account-management statements work: mysql> FLUSH PRIVILEGES mysql> ALTER USER 'root'@'localhost' IDENTIFIED BY 'MyNewPass'; . Also please refer to : https://stackoverflow.com/questions/17975120/access-denied-for-user-rootlocalhost-using-password-yes-no-privileges/17976151

jsensharma · ‎11-19-2018

UI uses Java Script to parse and process the bar values. I am afraid that using API call we can not get those values calculations. Mostly the recommendations comes from the "stack_advisor.py" script as following: https://github.com/apache/ambari/blob/release-2.6.2/ambari-server/src/main/resources/stacks/stack_advisor.py#L611-L613 .

jsensharma · ‎11-18-2018

@Michael Bronson The Max limit should be (RAM on NameNode - 500MB) i guess because Operating System processes also need some amount of RAM memory. Do you have 16 GB RAM on your NameNode host? Please check the NameNode "Hosts/total_mem" (Total Memory). You can assign NameNode heap not maore than that ideally even if the configuration file can have higher value. # curl -H "X-Requested-By: ambari" -u admin:admin -X GET "http://newhwx1.example.com:8080/api/v1/clusters/NewCluster/hosts?fields=Hosts/rack_info,Hosts/host_name,Hosts/maintenance_state,Hosts/public_host_name,Hosts/total_mem" .

jsensharma · ‎11-18-2018

@Michael Bronson You can try making the following kind of API call: # curl -H "X-Requested-By: ambari" -u admin:admin -X GET "http://newhwx1.example.com:8080/api/v1/clusters/NewCluster/hosts?fields=Hosts/host_name,Hosts/public_host_name,Hosts/cpu_count&host_compnents/HostRoles/component_name.in(DATANODE)" . Please replace the following (in addition to cre4dentials) newhwx1.example.com:8080 => Ambari Server URL NewCluster => Your ClusterName . Also if you are running your Abari Server on "HTTPS" secure port then please make sure that you are are appending "-k" in the curl command like: # curl -k -H "X-Requested-By: ambari" ...... .

Member Since	‎03-14-2016 01:07 PM
Last Visited
Posts	4,721
Kudos received	1096

Cloudera Community

Re: set Variable in ambari rest API

Re: how to stop Hive Metastore and HiveServer2 by...

Re: how to verify by ambari api the active/standby...

Re: Curl throws error when running allow snapshot

Re: ambari server + REASON: Server not yet listeni...

Re: Getting error while starting hbase process in ...

Re: hadoop SLF4J: Class path contains multiple SLF...

Re: hadoop SLF4J: Class path contains multiple SLF...

Re: I am getting error while starting Hbase servic...

How to enable HTTP logging for Ambari Server Outbo...

Re: how to check that all datanode are up by REST ...

Re: while importing data from mysql to HDFS gettin...

Re: REST API + how to verify the max value for eac...

Re: REST API + how to verify the max value for eac...

Re: REST API + how to get the number of CPU on eac...