Member since
11-07-2016
637
Posts
253
Kudos Received
144
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2721 | 12-06-2018 12:25 PM | |
| 2863 | 11-27-2018 06:00 PM | |
| 2194 | 11-22-2018 03:42 PM | |
| 3567 | 11-20-2018 02:00 PM | |
| 6281 | 11-19-2018 03:24 PM |
01-03-2018
12:38 PM
1 Kudo
@Michael Bronson, There will not be separate status for Active NameNode and StandByNamenode. You can find if name node is running or not. To get the status of NAMENODE use the below API curl -u {ambari-username}:{ambari-password} -H "X-Requested-By: ambari" -X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/components/NAMENODE?fields=ServiceComponentInfo/state Thanks, Aditya
... View more
01-03-2018
10:46 AM
1 Kudo
@Michael Bronson, ZKFailoverController is listed as ZKFC in the above API call response. If you want to get the status of ZKFailoverController , you can call this below API curl -u {ambari-username}:{ambari-password} -H "X-Requested-By: ambari" -X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/components/ZKFC?fields=ServiceComponentInfo/state The status of Standby NameNode and Active Namenode will be represented together as NameNode. If you want to know the active and standby namenodes, you can use these below API calls For active Namenode: curl -u admin:admin -H "X-Requested-By: ambari" -X GET "http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/host_components?HostRoles/component_name=NAMENDE&metrics/dfs/FSNamesystem/HAState=active" For standby namenode: curl -u admin:admin -H "X-Requested-By: ambari" -X GET "http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/host_components?HostRoles/component_name=NAMENODE&metrics/dfs/FSNamesystem/HAState=standby" Thanks, Aditya
... View more
01-03-2018
05:20 AM
1 Kudo
@Michael Bronson, To get status of all services curl -u {ambari-username}:{ambari-password} -H "X-Requested-By: ambari" -X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/services?fields=ServiceInfo/state To get status of all components curl -u {ambari-username}:{ambari-password} -H "X-Requested-By: ambari" -X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/components?fields=ServiceComponentInfo/state Replace the placeholders Thanks, Aditya
... View more
01-02-2018
05:19 PM
1 Kudo
@Michael Bronson To get list of services curl -u {ambari-username}:{ambari-password}-H "X-Requested-By: ambari"-X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/services/{service-name} To get list of components curl -u {ambari-username}:{ambari-password}-H "X-Requested-By: ambari"-X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/components/
... View more
01-02-2018
04:51 PM
2 Kudos
@Michael Bronson, You can get the state - STARTED/STOPPED by using the below API Calls For services curl -u {ambari-username}:{ambari-password} -H "X-Requested-By: ambari" -X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/services/{service-name}?fields=ServiceInfo/state For components curl -u {ambari-username}:{ambari-password} -H "X-Requested-By: ambari" -X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/components/{component-name}?fields=ServiceComponentInfo/state To get complete status info about service curl -u {ambari-username}:{ambari-password} -H "X-Requested-By: ambari" -X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/services/{service-name} To get complete status info about component curl -u {ambari-username}:{ambari-password} -H "X-Requested-By: ambari" -X GET http://{ambari-host}:{ambari-port}/api/v1/clusters/{clustername}/components/{component-name} Replace the place holders like {ambari-username} , {ambari-password}, {ambari-host} , {ambari-port},{clustername} etc with your respective values Thanks, Aditya
... View more
01-02-2018
11:42 AM
1 Kudo
@Raja Sekhar Chintalapati, The below command should do hdfs dfs -ls -R / | awk '{ if ( $3 == "spark" && substr($0,0,1) != "d" ) { print $8 } }' | xargs hdfs dfs -rm In the above command "spark" is the user name. Replace it with your username. Also I considered path as '/' . If you want to delete files only in a certain directory , replace it with your directory. This will remove only the files owned by the user and not the directories. Thanks, Aditya
... View more
01-02-2018
08:33 AM
@Michael Bronson Go to Yarn -> Configs -> Advanced -> Scheduler -> Capacity Scheduler . Check 'yarn.scheduler.capacity.maximum-applications'. Default should be 10000.
... View more
01-02-2018
06:41 AM
1 Kudo
@Michael Bronson Check if Yarn application is started when you start Spark2 Thrift server. Application name should be "Thrift JDBC/ODBC Server SPARK" and Application Type should be "SPARK". If the application is not started after few minutes after starting Spark2 server from Ambari GUI, there may be resource crunch on Yarn. Check the max applications allowed in Yarn and memory settings or try adding a Node manager. Thanks, Aditya
... View more
12-22-2017
05:39 AM
@Chiranjeevi Nimmala, If the Replication factor >= no of datanodes currently and you try to decommission a data node , it may get stuck in Decommissioning state. Ex: Replication factor is 3, Current data nodes =3. If you are trying to decommission a node now , it may get stuck in that state. Make sure that no of data node matches the replication factor. Reference : https://issues.apache.org/jira/browse/HDFS-1590 Thanks, Aditya
... View more