Member since
07-30-2019
453
Posts
112
Kudos Received
80
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1427 | 04-12-2023 08:58 PM | |
| 3409 | 04-04-2023 11:48 PM | |
| 994 | 04-02-2023 10:24 PM | |
| 2630 | 07-05-2019 08:38 AM | |
| 2709 | 05-13-2019 06:21 AM |
12-04-2017
10:55 AM
1 Kudo
Hi @Anurag Mishra , for Operations covered when you run service check on various services you can know by reading the file service_check.py in respective services for example : HBASE you can understand by reading the file : cat /var/lib/ambari-server/resources/common-services/HBASE/0.96.0.2.0/package/scripts/service_check.py for HDFS cat /var/lib/ambari-server/resources/common-services/HDFS/2.1.0.2.0/package/scripts/service_check.py Similarly you can Open each of folders in common-services to see how ambari performs service check on each of those services Now For other question Is there some rest api to details of operations performed ? you can Always know it by checking in Pending requests in UI if you want to perform Service check via REST API you can follow the guides here : How to run service checks for various services using Ambari Rest APIs. Ambari API - Run all service checks (bulk)
... View more
12-04-2017
04:41 AM
Hi @Michael Bronson you can refer to following link to How to automatically restart/recovery of HDP services via ambari How do I enable automatic restart / recovery of HDP services via Ambari? Hope this Helps
... View more
10-24-2017
04:58 AM
@sidharth, * You can see the Ambari Server log to see if there is any error while performing the operation. * You can double check the DNS of each of the ambari agents whether its correct hostname -f * You can see Check the ambari-agents on these nodes are running if not restart them ensure the value hostname points to your ambari server in the /etc/ambari-agent/conf/ambari-agent.ini * you can see the /etc/hosts folder to check the FQDN names are provided are correct hope this helps
... View more
10-18-2017
06:51 AM
@Ramesh Prasad Some more suggestions 1) For JS code use :WebStorm ( you will get EAP version from official website with 30 days trial) 2) Remember to use Coding guidelines as mentioned here https://cwiki.apache.org/confluence/display/AMBARI/Coding+Guidelines+for+Ambari 3) when you are running the project always skip rat checks or it might fail in most of cases and takes lot of time: mvn clean install package -Dmaven.test.skip=true -Drat.skip -DskipTests 4) if you are changing only client side changes( Javascript in ambari-web folder ) , you can only run the project on ambari-web folder using the abouve command and the output will be generated on ambari/ambari/ambari-web/public/javascripts folder you can copy that for debbuging in your server folder /usr/lib/ambari-server/web/javascripts
... View more
10-09-2017
05:32 AM
2 Kudos
Hi @dsun, you can see the Status of upgrade in Database, psql ambari -U ambari default password is bigdata in DB execute the following command to see package versions ( to know status of upgrade) select * from hostcomponentstate;
id | cluster_id | component_name | version | current_stack_id | current_state | host_id | service_name | upgrade_state | security_state
-----+------------+-------------------------+-------------+------------------+---------------+---------+----------------+---------------+----------------
24 | 2 | HDFS_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 1 | HDFS | NONE | UNSECURED
21 | 2 | DATANODE | 2.6.2.0-205 | 7 | STARTED | 2 | HDFS | NONE | UNSECURED
26 | 2 | HDFS_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 4 | HDFS | NONE | UNSECURED
1 | 2 | NAMENODE | 2.6.2.0-205 | 7 | STARTED | 4 | HDFS | NONE | UNSECURED
30 | 2 | MAPREDUCE2_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 4 | MAPREDUCE2 | NONE | UNSECURED
2 | 2 | SECONDARY_NAMENODE | 2.6.2.0-205 | 7 | STARTED | 1 | HDFS | NONE | UNSECURED
101 | 2 | OOZIE_SERVER | 2.6.2.0-205 | 7 | STARTED | 1 | OOZIE | NONE | UNSECURED
25 | 2 | HDFS_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | HDFS | NONE | UNSECURED
34 | 2 | TEZ_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 4 | TEZ | NONE | UNSECURED
103 | 2 | OOZIE_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | OOZIE | NONE | UNSECURED
102 | 2 | OOZIE_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 1 | OOZIE | NONE | UNSECURED
52 | 2 | METRICS_MONITOR | UNKNOWN | 7 | STARTED | 1 | AMBARI_METRICS | NONE | UNSECURED
5 | 2 | HISTORYSERVER | 2.6.2.0-205 | 7 | STARTED | 1 | MAPREDUCE2 | NONE | UNSECURED
4 | 2 | APP_TIMELINE_SERVER | 2.6.2.0-205 | 7 | STARTED | 1 | YARN | NONE | UNSECURED
58 | 2 | HST_AGENT | UNKNOWN | 7 | INSTALLED | 1 | SMARTSENSE | NONE | UNSECURED
39 | 2 | HBASE_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | HBASE | NONE | UNSECURED
17 | 2 | HST_SERVER | UNKNOWN | 7 | STARTED | 4 | SMARTSENSE | NONE | UNSECURED
59 | 2 | MYSQL_SERVER | UNKNOWN | 7 | STARTED | 1 | HIVE | NONE | UNSECURED
12 | 2 | ZOOKEEPER_SERVER | 2.6.2.0-205 | 7 | STARTED | 4 | ZOOKEEPER | NONE | UNSECURED
51 | 2 | METRICS_MONITOR | UNKNOWN | 7 | STARTED | 4 | AMBARI_METRICS | NONE | UNSECURED
3 | 2 | RESOURCEMANAGER | 2.6.2.0-205 | 7 | STARTED | 1 | YARN | NONE | UNSECURED
45 | 2 | INFRA_SOLR_CLIENT | UNKNOWN | 7 | INSTALLED | 4 | AMBARI_INFRA | NONE | UNSECURED
18 | 2 | ACTIVITY_ANALYZER | UNKNOWN | 7 | INSTALLED | 4 | SMARTSENSE | NONE | UNSECURED
38 | 2 | HIVE_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 1 | HIVE | NONE | UNSECURED
54 | 2 | METRICS_MONITOR | UNKNOWN | 7 | STARTED | 2 | AMBARI_METRICS | NONE | UNSECURED
55 | 2 | HST_AGENT | UNKNOWN | 7 | INSTALLED | 4 | SMARTSENSE | NONE | UNSECURED
13 | 2 | INFRA_SOLR | UNKNOWN | 7 | STARTED | 4 | AMBARI_INFRA | NONE | UNSECURED
31 | 2 | MAPREDUCE2_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 1 | MAPREDUCE2 | NONE | UNSECURED
11 | 2 | ZOOKEEPER_SERVER | 2.6.2.0-205 | 7 | STARTED | 3 | ZOOKEEPER | NONE | UNSECURED
14 | 2 | METRICS_GRAFANA | UNKNOWN | 7 | STARTED | 4 | AMBARI_METRICS | NONE | UNSECURED
53 | 2 | METRICS_MONITOR | UNKNOWN | 7 | STARTED | 3 | AMBARI_METRICS | NONE | UNSECURED
44 | 2 | INFRA_SOLR_CLIENT | UNKNOWN | 7 | INSTALLED | 2 | AMBARI_INFRA | NONE | UNSECURED
36 | 2 | HCAT | 2.6.2.0-205 | 7 | INSTALLED | 2 | HIVE | NONE | UNSECURED
37 | 2 | HIVE_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | HIVE | NONE | UNSECURED
32 | 2 | MAPREDUCE2_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | MAPREDUCE2 | NONE | UNSECURED
20 | 2 | SPARK2_JOBHISTORYSERVER | 2.6.2.0-205 | 7 | STARTED | 4 | SPARK2 | NONE | UNSECURED
15 | 2 | METRICS_COLLECTOR | UNKNOWN | 7 | STARTED | 3 | AMBARI_METRICS | NONE | UNSECURED
23 | 2 | HBASE_REGIONSERVER | 2.6.2.0-205 | 7 | STARTED | 2 | HBASE | NONE | UNSECURED
50 | 2 | SLIDER | 2.6.2.0-205 | 7 | INSTALLED | 2 | SLIDER | NONE | UNSECURED
6 | 2 | HIVE_METASTORE | 2.6.2.0-205 | 7 | STARTED | 1 | HIVE | NONE | UNSECURED
41 | 2 | PIG | 2.6.2.0-205 | 7 | INSTALLED | 2 | PIG | NONE | UNSECURED
27 | 2 | YARN_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 4 | YARN | NONE | UNSECURED
40 | 2 | PIG | 2.6.2.0-205 | 7 | INSTALLED | 1 | PIG | NONE | UNSECURED
49 | 2 | SLIDER | 2.6.2.0-205 | 7 | INSTALLED | 1 | SLIDER | NONE | UNSECURED
46 | 2 | SPARK_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 1 | SPARK | NONE | UNSECURED
10 | 2 | ZOOKEEPER_SERVER | 2.6.2.0-205 | 7 | STARTED | 1 | ZOOKEEPER | NONE | UNSECURED
9 | 2 | HBASE_MASTER | 2.6.2.0-205 | 7 | STARTED | 4 | HBASE | NONE | UNSECURED
48 | 2 | SPARK2_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | SPARK2 | NONE | UNSECURED
35 | 2 | TEZ_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 1 | TEZ | NONE | UNSECURED
22 | 2 | NODEMANAGER | 2.6.2.0-205 | 7 | STARTED | 2 | YARN | NONE | UNSECURED
28 | 2 | YARN_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 1 | YARN | NONE | UNSECURED
33 | 2 | TEZ_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | TEZ | NONE | UNSECURED
42 | 2 | ZOOKEEPER_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 1 | ZOOKEEPER | NONE | UNSECURED
43 | 2 | ZOOKEEPER_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | ZOOKEEPER | NONE | UNSECURED
47 | 2 | SPARK_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | SPARK | NONE | UNSECURED
57 | 2 | HST_AGENT | UNKNOWN | 7 | INSTALLED | 3 | SMARTSENSE | NONE | UNSECURED
29 | 2 | YARN_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 2 | YARN | NONE | UNSECURED
56 | 2 | HST_AGENT | UNKNOWN | 7 | INSTALLED | 2 | SMARTSENSE | NONE | UNSECURED
16 | 2 | ACTIVITY_EXPLORER | UNKNOWN | 7 | STARTED | 4 | SMARTSENSE | NONE | UNSECURED
104 | 2 | OOZIE_CLIENT | 2.6.2.0-205 | 7 | INSTALLED | 4 | OOZIE | NONE | UNSECURED
19 | 2 | SPARK_JOBHISTORYSERVER | 2.6.2.0-205 | 7 | STARTED | 4 | SPARK | NONE | UNSECURED
7 | 2 | WEBHCAT_SERVER | 2.6.2.0-205 | 7 | STARTED | 1 | HIVE | NONE | UNSECURED
8 | 2 | HIVE_SERVER | 2.6.2.0-205 | 7 | STARTED | 1 | HIVE | NONE | UNSECURED
select * from hostcomponentdesiredstate;
id | cluster_id | component_name | desired_stack_id | desired_state | host_id | service_name | admin_state | maintenance_state | security_state | restart_required
-----+------------+-------------------------+------------------+---------------+---------+----------------+-------------+-------------------+----------------+------------------
6 | 2 | HIVE_METASTORE | 7 | STARTED | 1 | HIVE | | OFF | UNSECURED | 0
7 | 2 | WEBHCAT_SERVER | 7 | STARTED | 1 | HIVE | | OFF | UNSECURED | 0
19 | 2 | SPARK_JOBHISTORYSERVER | 7 | STARTED | 4 | SPARK | | OFF | UNSECURED | 0
20 | 2 | SPARK2_JOBHISTORYSERVER | 7 | STARTED | 4 | SPARK2 | | OFF | UNSECURED | 0
23 | 2 | HBASE_REGIONSERVER | 7 | STARTED | 2 | HBASE | INSERVICE | OFF | UNSECURED | 0
51 | 2 | METRICS_MONITOR | 7 | STARTED | 4 | AMBARI_METRICS | INSERVICE | OFF | UNSECURED | 0
52 | 2 | METRICS_MONITOR | 7 | STARTED | 1 | AMBARI_METRICS | INSERVICE | OFF | UNSECURED | 0
53 | 2 | METRICS_MONITOR | 7 | STARTED | 3 | AMBARI_METRICS | INSERVICE | OFF | UNSECURED | 0
54 | 2 | METRICS_MONITOR | 7 | STARTED | 2 | AMBARI_METRICS | INSERVICE | OFF | UNSECURED | 0
55 | 2 | HST_AGENT | 7 | STARTED | 4 | SMARTSENSE | INSERVICE | OFF | UNSECURED | 0
56 | 2 | HST_AGENT | 7 | STARTED | 2 | SMARTSENSE | INSERVICE | OFF | UNSECURED | 0
57 | 2 | HST_AGENT | 7 | STARTED | 3 | SMARTSENSE | INSERVICE | OFF | UNSECURED | 0
58 | 2 | HST_AGENT | 7 | STARTED | 1 | SMARTSENSE | INSERVICE | OFF | UNSECURED | 0
59 | 2 | MYSQL_SERVER | 7 | STARTED | 1 | HIVE | | OFF | UNSECURED | 0
102 | 2 | OOZIE_CLIENT | 7 | INSTALLED | 1 | OOZIE | | OFF | UNSECURED | 0
104 | 2 | OOZIE_CLIENT | 7 | INSTALLED | 4 | OOZIE | | OFF | UNSECURED | 0
1 | 2 | NAMENODE | 7 | STARTED | 4 | HDFS | | OFF | UNSECURED | 0
2 | 2 | SECONDARY_NAMENODE | 7 | STARTED | 1 | HDFS | | OFF | UNSECURED | 0
3 | 2 | RESOURCEMANAGER | 7 | STARTED | 1 | YARN | | OFF | UNSECURED | 0
4 | 2 | APP_TIMELINE_SERVER | 7 | STARTED | 1 | YARN | | OFF | UNSECURED | 0
5 | 2 | HISTORYSERVER | 7 | STARTED | 1 | MAPREDUCE2 | | OFF | UNSECURED | 0
21 | 2 | DATANODE | 7 | STARTED | 2 | HDFS | INSERVICE | OFF | UNSECURED | 0
22 | 2 | NODEMANAGER | 7 | STARTED | 2 | YARN | INSERVICE | OFF | UNSECURED | 0
24 | 2 | HDFS_CLIENT | 7 | INSTALLED | 1 | HDFS | | OFF | UNSECURED | 0
25 | 2 | HDFS_CLIENT | 7 | INSTALLED | 2 | HDFS | | OFF | UNSECURED | 0
26 | 2 | HDFS_CLIENT | 7 | INSTALLED | 4 | HDFS | | OFF | UNSECURED | 0
27 | 2 | YARN_CLIENT | 7 | INSTALLED | 4 | YARN | | OFF | UNSECURED | 0
28 | 2 | YARN_CLIENT | 7 | INSTALLED | 1 | YARN | | OFF | UNSECURED | 0
29 | 2 | YARN_CLIENT | 7 | INSTALLED | 2 | YARN | | OFF | UNSECURED | 0
30 | 2 | MAPREDUCE2_CLIENT | 7 | INSTALLED | 4 | MAPREDUCE2 | | OFF | UNSECURED | 0
31 | 2 | MAPREDUCE2_CLIENT | 7 | INSTALLED | 1 | MAPREDUCE2 | | OFF | UNSECURED | 0
32 | 2 | MAPREDUCE2_CLIENT | 7 | INSTALLED | 2 | MAPREDUCE2 | | OFF | UNSECURED | 0
33 | 2 | TEZ_CLIENT | 7 | INSTALLED | 2 | TEZ | | OFF | UNSECURED | 0
34 | 2 | TEZ_CLIENT | 7 | INSTALLED | 4 | TEZ | | OFF | UNSECURED | 0
35 | 2 | TEZ_CLIENT | 7 | INSTALLED | 1 | TEZ | | OFF | UNSECURED | 0
36 | 2 | HCAT | 7 | INSTALLED | 2 | HIVE | | OFF | UNSECURED | 0
37 | 2 | HIVE_CLIENT | 7 | INSTALLED | 2 | HIVE | | OFF | UNSECURED | 0
38 | 2 | HIVE_CLIENT | 7 | INSTALLED | 1 | HIVE | | OFF | UNSECURED | 0
39 | 2 | HBASE_CLIENT | 7 | INSTALLED | 2 | HBASE | | OFF | UNSECURED | 0
40 | 2 | PIG | 7 | INSTALLED | 1 | PIG
| | OFF | UNSECURED | 0
41 | 2 | PIG | 7 | INSTALLED | 2 | PIG | | OFF | UNSECURED | 0
42 | 2 | ZOOKEEPER_CLIENT | 7 | INSTALLED | 1 | ZOOKEEPER | | OFF | UNSECURED | 0
43 | 2 | ZOOKEEPER_CLIENT | 7 | INSTALLED | 2 | ZOOKEEPER | | OFF | UNSECURED | 0
44 | 2 | INFRA_SOLR_CLIENT | 7 | INSTALLED | 2 | AMBARI_INFRA | | OFF | UNSECURED | 0
45 | 2 | INFRA_SOLR_CLIENT | 7 | INSTALLED | 4 | AMBARI_INFRA | | OFF | UNSECURED | 0
46 | 2 | SPARK_CLIENT | 7 | INSTALLED | 1 | SPARK | | OFF | UNSECURED | 0
47 | 2 | SPARK_CLIENT | 7 | INSTALLED | 2 | SPARK | | OFF | UNSECURED | 0
48 | 2 | SPARK2_CLIENT | 7 | INSTALLED | 2 | SPARK2 | | OFF | UNSECURED | 0
49 | 2 | SLIDER | 7 | INSTALLED | 1 | SLIDER | | OFF | UNSECURED | 0
50 | 2 | SLIDER | 7 | INSTALLED | 2 | SLIDER | | OFF | UNSECURED | 0
8 | 2 | HIVE_SERVER | 7 | STARTED | 1 | HIVE | | OFF | UNSECURED | 0
9 | 2 | HBASE_MASTER | 7 | STARTED | 4 | HBASE | | OFF | UNSECURED | 0
10 | 2 | ZOOKEEPER_SERVER | 7 | STARTED | 1 | ZOOKEEPER | | OFF | UNSECURED | 0
11 | 2 | ZOOKEEPER_SERVER | 7 | STARTED | 3 | ZOOKEEPER | | OFF | UNSECURED | 0
12 | 2 | ZOOKEEPER_SERVER | 7 | STARTED | 4 | ZOOKEEPER | | OFF | UNSECURED | 0
13 | 2 | INFRA_SOLR | 7 | STARTED | 4 | AMBARI_INFRA | | OFF | UNSECURED | 0
14 | 2 | METRICS_GRAFANA | 7 | STARTED | 4 | AMBARI_METRICS | | OFF | UNSECURED | 0
15 | 2 | METRICS_COLLECTOR | 7 | STARTED | 3 | AMBARI_METRICS | | OFF | UNSECURED | 0
16 | 2 | ACTIVITY_EXPLORER | 7 | STARTED | 4 | SMARTSENSE | | OFF | UNSECURED | 0
17 | 2 | HST_SERVER | 7 | STARTED | 4 | SMARTSENSE | | OFF | UNSECURED | 0
18 | 2 | ACTIVITY_ANALYZER | 7 | STARTED | 4 | SMARTSENSE | | OFF | UNSECURED | 0
103 | 2 | OOZIE_CLIENT | 7 | INSTALLED | 2 | OOZIE | | OFF | UNSECURED | 0
101 | 2 | OOZIE_SERVER | 7 | STARTED | 1 | OOZIE | | OFF | UNSECURED | 0
select * from host_version;
id | repo_version_id | host_id | state
----+-----------------+---------+---------
2 | 1 | 3 | CURRENT
3 | 1 | 4 | CURRENT
4 | 1 | 1 | CURRENT
1 | 1 | 2 | CURRENT
select * from cluster_version;
id | repo_version_id | cluster_id | state | start_time | end_time | user_name
----+-----------------+------------+---------+---------------+---------------+-----------
1 | 1 | 2 | CURRENT | 1505793403390 | 1505794154404 | admin
you can update the host_versions to UPGRADING incase some upgrades has not happened. you can troubleshoot more based on output of this database commands.
... View more
09-25-2017
06:03 AM
As per this Link(point17) :https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_command-line-upgrade/content/getting-ready-23.html You need to upgrade JDK first. then go with HDP upgrade
... View more
08-08-2017
11:26 AM
I have a Kerberos enabled cluster with HDFS service installed on host1. when i try to perform some operations on HDFS server, its failing with below error. 17/08/08 11:19:34 WARN ipc.Client: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
report: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "host1.example.com/172.26.110.122"; destination host is: "host1.example.com":8020; I tried to execute klist it shoes some certificates but seems expired. Please help me on this error.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
08-08-2017
08:29 AM
If you are sure its related to your Custom Service , You can skip the service checks of Ambari before upgrade by changing the configuration in ambari.properties : cd /etc/ambari-server/conf
vi ambari.properties check for the below configurations (add if doesnt exist): skip.service.checks=true -- if you want to skip service checks
stack.upgrade.bypass.prechecks=true Restart the ambari server Perform the steps. It has to work fine. Let me know if it works
... View more
08-08-2017
04:54 AM
Go to etc/hive/conf find a file called hive-log4j.prpoerties # 30-day backup
#log4j.appender.DRFA.MaxBackupIndex= 30 Find the abouve commented line inside the file. Remove the # and modify value to 10. I think this is one you are searching for . Let me know if it works
... View more
06-14-2017
06:29 AM
@Jay SenSharma Thanks, Worked for me too
... View more
- « Previous
- Next »