Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2001 | 06-15-2020 05:23 AM | |
| 16478 | 01-30-2020 08:04 PM | |
| 2149 | 07-07-2019 09:06 PM | |
| 8349 | 01-27-2018 10:17 PM | |
| 4739 | 12-31-2017 10:12 PM |
12-06-2017
01:09 PM
@Michael Bronson Yes, we can change the default ZK port 2181 to something else for all the hosts. That will also be a easily managable option.
... View more
12-06-2017
10:29 AM
@Jay excellent answer ,
... View more
12-05-2017
07:32 PM
@Michael Bronson In your first update the Hostname was not complete for ambari host. (Is that a typo "master02.dddns.com" or it should be "master02" ) curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://master02.dddns.com:8080/api/v1/clusters/HDP/hosts/worker04.dddns.com/host_components/METRICS_MONITOR . Also the hostname of worker is different "worker04.dddns.com" (or it should be "worker04.sys45.com") Are you sure that your host "worker04.dddns.com" really has AMS monitor installed to it? Please confirm the same using GET command to see if MONITOR is listed int eh output of the following API call? curl -u admin:admin -H "X-Requested-By: ambari" -X GET http://master02.dddns.com:8080/api/v1/clusters/HDP/hosts/worker04.dddns.com/host_components
... View more
12-05-2017
08:21 PM
1 Kudo
@Michael Bronson You can try the following approach to completely remove the unwanted host from your ambari Database. 0. Stop ambari-server. # ambari-server stop 1. Please take a fresh ambari DB dump for safety and backup. 2. Now run the following SQL queries inside your ambari DB to delete the unwanted host. Please replace the "unwanted1.host.com" with your unwanted hostname and similarly the "351" with the "host_id" that you want to remove from your Database. delete from execution_command where task_id in (select task_id from host_role_command where host_id in (351));
delete from host_version where host_id in (351);
delete from host_role_command where host_id in (351);
delete from serviceconfighosts where host_id in (351);
delete from hoststate where host_id in (351);
delete from kerberos_principal_host WHERE host_id='unwanted1.host.com'; ----> For kerberized Env
delete from hosts where host_name in ('unwanted1.host.com');
delete from alert_current where history_id in ( select alert_id from alert_history where host_name in ('unwanted1.host.com')); 3. Now restart ambari-server. # ambari-server start .
... View more
12-07-2017
06:32 PM
Is passwordless installed between the namenode and secondary namenode ( or standby if you are HA ) can you check in the namenode UI the checkpoints ?
... View more
12-05-2017
12:56 PM
@Aditya ok , so what we can do next ?
... View more
12-06-2017
10:04 AM
@Michael Bronson Brief of edits_inprogress__start transaction ID– This
is the current edit log in progress. All transactions starting fromare
in this file, and all new incoming transactions will get appended to
this file. HDFS pre-allocates space in this file in 1 MB chunks for
efficiency, and then fills it with incoming transactions. You’ll
probably see this file’s size as a multiple of 1 MB. When HDFS finalizes
the log segment, it truncates the unused portion of the space that
doesn’t contain any transactions, so the finalized file’s space will
shrink down. . More details about these files and it's functionality can be found at: https://hortonworks.com/blog/hdfs-metadata-directories-explained/
... View more
12-04-2017
05:09 PM
@Michael Bronson, This is because of dependency between the services. These are defined in role_command_order.json. If there is no dependency for the component it can run in parallel between the nodes. However in a particular node the execution will be sequential. You can check the role_command_order.json for different services and their dependencies. Just run the command in ambari server to find all the json files. find /var/lib/ambari-server/ -iname role_command_order.json Thanks, Aditya
... View more
12-05-2017
12:47 AM
@Michael Bronson Can you instead do a # grep namenodes /etc/hadoop/conf/hdfs-site.xml Then get the values of the parameter dfs.ha.namenodes.xxxx Please let me know
... View more
12-03-2017
11:00 PM
from the out file we get that --> Getting jmx metrics from NN failed. URL: http://master03.sys56.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem
... View more