Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2001 | 06-15-2020 05:23 AM | |
| 16486 | 01-30-2020 08:04 PM | |
| 2149 | 07-07-2019 09:06 PM | |
| 8357 | 01-27-2018 10:17 PM | |
| 4740 | 12-31-2017 10:12 PM |
05-14-2018
03:31 AM
@Michael Bronson Kafka stores the latest offsets in memory before they are sent to disk, therefore, the more memory the better, with a max of 8G. And I would assume that the heap properties can be set from Ambari rather than individually on the broker, but I don't use Kafka from HDP, so I can't say.
... View more
05-01-2018
07:39 PM
2 Kudos
@Michael Bronson You can safely delete them
... View more
04-25-2018
08:17 PM
1 Kudo
@Michael Bronson The Avahi daemon is present by default and allows you to discover network resources. No hortonworks documentation talks about it just because I think it trivial. Do you NEED it? No, AFAIK nobody absolutely needs this, it's a recent technology and the networks have worked before this. It can be convenient though on networks available to the public, but if you administer your network you know where services are. The only services that affect HDP are documented below especially the last 4
Set Up Password-less SSH Set Up Service User Accounts Enable NTP on the Cluster and on the Browser Host Check DNS and NSCD Configuring iptables Disable SELinux and PackageKit and check the umask Value DNS should work without Avahi, disable on a couple of nodes you will see the seervice still running fine
... View more
04-30-2018
10:39 AM
@Michael Bronson Here is how I force my filesystem check for every 3 months, I use the below command below. $ sudo tune2fs -i 3m /dev/sda1 Now verify that newly added filesystem check conditions are set properly. $ sudo tune2fs -l /dev/sda1 Desired output should look like this Last mount time: n/a
Last write time: Sat Mar 10 22:29:24 2018
Mount count: 20
Maximum mount count: 30
Last checked: Fri Mar 2 20:55:08 2018
Check interval: 7776000 (3 months)
Next check after: Sat Jun 2 21:55:08 2018 Hope that answers your question
... View more
04-25-2018
08:25 PM
1 Kudo
@Michael Bronson The disk is already unusable go-ahead run fsck with a -y option to repair it 🙂 see above Either way you will have to replace that dirty disk anyways!
... View more
04-16-2018
05:22 PM
@Michael Bronson Need to look at the Journal node logs. To fix JN, You can simply copy the data from another good JN and start it.
... View more
04-16-2018
02:44 PM
@Jay do you have suggestion how to install Master + worker + kafka on single node ?
... View more
04-15-2018
10:26 AM
2 Kudos
@Michael Bronson Ambari provides an option as following to change the hostnames for various hosts: # ambari-server update-host-names host_names_changes.json . In this case we will need to create a JSON file as mentioned in the doc: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-administration/content/ch_changing_host_names.html {
"cluster1" : {
"c6400.ambari.apache.org" : "c6410.ambari.apache.org",
"c6401.ambari.apache.org" : "c6411.ambari.apache.org",
....
}
} . NOTE: Please make sure to not have Mixed case hostname OR Uppercase Hostname. Please keep all hostnames in Lowercase else you might encounter some issues.
... View more
04-11-2019
01:01 PM
@Jay Kumar SenSharma I have figured it out. Thank you!! I also need to know one more thing. Using the feature Enable Service Auto start is it a safe way to configure it in Ambari in any environment? Is there any Cons having it enabled? If we enable auto start, will there be affect on service which will ask for restarting the service? Thanking in Advance!!!
... View more
04-12-2018
01:15 PM
@michael - We have done this in our cluster(170Nodes), It was done a year back. We took down time to perform this, Brought the whole cluster down. The steps mentioned by Jay were followed by us. the DNS changes were made during the downtime. We had two networking scripts ready on the Linux servers, one was pointing to the old ip & another pointing to new ip. Once the cluster was brought down, the new ip addresses were brought up. Post this we have started all the Ambari & Hadoop services manually.
... View more