Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1916 | 06-15-2020 05:23 AM | |
| 15447 | 01-30-2020 08:04 PM | |
| 2067 | 07-07-2019 09:06 PM | |
| 8097 | 01-27-2018 10:17 PM | |
| 4565 | 12-31-2017 10:12 PM |
01-24-2018
09:15 PM
@Michael Bronson Can you please share the following log file content so that we can see the cause of failure? The latest log of the ZKFC process # ls -lart /var/log/hadoop/hdfs/hadoop-hdfs-zkfc*.log
# ls -lart /var/log/hadoop/hdfs/hadoop-hdfs-zkfc*.out .
... View more
01-24-2018
10:42 PM
can I run like - hdfs namenode -bootstrap.... on the active node , if yes then what is the complete syntax ?
... View more
01-22-2018
11:24 PM
@Jay what you recomended based on the output from grep ?
... View more
01-20-2018
04:04 AM
Ambari is only okay if the agents are healthy and responding. You will at least need something like Nagios to check when services are down, disks are dead or full, fan stopped worked, RAM is bad, etc. Personally, I'm a big fan of Ansible for running distributed SSH commands across the entire cluster. Ansible uses Jinja2 templates just like Ambari for templating out config files, it can start/stop services, sync files across machines, etc. Much better than ssh-ing to each host one by one. With the recent release of Ansible Tower, you can make a centralized location for all your Ansible scripts. Alternative tools such as Puppet/Chef exist, and many older infrastructures already have those tools in place elsewhere in their infrastructure. If you have RHEL, then Satellite might be worth using. For tracing problems, you absolutely need some log collection framework and enabling JMX on every single Java / Hadoop process. You can pay for Splunk, or you can roll your own setup using Solr or Elasticsearch. Ambari recently added Ambari Infra and Log Search, which are backed by Solr. Lucidworks has a project named Banana that adds a nice dashboarding UI on top of Solr, although Grafana is also nice for dashboarding. If you go with Elasticsearch, it offers Logstash and Beats products that integrate well with many other external systems.
... View more
01-19-2018
02:16 PM
thank you for the long explanation , regarding the ppt , I just to save the time to create this doc ) , so I oped that somethng in network already done
... View more
01-14-2018
11:08 PM
what about the latest HDP Utils and ambari ? do you think we can use the latest version ?
... View more
12-04-2018
02:03 PM
2018-12-04 06:01:04,253 - Repository[None] {'action': ['create']}
2018-12-04 06:01:04,254 - File['/tmp/tmp941BIk'] {'content': '[HDP-3.0-repo-101]\nname=HDP-3.0-repo-101\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos7/3.x/updates/3.0.1.0\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.22-repo-101]\nname=HDP-UTILS-1.1.0.22-repo-101\nbaseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-12-04 06:01:04,254 - Writing File['/tmp/tmp941BIk'] because contents don't match
2018-12-04 06:01:04,254 - File['/tmp/tmpq8_Itc'] {'content': StaticFile('/etc/yum.repos.d/ambari-hdp-101.repo')}
2018-12-04 06:01:04,255 - Writing File['/tmp/tmpq8_Itc'] because contents don't match
2018-12-04 06:01:04,255 - Rewriting /etc/yum.repos.d/ambari-hdp-101.repo since it has changed.
2018-12-04 06:01:04,255 - File['/etc/yum.repos.d/ambari-hdp-101.repo'] {'content': StaticFile('/tmp/tmp941BIk')}
2018-12-04 06:01:04,256 - Writing File['/etc/yum.repos.d/ambari-hdp-101.repo'] because contents don't match everytime the repo is overriden/generating new file due to which i cannot use my proxy to access public repository. i have already set proxy and port in ambari environment. pelase advise how to get rid of this to proceed with installation. Thank you in Advance. , Hi , i am using proxy to access HDP repo, but due to below issue , ambari is using new repo everytime due to which installation is failing . 018-12-04 06:01:04,255 - Writing File['/tmp/tmpq8_Itc'] because contents don't match
2018-12-04 06:01:04,255 - Rewriting /etc/yum.repos.d/ambari-hdp-101.repo since it has changed. I have already set proxyname and port in ambari environment . please advise , how to instruct ambari to use existing repo without generating/overriding everytime. Thank you,
... View more
01-13-2018
11:30 PM
2 Kudos
@Michael Bronson What ever version of Ambari and Hadoop you see in the Hortonworks Documentation are certified (however some of them are declared as End Of Support as they are very old). However if you want to see the Support Policy and the End Of Life Information about various products then please refer to: https://hortonworks.com/agreements/support-services-policy/ Example HDP Current Support Matrix If you are planning to setup a new cluster then we will suggest you to go with the latest version of Ambari (2.6.1) https://docs.hortonworks.com/HDPDocuments/Ambari/Ambari-2.6.1.0/index.html HDP 2.6.4 (Or 2.6.3). https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/index.html .
... View more
01-14-2018
03:13 PM
@Jay about HDP 2.6.4 , can we also download this version by curl?
... View more
01-10-2018
02:28 PM
well done Jay you are the best
... View more