Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2001 | 06-15-2020 05:23 AM | |
| 16478 | 01-30-2020 08:04 PM | |
| 2149 | 07-07-2019 09:06 PM | |
| 8354 | 01-27-2018 10:17 PM | |
| 4739 | 12-31-2017 10:12 PM |
03-05-2018
05:22 PM
1 Kudo
@Michael Bronson, url should be "http://master02.sys56.com:8080/api/v1/clusters/hdp/requests" not "http://master02.sys56.com:8080/api/v1/clusters/hdp/request". 's' is missing in requests. Thanks, Aditya
... View more
03-01-2018
09:34 AM
how to use - "Incognito Mode" , and what is prefer to use - CRHOM or explorer browezer ?
... View more
03-01-2018
03:04 AM
@Michael Bronson When we try to register a new version from ambari UI then on the mentioned page ambari makes the following API call to determine which one is the latest minor release of the selected stack: # curl -i -u admin:admin -H "X-Requested-By: ambari" -X GET http://amb25101.example.com:8080/api/v1/stacks/HDP/versions/2.6/operating_systems/redhat7/repositories/HDP-2.6 That way ambari knows which is the "latest_base_url" for the selected stack: {
"href" : "http://amb25101.example.com:8080/api/v1/stacks/HDP/versions/2.6/operating_systems/redhat7/repositories/HDP-2.6",
"Repositories" : {
"base_url" : "http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0",
"default_base_url" : "http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3",
"latest_base_url" : "http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.4.0",
"mirrors_list" : null,
"os_type" : "redhat7",
"repo_id" : "HDP-2.6",
"repo_name" : "HDP",
"stack_name" : "HDP",
"stack_version" : "2.6",
"unique" : false
}
} Like in this case it knows: http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.4.0 So if you do not see this info because you do not have the Internet access. So you will need to configure a local HDP repo and make it available in ambari. You will than need to provide the HDP and HDP-UTILS local repo location in the below text boxes. .
... View more
02-27-2018
01:07 PM
1 Kudo
@Michael Bronson Yes, service checks can still fail even after successful restart of yarn service. This is because the YARN service checks runs some jobs like following which might fail due to some memory issues (even though RM and NM might be running fine) Example: # yarn org.apache.hadoop.yarn.applications.distributedshell.Client -shell_command ls -num_containers 1 -jar /usr/hdp/current/hadoop-yarn-client/hadoop-yarn-applications-distributedshell.jar -timeout 300000 --queue default . So if service check is failijng then we should check the logs to find out why it failed, we might see some errors on the YARN logs indicating memory issue or container creation related issues or something else.
... View more
02-27-2018
01:06 PM
@Jay thank you so much
... View more
02-26-2018
10:32 PM
3 Kudos
@Michael Bronson Looks like due to some reason at yum level the "hadoop_" packages of 2.6.4.0-91 was not installed properly. You might want to try manually installing the "2.6.4.0-91" version of package on your own like following (please make sure that you are specifying the version in the below command as "2_6_4_0_91" ) # yum remove hadoop_2_6_4_0_91* zookeeper_2_6_4_0_91* . Also please perform a yum clean all and check if there are any pending old transactions present on the host? If Yes, then please clear then as mentioned in : https://community.hortonworks.com/questions/175762/how-to-resolve-incomplete-yum-transactions-when-pe.html?childToView=175766#comment-175766 . After that you can try from ambari UI.
... View more
02-26-2018
02:10 PM
now we install again ( re-install ) , from ambari GUI ( upgrade ) but we get now the following down its very strange because we set in the ambari GUI the repo for HDP , SDP-GPL and HDP-UTILS and also the 3 repo also exists on each machine what is unclear is that when we try to install the pkg on the machine /usr/bin/yum -d 0 -e 0 -y install '--disablerepo=*' --enablerepo=HDP-2.6-GPL-repo-53,HDP-2.6-repo-53,HDP-UTILS-1.1.0.22-repo-53 hdp-select
Package hdp-select-2.6.4.0-91.noarch already installed and latest version then its tell us that pkg already exists but from the log seems that he not found the pkg - hdp-select how it can be? <br>2018-02-26 13:59:25,315 - Will install packages for repository version 2.6.4.0
2018-02-26 13:59:25,316 - Repository['HDP-2.6-repo-53'] {'append_to_file': False, 'base_url': 'http://98.45.232.167/HDP/centos7/2.6.4.0-91', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-53', 'mirror_list': None}
2018-02-26 13:59:25,333 - File['/etc/yum.repos.d/ambari-hdp-53.repo'] {'content': '[HDP-2.6-repo-53]\nname=HDP-2.6-repo-53\nbaseurl=http://98.45.232.167/HDP/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-02-26 13:59:25,334 - Writing File['/etc/yum.repos.d/ambari-hdp-53.repo'] because contents don't match
2018-02-26 13:59:25,335 - Repository['HDP-2.6-GPL-repo-53'] {'append_to_file': True, 'base_url': 'http://98.45.232.167/HDP-GPL/centos7/2.6.4.0-91', 'action': ['create'], 'components': [u'HDP-GPL', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-53', 'mirror_list': None}
2018-02-26 13:59:25,343 - File['/etc/yum.repos.d/ambari-hdp-53.repo'] {'content': '[HDP-2.6-repo-53]\nname=HDP-2.6-repo-53\nbaseurl=http://98.45.232.167/HDP/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-2.6-GPL-repo-53]\nname=HDP-2.6-GPL-repo-53\nbaseurl=http://98.45.232.167/HDP-GPL/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-02-26 13:59:25,343 - Writing File['/etc/yum.repos.d/ambari-hdp-53.repo'] because contents don't match
2018-02-26 13:59:25,344 - Repository['HDP-UTILS-1.1.0.22-repo-53'] {'append_to_file': True, 'base_url': 'http://98.45.232.167/', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-53', 'mirror_list': None}
2018-02-26 13:59:25,352 - File['/etc/yum.repos.d/ambari-hdp-53.repo'] {'content': '[HDP-2.6-repo-53]\nname=HDP-2.6-repo-53\nbaseurl=http://98.45.232.167/HDP/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-2.6-GPL-repo-53]\nname=HDP-2.6-GPL-repo-53\nbaseurl=http://98.45.232.167/HDP-GPL/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.22-repo-53]\nname=HDP-UTILS-1.1.0.22-repo-53\nbaseurl=http://98.45.232.167/\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-02-26 13:59:25,353 - Writing File['/etc/yum.repos.d/ambari-hdp-53.repo'] because contents don't match
2018-02-26 13:59:25,354 - Yum non-completed transactions check passed
2018-02-26 13:59:25,354 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2018-02-26 13:59:25,426 - call returned (0, '2.6.0.3-8\n2.6.4.0-91')
2018-02-26 13:59:25,427 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5, 'use_repos': {u'HDP-2.6-repo-53': u'ambari-hdp-53', u'HDP-2.6-GPL-repo-53': u'ambari-hdp-53', u'HDP-UTILS-1.1.0.22-repo-53': u'ambari-hdp-53'}, 'action': ['upgrade']}
2018-02-26 13:59:25,428 - Installing package hdp-select ('/usr/bin/yum -d 0 -e 0 -y install '--disablerepo=*' --enablerepo=HDP-2.6-GPL-repo-53,HDP-2.6-repo-53,HDP-UTILS-1.1.0.22-repo-53 hdp-select')
2018-02-26 13:59:27,565 - Looking for matching packages in the following repositories: HDP-2.6-repo-53, HDP-2.6-GPL-repo-53, HDP-UTILS-1.1.0.22-repo-53
2018-02-26 13:59:35,337 - No package found for hadoop_${stack_version}(hadoop_(\d|_)+$)<br>
<br>
... View more
02-26-2018
10:32 AM
1 Kudo
@Michael Bronson, From HDP 2.6.4, HDP-UTILS will not include GPL licensed packages. While doing ambari server setup, if you have selected 'yes' while Reviewing the GPL license agreement, then you will have HDP-2.6-GPL repo will have lzo packages which are GPL licensed. Thanks, Aditya
... View more
03-14-2018
07:37 AM
@Michael Bronson Thank you for appreciation and i apologies for making this thread a bit confusing in few of my previous update 😉
... View more
03-06-2018
05:02 AM
@Michael Bronson The following link explains how to set the MTU value and how to deter mine it's value based on our network devices standards. https://www.tp-link.com/us/article/?faqid=190
... View more