Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2507 | 04-27-2020 03:48 AM | |
| 4974 | 04-26-2020 06:18 PM | |
| 4056 | 04-26-2020 06:05 PM | |
| 3287 | 04-13-2020 08:53 PM | |
| 5013 | 03-31-2020 02:10 AM |
03-08-2018
12:58 PM
Accepted this answer. More about that below
... View more
03-01-2018
09:34 AM
how to use - "Incognito Mode" , and what is prefer to use - CRHOM or explorer browezer ?
... View more
03-01-2018
03:04 AM
@Michael Bronson When we try to register a new version from ambari UI then on the mentioned page ambari makes the following API call to determine which one is the latest minor release of the selected stack: # curl -i -u admin:admin -H "X-Requested-By: ambari" -X GET http://amb25101.example.com:8080/api/v1/stacks/HDP/versions/2.6/operating_systems/redhat7/repositories/HDP-2.6 That way ambari knows which is the "latest_base_url" for the selected stack: {
"href" : "http://amb25101.example.com:8080/api/v1/stacks/HDP/versions/2.6/operating_systems/redhat7/repositories/HDP-2.6",
"Repositories" : {
"base_url" : "http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0",
"default_base_url" : "http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3",
"latest_base_url" : "http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.4.0",
"mirrors_list" : null,
"os_type" : "redhat7",
"repo_id" : "HDP-2.6",
"repo_name" : "HDP",
"stack_name" : "HDP",
"stack_version" : "2.6",
"unique" : false
}
} Like in this case it knows: http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.4.0 So if you do not see this info because you do not have the Internet access. So you will need to configure a local HDP repo and make it available in ambari. You will than need to provide the HDP and HDP-UTILS local repo location in the below text boxes. .
... View more
02-27-2018
01:07 PM
1 Kudo
@Michael Bronson Yes, service checks can still fail even after successful restart of yarn service. This is because the YARN service checks runs some jobs like following which might fail due to some memory issues (even though RM and NM might be running fine) Example: # yarn org.apache.hadoop.yarn.applications.distributedshell.Client -shell_command ls -num_containers 1 -jar /usr/hdp/current/hadoop-yarn-client/hadoop-yarn-applications-distributedshell.jar -timeout 300000 --queue default . So if service check is failijng then we should check the logs to find out why it failed, we might see some errors on the YARN logs indicating memory issue or container creation related issues or something else.
... View more
02-28-2018
12:31 AM
I think I found the answer. The dfs.datanode.dir was found inconsistent as I saw it from the logs. I added a healthy datanode, balanced the cluster then deleted the data direcories from the other inconsistent nodes after taking a backup at /tmp. Restarting after that works fine now.
... View more
02-26-2018
10:32 PM
3 Kudos
@Michael Bronson Looks like due to some reason at yum level the "hadoop_" packages of 2.6.4.0-91 was not installed properly. You might want to try manually installing the "2.6.4.0-91" version of package on your own like following (please make sure that you are specifying the version in the below command as "2_6_4_0_91" ) # yum remove hadoop_2_6_4_0_91* zookeeper_2_6_4_0_91* . Also please perform a yum clean all and check if there are any pending old transactions present on the host? If Yes, then please clear then as mentioned in : https://community.hortonworks.com/questions/175762/how-to-resolve-incomplete-yum-transactions-when-pe.html?childToView=175766#comment-175766 . After that you can try from ambari UI.
... View more
02-26-2018
02:10 PM
now we install again ( re-install ) , from ambari GUI ( upgrade ) but we get now the following down its very strange because we set in the ambari GUI the repo for HDP , SDP-GPL and HDP-UTILS and also the 3 repo also exists on each machine what is unclear is that when we try to install the pkg on the machine /usr/bin/yum -d 0 -e 0 -y install '--disablerepo=*' --enablerepo=HDP-2.6-GPL-repo-53,HDP-2.6-repo-53,HDP-UTILS-1.1.0.22-repo-53 hdp-select
Package hdp-select-2.6.4.0-91.noarch already installed and latest version then its tell us that pkg already exists but from the log seems that he not found the pkg - hdp-select how it can be? <br>2018-02-26 13:59:25,315 - Will install packages for repository version 2.6.4.0
2018-02-26 13:59:25,316 - Repository['HDP-2.6-repo-53'] {'append_to_file': False, 'base_url': 'http://98.45.232.167/HDP/centos7/2.6.4.0-91', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-53', 'mirror_list': None}
2018-02-26 13:59:25,333 - File['/etc/yum.repos.d/ambari-hdp-53.repo'] {'content': '[HDP-2.6-repo-53]\nname=HDP-2.6-repo-53\nbaseurl=http://98.45.232.167/HDP/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-02-26 13:59:25,334 - Writing File['/etc/yum.repos.d/ambari-hdp-53.repo'] because contents don't match
2018-02-26 13:59:25,335 - Repository['HDP-2.6-GPL-repo-53'] {'append_to_file': True, 'base_url': 'http://98.45.232.167/HDP-GPL/centos7/2.6.4.0-91', 'action': ['create'], 'components': [u'HDP-GPL', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-53', 'mirror_list': None}
2018-02-26 13:59:25,343 - File['/etc/yum.repos.d/ambari-hdp-53.repo'] {'content': '[HDP-2.6-repo-53]\nname=HDP-2.6-repo-53\nbaseurl=http://98.45.232.167/HDP/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-2.6-GPL-repo-53]\nname=HDP-2.6-GPL-repo-53\nbaseurl=http://98.45.232.167/HDP-GPL/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-02-26 13:59:25,343 - Writing File['/etc/yum.repos.d/ambari-hdp-53.repo'] because contents don't match
2018-02-26 13:59:25,344 - Repository['HDP-UTILS-1.1.0.22-repo-53'] {'append_to_file': True, 'base_url': 'http://98.45.232.167/', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-53', 'mirror_list': None}
2018-02-26 13:59:25,352 - File['/etc/yum.repos.d/ambari-hdp-53.repo'] {'content': '[HDP-2.6-repo-53]\nname=HDP-2.6-repo-53\nbaseurl=http://98.45.232.167/HDP/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-2.6-GPL-repo-53]\nname=HDP-2.6-GPL-repo-53\nbaseurl=http://98.45.232.167/HDP-GPL/centos7/2.6.4.0-91\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.22-repo-53]\nname=HDP-UTILS-1.1.0.22-repo-53\nbaseurl=http://98.45.232.167/\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-02-26 13:59:25,353 - Writing File['/etc/yum.repos.d/ambari-hdp-53.repo'] because contents don't match
2018-02-26 13:59:25,354 - Yum non-completed transactions check passed
2018-02-26 13:59:25,354 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2018-02-26 13:59:25,426 - call returned (0, '2.6.0.3-8\n2.6.4.0-91')
2018-02-26 13:59:25,427 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5, 'use_repos': {u'HDP-2.6-repo-53': u'ambari-hdp-53', u'HDP-2.6-GPL-repo-53': u'ambari-hdp-53', u'HDP-UTILS-1.1.0.22-repo-53': u'ambari-hdp-53'}, 'action': ['upgrade']}
2018-02-26 13:59:25,428 - Installing package hdp-select ('/usr/bin/yum -d 0 -e 0 -y install '--disablerepo=*' --enablerepo=HDP-2.6-GPL-repo-53,HDP-2.6-repo-53,HDP-UTILS-1.1.0.22-repo-53 hdp-select')
2018-02-26 13:59:27,565 - Looking for matching packages in the following repositories: HDP-2.6-repo-53, HDP-2.6-GPL-repo-53, HDP-UTILS-1.1.0.22-repo-53
2018-02-26 13:59:35,337 - No package found for hadoop_${stack_version}(hadoop_(\d|_)+$)<br>
<br>
... View more
02-26-2018
11:10 PM
@Amira khalifa As this issue is resolved and it was because of the classname issue of the driver class, hence can you please mark this HCC thread as Answered by clicking on the "Accept" button that way the mentioned troubleshooting steps can be useful for other HCC users to quickly find/troubleshoot the issue when they see similar issue.
... View more
10-31-2018
12:02 PM
i have followed the steps but after changing restart zeppeline i am getting below error:- help me to resolve HTTP ERROR: 503 Problem accessing /. Reason: Service Unavailable
... View more
02-25-2018
09:14 PM
Sorry sometime not read completely come up an issue 😞 works seamlessly.!
... View more