Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Install problems with HDP 2.6

avatar
Expert Contributor

Hi. I am at the install stage for my HDP2.6 cluster, for Ubuntu14 and Ambari 2.5.0.3. My master node fails with:

E: Unable to locate package accumulo-2-4-2-0-258

My s1 node fails (warning):

E: Unable to locate package hdp-select
2017-05-11 19:34:05,196 - Failed to install package hdp-select. Executing '/usr/bin/apt-get update -qq'
2017-05-11 19:34:47,796 - Retrying to install package hdp-select after 30 seconds
Command aborted. Reason: 'Server considered task failed and automatically aborted it'

My s2 node fails (warning):

2017-05-11 19:33:59,355 - Installing package hadoop-2-6-0-3-8-client ('/usr/bin/apt-get -q -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hadoop-2-6-0-3-8-client')
Command aborted. Reason: 'Server considered task failed and automatically aborted it'

My s2 node fails (warning):

2017-05-11 19:34:06,067 - Installing package accumulo-2-6-0-3-8 ('/usr/bin/apt-get -q -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install accumulo-2-6-0-3-8')
Command aborted. Reason: 'Server considered task failed and automatically aborted it'

These are all the first install tasks.

Are these related? How might I fix them?

TIA!

UPDATE:

I am now getting

An internal system exception occurred: Base url http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.6.0.3 is already defined for another repository version. Setting up base urls that contain the same versions of components will cause stack upgrade to fail.

error. I have not changed anything since my original post except install tree.

19 REPLIES 19

avatar
Rising Star

Which repository are you currently using, while try to install ?

HDP, OS ?

output :

yum repolist

also provide the full log it will help to analyze as quick as possible...

avatar
Expert Contributor

@Palanivelrajan Chellakutty Thanks, my log is here (I tried again just now, so the entries at the end 12/5/17 would be teh correct ones). I am using Ubuntu14, HDP2.6, how do I check which repos I am using for the install?

avatar
Rising Star

I need the ambari-server.log to analyze this issues.

avatar
Expert Contributor

@Peter Kim Thanks, my log is here (I tried again just now, so the entries at the end 12/5/17 would be the correct ones).

avatar
Master Guru

Something is wrong with your repositories, or with your Internet connection if you use repos on the Internet. Try to install just one of those packages directly from the command line, apt-get will show you more detailed error than Ambari, and then try to fix whatever is needed until apt-get install works, for example

$ apt-get install hadoop-2-6-0-3-8-client

Prepend "sudo" if needed. Also try to install a package unrelated to Hadoop like "tree": "sudo apt-get install tree". After both commands work, you can go back to Ambari and try to re-install the cluster.

avatar
Expert Contributor

If I do apt-get install hadoop-2-6-0-3-8-client it seems to be OK. I do not answer yes so as to not mess things up. tree installed OK. i have just noticed my cluster connection keeps dropping, could this be the problem?

avatar
Rising Star

ambari-server log

----------------------------------

08:56:15,539 INFO [Stack Version Loading Thread] LatestRepoCallable:219 - Stack HDP-2.3 cannot resolve OS debian6 to the supported ones: suse11,redhat7,debian7,redhat6,ubuntu14,ubuntu12. Family: null 07 May 2017 08:56:15,676 INFO [Stack Version Loading Thread] LatestRepoCallable:80 - Loading latest URL info for stack HDP-2.4 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json 07 May 2017 08:56:15,761 INFO [Stack Version Loading Thread] LatestRepoCallable:219 - Stack HDP-2.4 cannot resolve OS debian6 to the supported ones: suse11,redhat7,debian7,redhat6,ubuntu14,ubuntu12. Family: null 07 May 2017 08:56:15,893 INFO [Stack Version Loading Thread] LatestRepoCallable:80 - Loading latest URL info for stack HDP-2.5 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json 07 May 2017 08:56:16,039 ERROR [main] ClusterImpl:465 - Can not get service info: stackName=HDP, stackVersion=2.4, serviceName=ZEPPELIN 07 May 2017 08:56:16,473 WARN [Stack Version Loading Thread] LatestRepoCallable:237 - Could not load version definition for HDP-2.5 identified by http://public-repo-1.hortonworks.com/HDP/ubuntu16/2.x/updates/2.5.3.0/HDP-2.5.3.0-37.xml. http://public-repo-1.hortonworks.com/HDP/ubuntu16/2.x/updates/2.5.3.0/HDP-2.5.3.0-37.xml java.io.FileNotFoundException: http://public-repo-1.hortonworks.com/HDP/ubuntu16/2.x/updates/2.5.3.0/HDP-2.5.3.0-37.xml at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1872) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) at java.net.URL.openStream(URL.java:1045) at org.apache.ambari.server.state.repository.VersionDefinitionXml.load(VersionDefinitionXml.java:298) at org.apache.ambari.server.state.stack.LatestRepoCallable.mergeDefinitions

================================

-current repo settings set for public url.

you can find the repo file here ...../etc/yum.repos.d/

==> Need below output, to review all basic settings in place...

cat <ambari repo file>

cat <HDP repo files>

yum repolist

avatar
Rising Star

your current repo file looking into below public url below, no longer available in HDP repo directory.

http://public-repo-1.hortonworks.com/HDP/ubuntu16/2.x/updates/2.5.3.0/HDP-2.5.3.0-37.xml

Below are the HDP latest version available for ubuntu16 OS...Please go ahead and update your repo file below HDP version it will work.

HDP/ubuntu16/2.x/updates/

Parent Directory

(To Move Back To Repository)

2.5.5.0

2.6.0.3

avatar
Rising Star

Please go ahead below, since your are using "ubuntu14 OS", modify/replace your repofile ubuntu14 instead of ubuntu16.

http://public-repo-1.hortonworks.com/HDP/ubuntu14/2.x/updates/2.5.3.0/HDP-2.5.3.0-37.xml

HDP/ubuntu14/2.x/updates/2.5.3.0/ Parent Directory (To Move Back To Repository) HDP-2.5.3.0-37.xml HDP-2.5.3.0-ubuntu14-deb.tar.gz HDP-2.5.3.0-ubuntu14-deb.tar.gz.asc HDP-2.5.3.0-ubuntu14-deb.tar.gz.md5 HDP-2.5.3.0-ubuntu14-m2-artifacts.tar HDP-2.5.3.0-ubuntu14-tars-tarball.tar.gz HDP-2.5.3.0-ubuntu14-tars-tarball.tar.gz.asc HDP-2.5.3.0-ubuntu14-tars-tarball.tar.gz.md5 build.id build_metadata.txt db dists hdp.list pool relocatable slider-app-packages tars