Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

upgrade HDP 2.5.3 to hdp 2.6.3.xxx

upgrade HDP 2.5.3 to hdp 2.6.3.xxx

Explorer

Thanks in Advance

I am trying to upgrade hdp 2.5.3 to 2.6.3 via ambrai. (1- masater and 2 DNs)

created local repo.

updated version file (HDP-2.6.3.0-235.xml) from the repo list and browsed into ambari version tab.

updated local repo path with respect to OS version and hit on install button. packages are pushed to master node but getting error on both the data node as error mentioned below . kindly any one help on this issue.

Thanks,

kant

ERROR with transaction check vs depsolve:
hdp-select >= 2.6.4.0-91 is needed by (installed) shc_2_6_4_0_91-1.1.0.2.6.4.0-91.noarch
** Found 2 pre-existing rpmdb problem(s), 'yum check' output follows:
libdb-5.3.21-21.el7_4.x86_64 is a duplicate with libdb-5.3.21-20.el7.x86_64
shc_2_6_4_0_91-1.1.0.2.6.4.0-91.noarch has missing requires of hdp-select >= ('0', '2.6.4.0', '91')
Your transaction was saved, rerun it with:
 yum load-transaction /tmp/yum_save_tx.2018-04-16.10-01.4oTlyk.yumtx
2018-04-16 10:01:40,333 - checked_call[['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']] {'sudo': True}
2018-04-16 10:01:42,425 - Could not install packages. Error: Execution of '/usr/bin/yum -d 0 -e 0 check dependencies' returned 1. Error: check ['dependencies']
shc_2_6_4_0_91-1.1.0.2.6.4.0-91.noarch has missing requires of hdp-select >= ('0', '2.6.4.0', '91')
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 168, in actionexecute
    ret_code = self.install_packages(package_list)
  File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 409, in install_packages
    elif not verifyDependencies():
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/packages_analyzer.py", line 311, in verifyDependencies
    code, out = rmf_shell.checked_call(cmd, sudo=True)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 check dependencies' returned 1. Error: check ['dependencies']
shc_2_6_4_0_91-1.1.0.2.6.4.0-91.noarch has missing requires of hdp-select >= ('0', '2.6.4.0', '91')


DN2:

ERROR with transaction check vs depsolve:
hdp-select >= 2.6.4.0-91 is needed by (installed) pig_2_6_4_0_91-0.16.0.2.6.4.0-91.noarch
hdp-select >= 2.6.4.0-91 is needed by (installed) tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch
** Found 10 pre-existing rpmdb problem(s), 'yum check' output follows:
glibc-2.17-196.el7_4.2.x86_64 is a duplicate with glibc-2.17-196.el7.x86_64
glibc-common-2.17-196.el7_4.2.x86_64 is a duplicate with glibc-common-2.17-196.el7.x86_64
libdb-5.3.21-21.el7_4.x86_64 is a duplicate with libdb-5.3.21-20.el7.x86_64
pig_2_6_4_0_91-0.16.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91-client
pig_2_6_4_0_91-0.16.0.2.6.4.0-91.noarch has missing requires of hdp-select >= ('0', '2.6.4.0', '91')
tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91
tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91-hdfs
tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91-mapreduce
tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91-yarn
tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hdp-select >= ('0', '2.6.4.0', '91')
Your transaction was saved, rerun it with:
 yum load-transaction /tmp/yum_save_tx.2018-04-12.08-26.99xfvr.yumtx
5 REPLIES 5

Re: upgrade HDP 2.5.3 to hdp 2.6.3.xxx

@Kant T You said upgrade is from HDP 2.5.3 to hdp 2.6.3.xxx however the output/error shows 2.6.4.0-91.

Anyways, Check if

yum check dependencies --> shouldn't get any errors in all the nodes. 
hdp-select --> output should have the same version selected for all the services in all the nodes.

Re: upgrade HDP 2.5.3 to hdp 2.6.3.xxx

Explorer

Thanks sandeep,

DN1: dependency check error

:sudo yum check dependencies Loaded plugins: langpacks, product-id, search-disabled-repos shc_2_6_4_0_91-1.1.0.2.6.4.0-91.noarch has missing requires of hdp-select >= ('0', '2.6.4.0', '91') Error: check ['dependencies']

DN2: dependency check error:

sudo yum check dependencies Loaded plugins: langpacks, product-id, search-disabled-repos pig_2_6_4_0_91-0.16.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91-client pig_2_6_4_0_91-0.16.0.2.6.4.0-91.noarch has missing requires of hdp-select >= ('0', '2.6.4.0', '91') tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91 tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91-hdfs tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91-mapreduce tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hadoop_2_6_4_0_91-yarn tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch has missing requires of hdp-select >= ('0', '2.6.4.0', '91') Error: check ['dependencies']

hdp-select - output for DNs

accumulo-client - None accumulo-gc - None accumulo-master - None accumulo-monitor - None accumulo-tablet - None accumulo-tracer - None atlas-client - 2.5.3.0-37 atlas-server - 2.5.3.0-37 falcon-client - None falcon-server - None flume-server - None hadoop-client - 2.5.3.0-37 hadoop-hdfs-datanode - 2.5.3.0-37 hadoop-hdfs-journalnode - 2.5.3.0-37 hadoop-hdfs-namenode - 2.5.3.0-37 hadoop-hdfs-nfs3 - 2.5.3.0-37 hadoop-hdfs-portmap - 2.5.3.0-37 hadoop-hdfs-secondarynamenode - 2.5.3.0-37 hadoop-hdfs-zkfc - 2.5.3.0-37 hadoop-httpfs - None hadoop-mapreduce-historyserver - 2.5.3.0-37 hadoop-yarn-nodemanager - 2.5.3.0-37 hadoop-yarn-resourcemanager - 2.5.3.0-37 hadoop-yarn-timelineserver - 2.5.3.0-37 hbase-client - 2.5.3.0-37 hbase-master - 2.5.3.0-37 hbase-regionserver - 2.5.3.0-37 hive-metastore - 2.5.3.0-37 hive-server2 - 2.5.3.0-37 hive-server2-hive2 - 2.5.3.0-37 hive-webhcat - 2.5.3.0-37 kafka-broker - 2.5.3.0-37 knox-server - None livy-server - 2.5.3.0-37 mahout-client - None oozie-client - None oozie-server - None phoenix-client - 2.5.3.0-37 phoenix-server - 2.5.3.0-37 ranger-admin - None ranger-kms - None ranger-tagsync - None ranger-usersync - None slider-client - None spark-client - 2.5.3.0-37 spark-historyserver - 2.5.3.0-37 spark-thriftserver - 2.5.3.0-37 spark2-client - 2.5.3.0-37 spark2-historyserver - 2.5.3.0-37 spark2-thriftserver - 2.5.3.0-37 sqoop-client - 2.5.3.0-37 sqoop-server - 2.5.3.0-37 storm-client - None storm-nimbus - None storm-slider-client - None storm-supervisor - None zeppelin-server - 2.5.3.0-37 zookeeper-client - 2.5.3.0-37 zookeeper-server - 2.5.3.0-37

hdp-select - output of NN - bit diff i will paste only diff lines here - only 3 entry are looks higher version.

shc - 2.6.3.0-235

livy2-client - 2.6.3.0-235

livy2-server - 2.6.3.0-235

kindly suggest me how to proceed now. shall down grade on NN (hdp-select ) or upgrade DN (hdp-select) manully. i dont have internet on my nodes. can you suggest link or steps to dwongrade/upgrade hdp-select

Thanks,

kant

Re: upgrade HDP 2.5.3 to hdp 2.6.3.xxx

Looks like you have installed the rpms of a different version(2.6.4) and you'd need to remove them.

DN1 - yum remove shc_2_6_4_0_91-1.1.0.2.6.4.0-91.noarch

DN2 - yum remove pig_2_6_4_0_91-0.16.0.2.6.4.0-91.noarch tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch

NN - hdp-select set all 2.5.3.0-37

Re: upgrade HDP 2.5.3 to hdp 2.6.3.xxx

Explorer

Thank you very much sandeep,

I have checked as you said rpm -qa | grep tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch

tez_2_6_4_0_91-0.7.0.2.6.4.0-91.noarch

its insatllled diff rpm. as of now some use cases are going on my cluster i will follow your suggestion and update

===================================================thanks

Re: upgrade HDP 2.5.3 to hdp 2.6.3.xxx

Explorer

Thanks sandeep your suggest works well. we can close this.

Don't have an account?
Coming from Hortonworks? Activate your account here