Support Questions

Find answers, ask questions, and share your expertise

HDP Upgradation not able to complete

avatar
Explorer

We're trying for HDP upgrdation from 3.1.5.0-152 to 3.1.5.6189-1.

As we're having four nodes cluster, in two nodes the upgradation part completed, but in other it's failing. Please provide some solutions. 

Background operations log:

Error getting repository data for HDP-3.1-GPL-repo-51, repository not found

2022-03-09 11:09:07,436 - Installing package sqoop_3_1_5_6189_1 ('/usr/bin/yum -y install sqoop_3_1_5_6189_1')
2022-03-09 11:09:11,891 - Installing package hadoop_3_1_5_6189_1 ('/usr/bin/yum -y install hadoop_3_1_5_6189_1')
2022-03-09 11:09:16,296 - Installing package hadoop_3_1_5_6189_1-client ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-client')
2022-03-09 11:09:21,000 - Installing package snappy ('/usr/bin/yum -y install snappy')
2022-03-09 11:09:25,451 - Installing package snappy-devel ('/usr/bin/yum -y install snappy-devel')
2022-03-09 11:09:30,161 - Installing package hadoop_3_1_5_6189_1-libhdfs ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-libhdfs')
2022-03-09 11:09:34,700 - Installing package hadoop_3_1_5_6189_1-mapreduce ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-mapreduce')
2022-03-09 11:09:39,253 - Installing package tez_3_1_5_6189_1 ('/usr/bin/yum -y install tez_3_1_5_6189_1')
2022-03-09 11:09:43,573 - Installing package hbase_3_1_5_6189_1 ('/usr/bin/yum -y install hbase_3_1_5_6189_1')
2022-03-09 11:09:47,954 - Installing package phoenix_3_1_5_6189_1 ('/usr/bin/yum -y install phoenix_3_1_5_6189_1')
2022-03-09 11:09:52,508 - Installing package zookeeper_3_1_5_6189_1 ('/usr/bin/yum -y install zookeeper_3_1_5_6189_1')
2022-03-09 11:09:56,954 - Installing package zookeeper_3_1_5_6189_1-server ('/usr/bin/yum -y install zookeeper_3_1_5_6189_1-server')
2022-03-09 11:10:01,531 - Installing package hadoop_3_1_5_6189_1-yarn ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-yarn')
2022-03-09 11:10:06,154 - Installing package hadoop_3_1_5_6189_1-mapreduce ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-mapreduce')
2022-03-09 11:10:10,810 - Installing package hadoop_3_1_5_6189_1-hdfs ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-hdfs')
2022-03-09 11:10:15,337 - Installing package atlas-metadata_3_1_5_6189_1 ('/usr/bin/yum -y install atlas-metadata_3_1_5_6189_1')
2022-03-09 11:10:19,867 - Installing package ambari-infra-solr-client ('/usr/bin/yum -y install ambari-infra-solr-client')
2022-03-09 11:10:24,416 - Installing package kafka_3_1_5_6189_1 ('/usr/bin/yum -y install kafka_3_1_5_6189_1')
2022-03-09 11:10:28,869 - Installing package hive_3_1_5_6189_1 ('/usr/bin/yum -y install hive_3_1_5_6189_1')
2022-03-09 11:10:33,271 - Installing package hive_3_1_5_6189_1-hcatalog ('/usr/bin/yum -y install hive_3_1_5_6189_1-hcatalog')
2022-03-09 11:10:37,878 - Installing package gcc ('/usr/bin/yum -y install gcc')
2022-03-09 11:10:42,314 - Installing package python-kerberos ('/usr/bin/yum -y install python-kerberos')
2022-03-09 11:10:46,957 - Installing package kafka_3_1_5_6189_1 ('/usr/bin/yum -y install kafka_3_1_5_6189_1')
2022-03-09 11:10:52,037 - Installing package spark2_3_1_5_6189_1 ('/usr/bin/yum -y install spark2_3_1_5_6189_1')
2022-03-09 11:10:56,414 - Installing package spark2_3_1_5_6189_1-python ('/usr/bin/yum -y install spark2_3_1_5_6189_1-python')
2022-03-09 11:11:01,002 - Installing package livy2_3_1_5_6189_1 ('/usr/bin/yum -y install livy2_3_1_5_6189_1')
2022-03-09 11:11:05,356 - Installing package spark-atlas-connector_3_1_5_6189_1 ('/usr/bin/yum -y install spark-atlas-connector_3_1_5_6189_1')
2022-03-09 11:11:15,064 - Failed to verify package dependencies. Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. hadoop_3_1_5_0_152-yarn-3.1.1.3.1.5.0-152.x86_64 has missing requires of hbase_3_1_5_0_152
phoenix_3_1_5_0_152-5.0.0.3.1.5.0-152.noarch has missing requires of hbase_3_1_5_0_152
spark2_3_1_5_0_152-2.3.2.3.1.5.0-152.noarch has missing requires of hive_3_1_5_0_152
Loaded plugins: langpacks, product-id, subscription-manager
2022-03-09 11:11:15,064 - Failure while verifying dependencies
2022-03-09 11:11:15,064 - *******************************************************************************
2022-03-09 11:11:15,064 - Manually verify and fix package dependencies and then re-run install_packages
2022-03-09 11:11:15,064 - *******************************************************************************
2022-03-09 11:11:15,064 - Installation of packages failed. Checking if installation was partially complete
2022-03-09 11:11:15,064 - Old versions: ['3.1.5.0-152', '3.1.5.6189-1']
2022-03-09 11:11:15,065 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2022-03-09 11:11:15,093 - call returned (0, '3.1.5.0-152\n3.1.5.6189-1')
2022-03-09 11:11:15,093 - New versions: ['3.1.5.0-152', '3.1.5.6189-1']
2022-03-09 11:11:15,093 - Deltas: set([])

Command failed after 1 tries

Another node log:

Error getting repository data for HDP-3.1-GPL-repo-51, repository not found

2022-03-09 11:04:49,444 - Installing package atlas-metadata_3_1_5_6189_1 ('/usr/bin/yum -y install atlas-metadata_3_1_5_6189_1')
2022-03-09 11:04:53,946 - Installing package ambari-infra-solr-client ('/usr/bin/yum -y install ambari-infra-solr-client')
2022-03-09 11:04:59,400 - Installing package kafka_3_1_5_6189_1 ('/usr/bin/yum -y install kafka_3_1_5_6189_1')
2022-03-09 11:05:03,632 - Installing package hive_3_1_5_6189_1 ('/usr/bin/yum -y install hive_3_1_5_6189_1')
2022-03-09 11:05:07,908 - Installing package hive_3_1_5_6189_1-hcatalog ('/usr/bin/yum -y install hive_3_1_5_6189_1-hcatalog')
2022-03-09 11:05:12,386 - Installing package gcc ('/usr/bin/yum -y install gcc')
2022-03-09 11:05:16,610 - Installing package python-kerberos ('/usr/bin/yum -y install python-kerberos')
2022-03-09 11:05:21,068 - Installing package sqoop_3_1_5_6189_1 ('/usr/bin/yum -y install sqoop_3_1_5_6189_1')
2022-03-09 11:05:25,269 - Installing package hadoop_3_1_5_6189_1 ('/usr/bin/yum -y install hadoop_3_1_5_6189_1')
2022-03-09 11:05:29,506 - Installing package hadoop_3_1_5_6189_1-client ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-client')
2022-03-09 11:05:33,986 - Installing package snappy ('/usr/bin/yum -y install snappy')
2022-03-09 11:05:38,234 - Installing package snappy-devel ('/usr/bin/yum -y install snappy-devel')
2022-03-09 11:05:42,694 - Installing package hadoop_3_1_5_6189_1-libhdfs ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-libhdfs')
2022-03-09 11:05:47,294 - Installing package hadoop_3_1_5_6189_1-mapreduce ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-mapreduce')
2022-03-09 11:05:51,778 - Installing package tez_3_1_5_6189_1 ('/usr/bin/yum -y install tez_3_1_5_6189_1')
2022-03-09 11:05:55,969 - Installing package hbase_3_1_5_6189_1 ('/usr/bin/yum -y install hbase_3_1_5_6189_1')
2022-03-09 11:06:00,190 - Installing package phoenix_3_1_5_6189_1 ('/usr/bin/yum -y install phoenix_3_1_5_6189_1')
2022-03-09 11:06:04,414 - Installing package zookeeper_3_1_5_6189_1 ('/usr/bin/yum -y install zookeeper_3_1_5_6189_1')
2022-03-09 11:06:08,614 - Installing package zookeeper_3_1_5_6189_1-server ('/usr/bin/yum -y install zookeeper_3_1_5_6189_1-server')
2022-03-09 11:06:13,088 - Installing package spark2_3_1_5_6189_1 ('/usr/bin/yum -y install spark2_3_1_5_6189_1')
2022-03-09 11:06:17,376 - Installing package spark2_3_1_5_6189_1-python ('/usr/bin/yum -y install spark2_3_1_5_6189_1-python')
2022-03-09 11:06:21,891 - Installing package livy2_3_1_5_6189_1 ('/usr/bin/yum -y install livy2_3_1_5_6189_1')
2022-03-09 11:06:26,067 - Installing package spark-atlas-connector_3_1_5_6189_1 ('/usr/bin/yum -y install spark-atlas-connector_3_1_5_6189_1')
2022-03-09 11:06:30,537 - Installing package hadoop_3_1_5_6189_1-yarn ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-yarn')
2022-03-09 11:06:35,023 - Installing package hadoop_3_1_5_6189_1-mapreduce ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-mapreduce')
2022-03-09 11:06:39,434 - Installing package hadoop_3_1_5_6189_1-hdfs ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-hdfs')
2022-03-09 11:07:10,652 - Failed to verify package dependencies. Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. ffmpeg-3.4.7-1.el7.x86_64 has missing requires of ffmpeg-libs(x86-64) = ('0', '3.4.7', '1.el7')
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libOpenCL.so.1()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libOpenCL.so.1(OPENCL_1.0)(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libSDL2-2.0.so.0()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavcodec.so.57()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavcodec.so.57(LIBAVCODEC_57)(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavdevice.so.57()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavdevice.so.57(LIBAVDEVICE_57)(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavfilter.so.6()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavfilter.so.6(LIBAVFILTER_6)(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavformat.so.57()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavformat.so.57(LIBAVFORMAT_57)(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavresample.so.3()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavresample.so.3(LIBAVRESAMPLE_3)(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavutil.so.55()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavutil.so.55(LIBAVUTIL_55)(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libpostproc.so.54()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libpostproc.so.54(LIBPOSTPROC_54)(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libswresample.so.2()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libswresample.so.2(LIBSWRESAMPLE_2)(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libswscale.so.4()(64bit)
ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libswscale.so.4(LIBSWSCALE_4)(64bit)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-common = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-webapp = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-distcp = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-hive = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-hive2 = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-spark = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-sqoop = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-pig = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-hcatalog = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-mapreduce-streaming = ('0', '4.2.0.2.6.4.0', None)
oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib = ('0', '4.2.0.2.6.4.0', None)
2022-03-09 11:07:10,652 - Failure while verifying dependencies
2022-03-09 11:07:10,652 - *******************************************************************************
2022-03-09 11:07:10,652 - Manually verify and fix package dependencies and then re-run install_packages
2022-03-09 11:07:10,652 - *******************************************************************************
2022-03-09 11:07:10,652 - Installation of packages failed. Checking if installation was partially complete
2022-03-09 11:07:10,653 - Old versions: ['3.1.5.0-152', '3.1.5.6189-1']
2022-03-09 11:07:10,653 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2022-03-09 11:07:10,687 - call returned (0, '3.1.5.0-152\n3.1.5.6189-1')
2022-03-09 11:07:10,687 - New versions: ['3.1.5.0-152', '3.1.5.6189-1']
2022-03-09 11:07:10,687 - Deltas: set([])

Command failed after 1 tries

Please note that already disabled  HDP-GPL license in ambari.properties. 

1 ACCEPTED SOLUTION

avatar
Expert Contributor

Hi @HDP_Suja  , From the error "

Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. hadoop_3_1_5_0_152-yarn-3.1.1.3.1.5.0-152.x86_64 has missing requires of hbase_3_1_5_0_152

phoenix_3_1_5_0_152-5.0.0.3.1.5.0-152.noarch has missing requires of hbase_3_1_5_0_152" 

 

It looks like it is still pointing to the old repo. Please check for any old repo under /etc/yum.repos.d and move it to another folder and restart agent to see if it works.  Thanks

View solution in original post

2 REPLIES 2

avatar
Expert Contributor

Hi @HDP_Suja  , From the error "

Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. hadoop_3_1_5_0_152-yarn-3.1.1.3.1.5.0-152.x86_64 has missing requires of hbase_3_1_5_0_152

phoenix_3_1_5_0_152-5.0.0.3.1.5.0-152.noarch has missing requires of hbase_3_1_5_0_152" 

 

It looks like it is still pointing to the old repo. Please check for any old repo under /etc/yum.repos.d and move it to another folder and restart agent to see if it works.  Thanks

avatar
Community Manager

@HDP_Suja, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. 



Regards,

Vidya Sargur,
Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community: