Created 03-09-2022 03:08 AM
We're trying for HDP upgrdation from 3.1.5.0-152 to 3.1.5.6189-1.
As we're having four nodes cluster, in two nodes the upgradation part completed, but in other it's failing. Please provide some solutions.
Background operations log:
Error getting repository data for HDP-3.1-GPL-repo-51, repository not found 2022-03-09 11:09:07,436 - Installing package sqoop_3_1_5_6189_1 ('/usr/bin/yum -y install sqoop_3_1_5_6189_1') 2022-03-09 11:09:11,891 - Installing package hadoop_3_1_5_6189_1 ('/usr/bin/yum -y install hadoop_3_1_5_6189_1') 2022-03-09 11:09:16,296 - Installing package hadoop_3_1_5_6189_1-client ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-client') 2022-03-09 11:09:21,000 - Installing package snappy ('/usr/bin/yum -y install snappy') 2022-03-09 11:09:25,451 - Installing package snappy-devel ('/usr/bin/yum -y install snappy-devel') 2022-03-09 11:09:30,161 - Installing package hadoop_3_1_5_6189_1-libhdfs ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-libhdfs') 2022-03-09 11:09:34,700 - Installing package hadoop_3_1_5_6189_1-mapreduce ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-mapreduce') 2022-03-09 11:09:39,253 - Installing package tez_3_1_5_6189_1 ('/usr/bin/yum -y install tez_3_1_5_6189_1') 2022-03-09 11:09:43,573 - Installing package hbase_3_1_5_6189_1 ('/usr/bin/yum -y install hbase_3_1_5_6189_1') 2022-03-09 11:09:47,954 - Installing package phoenix_3_1_5_6189_1 ('/usr/bin/yum -y install phoenix_3_1_5_6189_1') 2022-03-09 11:09:52,508 - Installing package zookeeper_3_1_5_6189_1 ('/usr/bin/yum -y install zookeeper_3_1_5_6189_1') 2022-03-09 11:09:56,954 - Installing package zookeeper_3_1_5_6189_1-server ('/usr/bin/yum -y install zookeeper_3_1_5_6189_1-server') 2022-03-09 11:10:01,531 - Installing package hadoop_3_1_5_6189_1-yarn ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-yarn') 2022-03-09 11:10:06,154 - Installing package hadoop_3_1_5_6189_1-mapreduce ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-mapreduce') 2022-03-09 11:10:10,810 - Installing package hadoop_3_1_5_6189_1-hdfs ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-hdfs') 2022-03-09 11:10:15,337 - Installing package atlas-metadata_3_1_5_6189_1 ('/usr/bin/yum -y install atlas-metadata_3_1_5_6189_1') 2022-03-09 11:10:19,867 - Installing package ambari-infra-solr-client ('/usr/bin/yum -y install ambari-infra-solr-client') 2022-03-09 11:10:24,416 - Installing package kafka_3_1_5_6189_1 ('/usr/bin/yum -y install kafka_3_1_5_6189_1') 2022-03-09 11:10:28,869 - Installing package hive_3_1_5_6189_1 ('/usr/bin/yum -y install hive_3_1_5_6189_1') 2022-03-09 11:10:33,271 - Installing package hive_3_1_5_6189_1-hcatalog ('/usr/bin/yum -y install hive_3_1_5_6189_1-hcatalog') 2022-03-09 11:10:37,878 - Installing package gcc ('/usr/bin/yum -y install gcc') 2022-03-09 11:10:42,314 - Installing package python-kerberos ('/usr/bin/yum -y install python-kerberos') 2022-03-09 11:10:46,957 - Installing package kafka_3_1_5_6189_1 ('/usr/bin/yum -y install kafka_3_1_5_6189_1') 2022-03-09 11:10:52,037 - Installing package spark2_3_1_5_6189_1 ('/usr/bin/yum -y install spark2_3_1_5_6189_1') 2022-03-09 11:10:56,414 - Installing package spark2_3_1_5_6189_1-python ('/usr/bin/yum -y install spark2_3_1_5_6189_1-python') 2022-03-09 11:11:01,002 - Installing package livy2_3_1_5_6189_1 ('/usr/bin/yum -y install livy2_3_1_5_6189_1') 2022-03-09 11:11:05,356 - Installing package spark-atlas-connector_3_1_5_6189_1 ('/usr/bin/yum -y install spark-atlas-connector_3_1_5_6189_1') 2022-03-09 11:11:15,064 - Failed to verify package dependencies. Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. hadoop_3_1_5_0_152-yarn-3.1.1.3.1.5.0-152.x86_64 has missing requires of hbase_3_1_5_0_152 phoenix_3_1_5_0_152-5.0.0.3.1.5.0-152.noarch has missing requires of hbase_3_1_5_0_152 spark2_3_1_5_0_152-2.3.2.3.1.5.0-152.noarch has missing requires of hive_3_1_5_0_152 Loaded plugins: langpacks, product-id, subscription-manager 2022-03-09 11:11:15,064 - Failure while verifying dependencies 2022-03-09 11:11:15,064 - ******************************************************************************* 2022-03-09 11:11:15,064 - Manually verify and fix package dependencies and then re-run install_packages 2022-03-09 11:11:15,064 - ******************************************************************************* 2022-03-09 11:11:15,064 - Installation of packages failed. Checking if installation was partially complete 2022-03-09 11:11:15,064 - Old versions: ['3.1.5.0-152', '3.1.5.6189-1'] 2022-03-09 11:11:15,065 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {} 2022-03-09 11:11:15,093 - call returned (0, '3.1.5.0-152\n3.1.5.6189-1') 2022-03-09 11:11:15,093 - New versions: ['3.1.5.0-152', '3.1.5.6189-1'] 2022-03-09 11:11:15,093 - Deltas: set([]) Command failed after 1 tries
Another node log:
Error getting repository data for HDP-3.1-GPL-repo-51, repository not found 2022-03-09 11:04:49,444 - Installing package atlas-metadata_3_1_5_6189_1 ('/usr/bin/yum -y install atlas-metadata_3_1_5_6189_1') 2022-03-09 11:04:53,946 - Installing package ambari-infra-solr-client ('/usr/bin/yum -y install ambari-infra-solr-client') 2022-03-09 11:04:59,400 - Installing package kafka_3_1_5_6189_1 ('/usr/bin/yum -y install kafka_3_1_5_6189_1') 2022-03-09 11:05:03,632 - Installing package hive_3_1_5_6189_1 ('/usr/bin/yum -y install hive_3_1_5_6189_1') 2022-03-09 11:05:07,908 - Installing package hive_3_1_5_6189_1-hcatalog ('/usr/bin/yum -y install hive_3_1_5_6189_1-hcatalog') 2022-03-09 11:05:12,386 - Installing package gcc ('/usr/bin/yum -y install gcc') 2022-03-09 11:05:16,610 - Installing package python-kerberos ('/usr/bin/yum -y install python-kerberos') 2022-03-09 11:05:21,068 - Installing package sqoop_3_1_5_6189_1 ('/usr/bin/yum -y install sqoop_3_1_5_6189_1') 2022-03-09 11:05:25,269 - Installing package hadoop_3_1_5_6189_1 ('/usr/bin/yum -y install hadoop_3_1_5_6189_1') 2022-03-09 11:05:29,506 - Installing package hadoop_3_1_5_6189_1-client ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-client') 2022-03-09 11:05:33,986 - Installing package snappy ('/usr/bin/yum -y install snappy') 2022-03-09 11:05:38,234 - Installing package snappy-devel ('/usr/bin/yum -y install snappy-devel') 2022-03-09 11:05:42,694 - Installing package hadoop_3_1_5_6189_1-libhdfs ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-libhdfs') 2022-03-09 11:05:47,294 - Installing package hadoop_3_1_5_6189_1-mapreduce ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-mapreduce') 2022-03-09 11:05:51,778 - Installing package tez_3_1_5_6189_1 ('/usr/bin/yum -y install tez_3_1_5_6189_1') 2022-03-09 11:05:55,969 - Installing package hbase_3_1_5_6189_1 ('/usr/bin/yum -y install hbase_3_1_5_6189_1') 2022-03-09 11:06:00,190 - Installing package phoenix_3_1_5_6189_1 ('/usr/bin/yum -y install phoenix_3_1_5_6189_1') 2022-03-09 11:06:04,414 - Installing package zookeeper_3_1_5_6189_1 ('/usr/bin/yum -y install zookeeper_3_1_5_6189_1') 2022-03-09 11:06:08,614 - Installing package zookeeper_3_1_5_6189_1-server ('/usr/bin/yum -y install zookeeper_3_1_5_6189_1-server') 2022-03-09 11:06:13,088 - Installing package spark2_3_1_5_6189_1 ('/usr/bin/yum -y install spark2_3_1_5_6189_1') 2022-03-09 11:06:17,376 - Installing package spark2_3_1_5_6189_1-python ('/usr/bin/yum -y install spark2_3_1_5_6189_1-python') 2022-03-09 11:06:21,891 - Installing package livy2_3_1_5_6189_1 ('/usr/bin/yum -y install livy2_3_1_5_6189_1') 2022-03-09 11:06:26,067 - Installing package spark-atlas-connector_3_1_5_6189_1 ('/usr/bin/yum -y install spark-atlas-connector_3_1_5_6189_1') 2022-03-09 11:06:30,537 - Installing package hadoop_3_1_5_6189_1-yarn ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-yarn') 2022-03-09 11:06:35,023 - Installing package hadoop_3_1_5_6189_1-mapreduce ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-mapreduce') 2022-03-09 11:06:39,434 - Installing package hadoop_3_1_5_6189_1-hdfs ('/usr/bin/yum -y install hadoop_3_1_5_6189_1-hdfs') 2022-03-09 11:07:10,652 - Failed to verify package dependencies. Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. ffmpeg-3.4.7-1.el7.x86_64 has missing requires of ffmpeg-libs(x86-64) = ('0', '3.4.7', '1.el7') ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libOpenCL.so.1()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libOpenCL.so.1(OPENCL_1.0)(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libSDL2-2.0.so.0()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavcodec.so.57()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavcodec.so.57(LIBAVCODEC_57)(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavdevice.so.57()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavdevice.so.57(LIBAVDEVICE_57)(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavfilter.so.6()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavfilter.so.6(LIBAVFILTER_6)(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavformat.so.57()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavformat.so.57(LIBAVFORMAT_57)(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavresample.so.3()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavresample.so.3(LIBAVRESAMPLE_3)(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavutil.so.55()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libavutil.so.55(LIBAVUTIL_55)(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libpostproc.so.54()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libpostproc.so.54(LIBPOSTPROC_54)(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libswresample.so.2()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libswresample.so.2(LIBSWRESAMPLE_2)(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libswscale.so.4()(64bit) ffmpeg-3.4.7-1.el7.x86_64 has missing requires of libswscale.so.4(LIBSWSCALE_4)(64bit) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-common = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-webapp = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-distcp = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-hive = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-hive2 = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-spark = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-sqoop = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-pig = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-hcatalog = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib-mapreduce-streaming = ('0', '4.2.0.2.6.4.0', None) oozie_2_6_4_0_91-4.2.0.2.6.4.0-91.noarch has missing requires of oozie_2_6_4_0_91-sharelib = ('0', '4.2.0.2.6.4.0', None) 2022-03-09 11:07:10,652 - Failure while verifying dependencies 2022-03-09 11:07:10,652 - ******************************************************************************* 2022-03-09 11:07:10,652 - Manually verify and fix package dependencies and then re-run install_packages 2022-03-09 11:07:10,652 - ******************************************************************************* 2022-03-09 11:07:10,652 - Installation of packages failed. Checking if installation was partially complete 2022-03-09 11:07:10,653 - Old versions: ['3.1.5.0-152', '3.1.5.6189-1'] 2022-03-09 11:07:10,653 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {} 2022-03-09 11:07:10,687 - call returned (0, '3.1.5.0-152\n3.1.5.6189-1') 2022-03-09 11:07:10,687 - New versions: ['3.1.5.0-152', '3.1.5.6189-1'] 2022-03-09 11:07:10,687 - Deltas: set([]) Command failed after 1 tries
Please note that already disabled HDP-GPL license in ambari.properties.
Created 03-14-2022 08:31 AM
Hi @HDP_Suja , From the error "
Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. hadoop_3_1_5_0_152-yarn-3.1.1.3.1.5.0-152.x86_64 has missing requires of hbase_3_1_5_0_152
phoenix_3_1_5_0_152-5.0.0.3.1.5.0-152.noarch has missing requires of hbase_3_1_5_0_152"
It looks like it is still pointing to the old repo. Please check for any old repo under /etc/yum.repos.d and move it to another folder and restart agent to see if it works. Thanks
Created 03-14-2022 08:31 AM
Hi @HDP_Suja , From the error "
Execution of '['/usr/bin/yum', '-d', '0', '-e', '0', 'check', 'dependencies']' returned 1. hadoop_3_1_5_0_152-yarn-3.1.1.3.1.5.0-152.x86_64 has missing requires of hbase_3_1_5_0_152
phoenix_3_1_5_0_152-5.0.0.3.1.5.0-152.noarch has missing requires of hbase_3_1_5_0_152"
It looks like it is still pointing to the old repo. Please check for any old repo under /etc/yum.repos.d and move it to another folder and restart agent to see if it works. Thanks
Created 03-22-2022 12:49 AM
@HDP_Suja, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
Regards,
Vidya Sargur,