Mysql repo pointing to internet by default when we install HIVE service

[#1]

Environment: OS-Centos 7, Ambari 2.5.2, HDP 2.5.3

Tried installing HIVE service on single node cluster with "NO" internet access but it failed on installing below package -

Installing package mysql-community-release 

I see that while installing HIVE service in cluster using default mysql database, then Ambari Operation fails on Installing MYSQL_SERVER package-

2017-12-21 16:26:48,630 - Version 2.5.3.0-37 was provided as effective cluster version.  Using package version 2_5_3_0_37
2017-12-21 16:26:48,631 - Package['mysql-community-release'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-12-21 16:26:48,714 - Installing package mysql-community-release ('/usr/bin/yum -d 0 -e 0 -y install mysql-community-release')
2017-12-21 16:26:53,719 - Version 2.5.3.0-37 was provided as effective cluster version.  Using package version 2_5_3_0_37
2017-12-21 16:26:53,720 - Package['mysql-community-server'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-12-21 16:26:53,734 - Installing package mysql-community-server ('/usr/bin/yum -d 0 -e 0 -y install mysql-community-server')

Findings: While installing MYSQL_SERVER it expects "mysql-community-release-el7-5.noarch.rpm" to be installed which basically comes from HDP_UTILS as shown below -

HDP-UTILS-1.1.0.21/mysql/mysql-community-release-el7-5.noarch.rpm

When Ambari operation installs the "mysql-community-release-el7-5.noarch.rpm", it creates 2 repo files under /etc/yum.repos.d/ path -

 ls -lrt /etc/yum.repos.d/*
-rw-r--r--. 1 root root 1060 Jan 29  2014 mysql-community-source.repo
-rw-r--r--. 1 root root 1209 Jan 29  2014 mysql-community.repo

Both of above repos has base_url pointing to internet.

And hence the environment which has no internet access. the HIVE installation fails.

Do you this this is expected behavior ? Please suggest.

[#2]

@Jay Kumar SenSharma @Sindhu Please suggest

[#3 · Accepted solution]

@Sagar Shimpi

Hi,
MySQL package is not provided as part of Hortonworks Binaries. Even though we provide the "mysql-community*.repo" repo files as a reference.

If the internet access is not available on the host then we will need to install this package manually using offline MySQL package RPM download/install.

.

[#4]

@Jay Kumar SenSharma

**MySQL package is not provided as part of Hortonworks Binaries ---> I agree.

I tried installing mysql first -

#rpm -qa |grep mysql
mysql-community-libs-5.6.38-2.el7.x86_64
mysql-connector-java-5.1.37-1.noarch
mysql-community-server-5.6.38-2.el7.x86_64
mysql-community-common-5.6.38-2.el7.x86_64
mysql-community-client-5.6.38-2.el7.x86_64

Now when I try to install HIVE server [on MYSQL_SERVER step] by default installs "mysql-community-release-el7-5.noarch.rpm" as part of the installation script, due to which mysql-community*.repo are created. And irrespective of local or internet environment it installs the RPM and my installation is stuck.

I think its hardcoded in "MySQL Server Install" script to install the rpm irrespective of mysql is installed or not.

[#5]

@Sagar Shimpi @Jay Kumar SenSharma

RHEL/CentOS 7 - MySql community server with RPM installation runs into multiple issues. Here are full instructions on how you could install manually using Mysql RPM Bundle(https://dev.mysql.com/downloads/) when you do not have internet and using local Repository.

If you try to use "yum install mysql-community-{client,common,libs}-* mysql-5.*", you will run into errors. So install each rpm in the order below.

If your issue is resolved Accept the answer for the benefit of others. Else post any issue encountered as well. Unfortunately, MySQL website does not have full instructions :). Thanks!

[root@ mysql]# rpm -ivh mysql-community-common-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-common-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mysql-community-common-5.7.21-1.e################################# [100%]
[root@ mysql]# rpm -ivh mysql-community-libs-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-libs-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mysql-community-libs-5.7.21-1.el7################################# [100%]
[root@cpsh20-03 mysql]# rpm -ivh mysql-community-client-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-client-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mysql-community-client-5.7.21-1.e################################# [100%]
[root@ mysql]# rpm -ivh mysql-community-server-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-server-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
error: Failed dependencies:
	libaio.so.1()(64bit) is needed by mysql-community-server-5.7.21-1.el7.x86_64
	libaio.so.1(LIBAIO_0.1)(64bit) is needed by mysql-community-server-5.7.21-1.el7.x86_64
	libaio.so.1(LIBAIO_0.4)(64bit) is needed by mysql-community-server-5.7.21-1.el7.x86_64
[root@ mysql]# wget http://mirror.centos.org/centos/6/os/x86_64/Packages/libaio-0.3.107-10.el6.x86_64.rpm
--2018-03-01 05:34:21--  http://mirror.centos.org/centos/6/os/x86_64/Packages/libaio-0.3.107-10.el6.x86_64.rpm
Resolving mirror.centos.org (mirror.centos.org)... 66.29.48.168, 2607:f2d8:1:e::10
Connecting to mirror.centos.org (mirror.centos.org)|66.29.48.168|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 21708 (21K) [application/x-rpm]
Saving to: ‘libaio-0.3.107-10.el6.x86_64.rpm’


100%[==================================================================================================================>] 21,708      --.-K/s   in 0.07s


2018-03-01 05:34:21 (303 KB/s) - ‘libaio-0.3.107-10.el6.x86_64.rpm’ saved [21708/21708]


[root@ mysql]# rpm -ivh libaio-0.3.107-10.el6.x86_64.rpm
warning: libaio-0.3.107-10.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID c105b9de: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:libaio-0.3.107-10.el6            ################################# [100%]
[root@ mysql]# rpm -Uvh mysql-community-server-5.7.21-1.el7.x86_64.rpm
warning: mysql-community-server-5.7.21-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mysql-community-server-5.7.21-1.e################################# [100%]
[root@ mysql]# systemctl start mysqld.service
[root@ mysql]# mysql -u root -p
Enter password: