CDH 6.1 upgrade fails HUE

[#1]

Hello,

I have been working on upgrading our cluster from CDH5.15 to CDH6.1.0 version. We have CentOS 6.10 operating system and Python version 2.6.6 on our boxes. According to the documentation the python version is compatable for the OS vesion (https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_os_requirements.html#os_...) "Cloudera Enterprise 6 requires Python 2.6 or higher on RHEL 6 compatible operating systems".

But, when trying to upgrade and launch services (CDH 6.1), HUE service fails with the following error message,

2019-02-25 22:20:31,504 INFO CommandPusher:com.cloudera.cmf.service.AbstractDbConnectionTestCommand: ++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop-kms ++ export CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/parquet ++ CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/parquet ++ export CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/avro ++ CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/avro ++ export CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/kafka ++ CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/kafka ++ export CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/kudu ++ CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/kudu + locate_cdh_java_home + '[' -z /usr/lib/jvm/java-1.8.0-openjdk.x86_64 ']' + verify_java_home + '[' -z /usr/lib/jvm/java-1.8.0-openjdk.x86_64 ']' + echo JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk.x86_64 + export HUE_CONF_DIR=/var/run/cloudera-scm-agent/process/591-HUE-test-db-connection + HUE_CONF_DIR=/var/run/cloudera-scm-agent/process/591-HUE-test-db-connection + export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/591-HUE-test-db-connection/hadoop-conf + HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/591-HUE-test-db-connection/hadoop-conf + '[' python27_version_check = is_db_alive ']' + '[' -n 6 ']' + '[' 6 -ge 6 ']' + python27_version_check + python27_exists=0 + python_vers=("/usr/bin" "/usr/local/python27/bin" "/opt/rh/python27/root/usr/bin") + for binpath in '${python_vers[@]}' + pybin=/usr/bin/python2.7 + '[' '!' -e /usr/bin/python2.7 ']' + continue + for binpath in '${python_vers[@]}' + pybin=/usr/local/python27/bin/python2.7 + '[' '!' -e /usr/local/python27/bin/python2.7 ']' + continue + for binpath in '${python_vers[@]}' + pybin=/opt/rh/python27/root/usr/bin/python2.7 + '[' '!' -e /opt/rh/python27/root/usr/bin/python2.7 ']' + continue + '[' 0 -eq 0 ']' + echo 'ERROR: Unable to find python 2.7 installation' + exit 1
2019-02-25 22:20:31,504 ERROR CommandPusher:com.cloudera.cmf.model.DbCommand: Command 2177(HueTestDatabaseConnection) has completed. finalstate:FINISHED, success:false, msg:Unexpected error. Unable to verify database connection.

which says that it is looking for Python 2.7. Is there any properties file or configuration thats been set as 2.7 by default and needs to be changes? 

Due to this our HUE service is down. Any suggestion to resolve this issue would be helpful.

[#2 · Accepted solution]

Hi @Thrisha,

From the same link you pasted, it says:

Python - Cloudera Enterprise 6, with the exception of Hue, is supported on the Python version that is included in the operating system by default, as well as higher versions, but is not compatible with Python 3.0 or higher.

For example, Cloudera Enterprise 6 requires Python 2.6 or higher on RHEL 6 compatible operating systems, but requires Python 2.7 or higher on RHEL 7 compatible operating systems.

Hue in CDH 6 requires Python 2.7 or higher on all operating systems. For RHEL 6 compatible operating systems running Hue, you must manually install Python 2.7.

Based on above, you need to follow the link to manually install Python 2.7 for Hue to work in CDH 6.

Thanks and hope this helps,

Li