question Re: Warning message in Hive output after upgrading to hive version 1.1.0 from 0.13.0. in Archives of Support Questions (Read Only)

Warning message in Hive output after upgrading to hive version 1.1.0 from 0.13.0.

Alexraj84 — Thu, 19 May 2016 19:51:15 GMT

Our cluster was recently upgraded to CDH 5.5 and all the outputs generated by hive query has now a warning message shown below

WARN: The method class org.apache.commons.logging.impl.SLF4JLogFactory#release() was invoked.
WARN: Please see http://www.slf4j.org/codes.html#release for an explanation.

But when I use Beeline I don't see them. Is there a way I can get rid of the warning without switching to Beeline at least for now?

Hive version is 1.1.0

Re: Warning message in Hive output after upgrading to hive version 1.1.0 from 0.13.0.

jyadav — Thu, 19 May 2016 20:30:02 GMT

@Alex Raj

This is another bug fixed in hive 1.3 and later.

https://issues.apache.org/jira/browse/HIVE-12179

Re: Warning message in Hive output after upgrading to hive version 1.1.0 from 0.13.0.

Alexraj84 — Thu, 19 May 2016 21:22:01 GMT

I am adding the below jar but don't get any warnings. So the above Jira you mentioned is only for the Spark jars.

add jar hdfs:///data/95-utilities/hive-contrib-1.1.0-cdh5.5.2.jar;

Re: Warning message in Hive output after upgrading to hive version 1.1.0 from 0.13.0.

jyadav — Thu, 19 May 2016 21:27:58 GMT

@Alex Raj

yes, that was a general Jira related to spark therefore same applicable to other jar also which includes in hive classpath. Also I noticed you are using cdh? if your distro is CDH then sorry I have no idea about their distro jars.

Re: Warning message in Hive output after upgrading to hive version 1.1.0 from 0.13.0.

Alexraj84 — Fri, 20 May 2016 16:15:35 GMT

To Conclude, it is not possible to remove the warning message from the Hive query output until migrating to Beeline. I found a very simple and well known workaround to this problem which almost all of us use it in shell scripting. I used the grep tool to remove the warning message from my output. Below is how I modified my script to fix the problem.

hive -S -d ns=$hiveDB -d tab=$t -d dunsCol=$c1 -d phase="$ph1" -d error=$c2 -d ts=$eColumnArray -d reporting_window=$rDate -f $dir'select_count.hsql' | grep -v "^WARN" > $gOutPut 2> /dev/null

Re: Warning message in Hive output after upgrading to hive version 1.1.0 from 0.13.0.

SatyajeetS — Wed, 08 Jan 2020 12:27:38 GMT

You can also append HIVE_SKIP_SPARK_ASSEMBLY to the command which should remove the warnings.

export HIVE_SKIP_SPARK_ASSEMBLY=true; hive -S --database dbname -e 'show tables;'