Created 06-20-2019 06:55 PM
Hi,
We are getting below warnings while starting hive shell from CLI.
$hive
19/06/20 07:53:14 WARN conf.HiveConf: HiveConf of name hive.mapred.strict does not exist
19/06/20 07:53:14 WARN conf.HiveConf: HiveConf of name hive.mapred.supports.subdirectories does not exist
log4j:WARN No such property [maxFileSize] in org.apache.log4j.DailyRollingFileAppender
hive>
Hive version - 1.2
As per I know, we can safely ignore these warnings but, we need to get rid off these.
Could you please help on this. Thanks
Created 06-24-2019 01:56 PM
This WARN logs should not cause any issue,
1) however if you want to remove this configs, you can use below syntax to delete the config on specific component config_type(Configs can be searched in ambari -> hive configs filter box to know which file to be updated)
/var/lib/ambari-server/resources/scripts/configs.py -u <<username>> -p <<password>> -n <<clustername>> -l <<ambari-server-host>> -t <<ambari-server-port>> -a <<action>> -c <<config_type>> -k <<config-key>>
eg.,
/var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.strict
/var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.supports.subdirectories
This is the reference for configs.py https://cwiki.apache.org/confluence/display/AMBARI/Modify+configurations#Modifyconfigurations-Editco...
2) To remove log4j warning, goto ambari -> hive configs -> advance hive-log4j, comment below line
log4j.appender.DRFA.MaxFileSize
After the above 2 changes, restart hive services, all those 3 warns should go away.
If this article helps to resolve the issue, accept the answer, it might also help others members in the community.
Created 06-24-2019 01:56 PM
This WARN logs should not cause any issue,
1) however if you want to remove this configs, you can use below syntax to delete the config on specific component config_type(Configs can be searched in ambari -> hive configs filter box to know which file to be updated)
/var/lib/ambari-server/resources/scripts/configs.py -u <<username>> -p <<password>> -n <<clustername>> -l <<ambari-server-host>> -t <<ambari-server-port>> -a <<action>> -c <<config_type>> -k <<config-key>>
eg.,
/var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.strict
/var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.supports.subdirectories
This is the reference for configs.py https://cwiki.apache.org/confluence/display/AMBARI/Modify+configurations#Modifyconfigurations-Editco...
2) To remove log4j warning, goto ambari -> hive configs -> advance hive-log4j, comment below line
log4j.appender.DRFA.MaxFileSize
After the above 2 changes, restart hive services, all those 3 warns should go away.
If this article helps to resolve the issue, accept the answer, it might also help others members in the community.