Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 06-20-2019 06:55 PM
Hi,
We are getting below warnings while starting hive shell from CLI.
$hive
19/06/20 07:53:14 WARN conf.HiveConf: HiveConf of name hive.mapred.strict does not exist
19/06/20 07:53:14 WARN conf.HiveConf: HiveConf of name hive.mapred.supports.subdirectories does not exist
log4j:WARN No such property [maxFileSize] in org.apache.log4j.DailyRollingFileAppender
hive>
Hive version - 1.2
As per I know, we can safely ignore these warnings but, we need to get rid off these.
Could you please help on this. Thanks
Created 06-24-2019 01:56 PM
This WARN logs should not cause any issue,
1) however if you want to remove this configs, you can use below syntax to delete the config on specific component config_type(Configs can be searched in ambari -> hive configs filter box to know which file to be updated)
/var/lib/ambari-server/resources/scripts/configs.py -u <<username>> -p <<password>> -n <<clustername>> -l <<ambari-server-host>> -t <<ambari-server-port>> -a <<action>> -c <<config_type>> -k <<config-key>>
eg.,
/var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.strict
/var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.supports.subdirectories
This is the reference for configs.py https://cwiki.apache.org/confluence/display/AMBARI/Modify+configurations#Modifyconfigurations-Editco...
2) To remove log4j warning, goto ambari -> hive configs -> advance hive-log4j, comment below line
log4j.appender.DRFA.MaxFileSize
After the above 2 changes, restart hive services, all those 3 warns should go away.
If this article helps to resolve the issue, accept the answer, it might also help others members in the community.
Created 06-24-2019 01:56 PM
This WARN logs should not cause any issue,
1) however if you want to remove this configs, you can use below syntax to delete the config on specific component config_type(Configs can be searched in ambari -> hive configs filter box to know which file to be updated)
/var/lib/ambari-server/resources/scripts/configs.py -u <<username>> -p <<password>> -n <<clustername>> -l <<ambari-server-host>> -t <<ambari-server-port>> -a <<action>> -c <<config_type>> -k <<config-key>>
eg.,
/var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.strict
/var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.supports.subdirectories
This is the reference for configs.py https://cwiki.apache.org/confluence/display/AMBARI/Modify+configurations#Modifyconfigurations-Editco...
2) To remove log4j warning, goto ambari -> hive configs -> advance hive-log4j, comment below line
log4j.appender.DRFA.MaxFileSize
After the above 2 changes, restart hive services, all those 3 warns should go away.
If this article helps to resolve the issue, accept the answer, it might also help others members in the community.