Member since
11-28-2016
7
Posts
0
Kudos Received
0
Solutions
01-08-2017
11:18 AM
@clukasik, @Divakar Annapureddy This was an issue related to the JIRA - https://issues.apache.org/jira/browse/HIVE-11681 We have hive jobs that use same aux jars and "add jar" statements and these jobs execute concurrently. So, apparently, when one of the jobs is completed, the loader is closed while the other job is still using it and hence the KILL signal. We solved it by removing add jar statements from concurrent hive jobs and instead added the auxiliary jars in hive.aux.jars.path at the time of HS2 "start" which means that these jars would be loaded only once and will not be removed/closed/unloaded per session. Thus concurrent hive jobs will not have problem in accessing them. To make the jars available to HS2 - they were copied on each machine that hosted HS2 and then through Ambari added the path to HIVE_AUX_JARS_PATH only for the hiveserver component in the hive-env template script. if [ "$SERVICE" = "hiveserver2" ]; then CUSTOM_AUX_JARS_PATH=/<path_to_aux_lib_dir> if [ -d $CUSTOM_AUX_JARS_PATH ]; then CUSTOM_AUX_JARS=`echo $CUSTOM_AUX_JARS_PATH/*.jar | sed 's/ /,/g'` export HIVE_AUX_JARS_PATH="$HIVE_AUX_JARS_PATH,$CUSTOM_AUX_JARS" fi fi
... View more