Created 05-16-2017 11:56 AM
I need to execute a shell script using Oozie shell action. The shell script consists of few hive queries. But while executing the oozie job, I am getting below error. There is also a CTRL-A character before the class name, I don't understand from where it is coming
================================================================ Error: java.lang.RuntimeException: Failed to load plan: hdfs://<host-name>:8020/tmp/hive/root/84b33b39-ae32-48af-93a7-642a09c7990a/hive_2017-05-16_13-29-53_726_2783073923589041084-1/-mr-10014/d3f18287-7e18-42e4-871f-19a6518b5ba6/map.xml: org.apache.hive.com.esotericsoftware.kryo.KryoException: Unable to find class: ^AGenericUDFOPNumericMinus Serialization trace: longWritable (org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPNumericMinus) arithmeticOperation (org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPMinus) genericUDF (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) colExprMap (org.apache.hadoop.hive.ql.exec.SelectOperator) childOperators (org.apache.hadoop.hive.ql.exec.MapJoinOperator) childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator) aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork) at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:474) at org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:313) at org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:269) at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:508) at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:483) at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:715) at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:169) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) Caused by: org.apache.hive.com.esotericsoftware.kryo.KryoException: Unable to find class: ^AGenericUDFOPNumericMinus Serialization trace: longWritable (org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPNumericMinus) arithmeticOperation (org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPMinus) genericUDF (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) chidren (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) colExprMap (org.apache.hadoop.hive.ql.exec.SelectOperator) childOperators (org.apache.hadoop.hive.ql.exec.MapJoinOperator) childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator) aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)
Created 05-16-2017 12:26 PM
The issue might be related to Jira HIVE-7711. Try setting `hive.plan.serialization.format=javaXML` and try running shell script again.
Created 05-24-2017 07:24 AM
I tried the setting suggested by you but that didn't help. I am getting below error message:
'java.lang.RuntimeException(java.lang.RuntimeException: Cannot serialize object)'