Support Questions
Find answers, ask questions, and share your expertise

Hive Runtime Error while processing row (tag=0) using join(TEZ engine)

New Contributor

HI,all, I try the SQL as below,it fails.

insert into table bi.tenant_day_20160422 
select         
    tmp.user_id,class.tenant_id,tmp.study_datefrom     bi.tmp_date tmp
join
    gxb.gxb_class class
on 
    tmp.class_id=class.class_id 
group by    
    tmp.user_id,class.tenant_id,tmp.study_date;

But it works like:

insert into table bi.tenant_day_20160422
select tmp.user_id,class.tenant_id,tmp.study_date 
from (select * from bi.tmp_date limit 200000) tmp 
join gxb.gxb_class class
on tmp.class_id=class.class_id group by tmp.user_id,class.tenant_id,tmp.study_date;

The two relevant tables(tmp_date&gxb_class), one has 1374634 records, another has 17961 records. I check the dag.recovery, it shows the error may be caused by shuffle errors. It still fails even I follow someone's suggestions by setting

this two properties.

<property>
    <name>tez.runtime.shuffle.memory.limit.percent</name>
    <value>0.4</value>
</property>
<property>
    <name>tez.runtime.shuffle.fetch.buffer.percent</name>
    <value>0.15</value>
</property>

Has anyone ever seen this type of error before? If so any suggestions on how to resolve it?

Error log:

Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"reducesinkkey0":1881},"value":{"_col0":1115175,"_col1":"2015-10-19"}}
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:288)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:263)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:172)
... 14 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"reducesinkkey0":1881},"value":{"_col0":1115175,"_col1":"2015-10-19"}}
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource$GroupIterator.next(ReduceRecordSource.java:356)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:278)
... 16 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.IllegalArgumentException: java.net.URISyntaxException: Expected scheme-specific part at index 5: file:
at org.apache.hadoop.hive.ql.exec.persistence.RowContainer.first(RowContainer.java:250)
at org.apache.hadoop.hive.ql.exec.persistence.RowContainer.first(RowContainer.java:78)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genUniqueJoinObject(CommonJoinOperator.java:653)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.checkAndGenObject(CommonJoinOperator.java:759)
at org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.joinObject(CommonMergeJoinOperator.java:316)
at org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.joinOneGroup(CommonMergeJoinOperator.java:279)
at org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.joinOneGroup(CommonMergeJoinOperator.java:272)
at org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.process(CommonMergeJoinOperator.java:258)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource$GroupIterator.next(ReduceRecordSource.java:347).
4 REPLIES 4

Re: Hive Runtime Error while processing row (tag=0) using join(TEZ engine)

New Contributor

Hello. Did you receive any response or solution on this issue? I'm facing the exact same error on my end as well and can't find a solution as of this moment. I'll appreciate any help or clue... Thanks!

,

Hi, did you get any reply on this or any possible solution? I'm facing the exact same issue. Thanks in advance.

Re: Hive Runtime Error while processing row (tag=0) using join(TEZ engine)

Rising Star

even i am facing similar issue, is there any solution?

thanks,

Rishit Shah

Re: Hive Runtime Error while processing row (tag=0) using join(TEZ engine)

New Contributor

even I am facing same issue.Is there any solution ?

,

even I am also facing the same issue.Is there any solution?

Thanks,

Satish

Re: Hive Runtime Error while processing row (tag=0) using join(TEZ engine)

New Contributor

I am Facing similar issue, do you guys find any solution?

Thanks,

Adarsh.