Created on 06-07-2016 10:13 AM - edited 09-16-2022 03:23 AM
Team,
My simple query is failing with following error when I am running on external portioned table though beeline.
0: jdbc:hive2://server1:8443/default> select * from testtable where lct_nbr=2413 and ivo_nbr in (17469,18630);
Error: java.io.IOException: java.lang.RuntimeException: serious problem (state=,code=0)
I found following in hiveserver2 log.
Caused by: java.io.IOException: java.lang.RuntimeException: serious problem at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508) at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415) at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140) at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:347) ... 43 more Caused by: java.lang.RuntimeException: serious problem at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1059) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1086) at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:363) at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295) at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446) ... 47 more
Created 06-08-2016 07:53 AM
Looks like this is caused by HIVE-13120 and a fix for this will be in HDP 2.4.2.0. The work-around is to set
hive.fetch.task.conversion=none
Created 06-07-2016 10:25 AM
Created 06-07-2016 10:32 AM
@Jitendra Yadav: Yes Jitendra I am facing problem for mr also. but when I am using hive cli then it is running fine for tez and mr.
443/default> select * from testtable where lct_nbr=2413 and ivo_nbr in (17469,18630);
Error: java.io.IOException: java.lang.RuntimeException: serious problem (state=,code=0)
Created 06-07-2016 10:51 AM
Kindly share more hiveserver2 logs it might have required info. May be permission issue?
Created 06-07-2016 12:03 PM
@Jitendra Yadav: I also thought of permission issue. But I did not get anything from ranger audit and even in hiveserevr2 log as well.
I saw one suspicious thing,actually logged in user is getting switched to some other users.
So any idea of such case ?
Created 06-07-2016 12:17 PM
Is this happening with single user or with all users? Did you checked your Hive impersonation setting?.
Created 06-08-2016 06:02 AM
@Jitendra Yadav: This is a bug https://issues.apache.org/jira/browse/HIVE-13120 for odbc only. It was checking for wrong user due to this bug.
hive.fetch.task.conversionminimal
in Hive 0.10.0 through 0.13.1, more
in Hive 0.14.0 and laterSome select queries can be converted to a single FETCH task, minimizing latency. Currently the query should be single sourced not having any subquery and should not have any aggregations or distincts (which incur RS – ReduceSinkOperator, requiring a MapReduce task), lateral views and joins.
Supported values are none, minimal
and more
.
0. none
: Disable hive.fetch.task.conversion (value added in Hive 0.14.0 with HIVE-8389)
1. minimal
: SELECT *, FILTER on partition columns (WHERE and HAVING clauses), LIMIT only
2. more
: SELECT, FILTER, LIMIT only (including TABLESAMPLE, virtual columns)
"more
" can take any kind of expressions in the SELECT clause, including UDFs.
(UDTFs and lateral views are not yet supported – see HIVE-5718.)
So to resolve this issue we have to set none like below and in this way issue will get resolved.
hive.fetch.task.conversion=noneCreated 06-08-2016 07:53 AM
Looks like this is caused by HIVE-13120 and a fix for this will be in HDP 2.4.2.0. The work-around is to set
hive.fetch.task.conversion=none
Created 02-27-2017 01:42 PM
This fixed my problem. I am on HDP 2.5.0 🙂
Created 12-06-2018 03:05 AM
I saw this error today. Apparently my hdfs file was in .csv but my table structure was in ORC.