Hive query failing with org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.RuntimeException: serious problem.

[#1]

Team,

My simple query is failing with following error when I am running on external portioned table though beeline.

0: jdbc:hive2://server1:8443/default> select * from testtable where lct_nbr=2413 and ivo_nbr in (17469,18630);

Error: java.io.IOException: java.lang.RuntimeException: serious problem (state=,code=0)

I found following in hiveserver2 log.

Caused by: java.io.IOException: java.lang.RuntimeException: serious problem at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508) at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415) at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140) at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:347) ... 43 more Caused by: java.lang.RuntimeException: serious problem at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1059) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1086) at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:363) at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295) at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446) ... 47 more

[#2]

@Saurabh Kumar

Are you also facign same issue when using mr engine?

set hive.execution.engine=mr;

[#3]

@Jitendra Yadav: Yes Jitendra I am facing problem for mr also. but when I am using hive cli then it is running fine for tez and mr.

443/default> select * from testtable where lct_nbr=2413 and ivo_nbr in (17469,18630);

Error: java.io.IOException: java.lang.RuntimeException: serious problem (state=,code=0)

[#4]

Kindly share more hiveserver2 logs it might have required info. May be permission issue?

[#5]

@Jitendra Yadav: I also thought of permission issue. But I did not get anything from ranger audit and even in hiveserevr2 log as well.

I saw one suspicious thing,actually logged in user is getting switched to some other users.

So any idea of such case ?

[#6]

@Saurabh Kumar

Is this happening with single user or with all users? Did you checked your Hive impersonation setting?.

[#7]

@Jitendra Yadav: This is a bug https://issues.apache.org/jira/browse/HIVE-13120 for odbc only. It was checking for wrong user due to this bug.

hive.fetch.task.conversion

• Default Value: minimal in Hive 0.10.0 through 0.13.1, more in Hive 0.14.0 and later
• Added In: Hive 0.10.0 with HIVE-2925; default changed in Hive 0.14.0 with HIVE-7397

Some select queries can be converted to a single FETCH task, minimizing latency. Currently the query should be single sourced not having any subquery and should not have any aggregations or distincts (which incur RS – ReduceSinkOperator, requiring a MapReduce task), lateral views and joins.

Supported values are none, minimal and more.

0. none: Disable hive.fetch.task.conversion (value added in Hive 0.14.0 with HIVE-8389) 1. minimal: SELECT *, FILTER on partition columns (WHERE and HAVING clauses), LIMIT only 2. more: SELECT, FILTER, LIMIT only (including TABLESAMPLE, virtual columns)

"more" can take any kind of expressions in the SELECT clause, including UDFs. (UDTFs and lateral views are not yet supported – see HIVE-5718.)

So to resolve this issue we have to set none like below and in this way issue will get resolved.

hive.fetch.task.conversion=none

[#8 · Accepted solution]

@Saurabh Kumar

Looks like this is caused by HIVE-13120 and a fix for this will be in HDP 2.4.2.0. The work-around is to set

hive.fetch.task.conversion=none

[#9]

This fixed my problem. I am on HDP 2.5.0 🙂

[#10]

I saw this error today. Apparently my hdfs file was in .csv but my table structure was in ORC.