Support Questions
Find answers, ask questions, and share your expertise

Sqoop job failed with Error: java.io.IOException: java.lang.IllegalStateException: Current state = RESET, new state = FLUSHED (state=,code=0)

New Contributor

Error: java.io.IOException: java.lang.IllegalStateException: Current state = RESET, new state = FLUSHED (state=,code=0)

3 REPLIES 3

Expert Contributor
@MML MAHESH

Please provide some more information about the stack trace of the error, this is a pretty vague message and does not provide what caused the issue unless we have the stack trace which can provide some information leading to what could have caused the issue.

Explorer

@mml_mahesh are you able to fix this, we are facing a same issue with few of our jobs which start a spark session and connect to hive:

 

java.io.IOException: Expected reader event with done status, but got ERROR with message Error while running task ( failure ) : attempt_437749772429135305_13982_0_00_000000_0:java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: java.io.IOException: java.lang.IllegalStateException: Current state = RESET, new state = FLUSHED

        at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)

        at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)

        at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)

        at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)

        at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:422)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)

        at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)

        at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)

        at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)

        at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

Caused by: java.lang.RuntimeException: java.io.IOException: java.io.IOException: java.lang.IllegalStateException: Current state = RESET, new state = FLUSHED

        at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:206)

        at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.next(TezGroupedSplitsInputFormat.java:152)

        at org.apache.tez.mapreduce.lib.MRReaderMapred.next(MRReaderMapred.java:116)

        at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)

        at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:426)

        at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:267)

        ... 15 more

Caused by: java.io.IOException: java.io.IOException: java.lang.IllegalStateException: Current state = RESET, new state = FLUSHED

        at org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderCreationException(HiveIOExceptionHandlerChain.java:97)

        at org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderCreationException(HiveIOExceptionHandlerUtil.java:57)

        at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:421)

        at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:203)

        ... 20 more

Community Manager

@Priyanka26, as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.



Regards,

Vidya Sargur,
Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community: