Member since
11-12-2019
5
Posts
0
Kudos Received
0
Solutions
01-28-2021
12:38 PM
Hello I have a problem with HiveWarehouseConnector trying to do hive.executeQuery("SELECT * FROM table").show(20) I'm using Zeppelin + Livy + Spark + HiveWarehouseConector, I don't know if I'm doing something wrong. I hope you can help me, thanks.
An error occurred while calling o133.showString.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 3.0 failed 4 times, most recent failure: Lost task 0.3 in stage 3.0 (TID 10, xxxx.xxxx.local, executor 2): java.io.IOException: Received reader event error: Error while running task ( failure ) : attempt_209249205889037353_0004_0_00_000000_3:java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Failed to load plan: hdfs://FQDN:8020/tmp/hive/anonymous/3c18d75e-bd2a-4cec-8d74-141d6727e98e/hive_2021-01-28_13-54-56_570_6847901818090377068-4/anonymous/_tez_scratch_dir/5201d615-4a62-4f26-8e79-1a540aeda76f/map.xml
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Failed to load plan: hdfs://FQDN:8020/tmp/hive/anonymous/3c18d75e-bd2a-4cec-8d74-141d6727e98e/hive_2021-01-28_13-54-56_570_6847901818090377068-4/anonymous/_tez_scratch_dir/5201d615-4a62-4f26-8e79-1a540aeda76f/map.xml
at org.apache.hadoop.hive.ql.exec.mr.ObjectCache.retrieve(ObjectCache.java:61)
at org.apache.hadoop.hive.ql.exec.ObjectCacheWrapper.retrieve(ObjectCacheWrapper.java:45)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:132)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:266)
... 15 more
Caused by: java.lang.RuntimeException: Failed to load plan: hdfs://FQDN:8020/tmp/hive/anonymous/3c18d75e-bd2a-4cec-8d74-141d6727e98e/hive_2021-01-28_13-54-56_570_6847901818090377068-4/anonymous/_tez_scratch_dir/5201d615-4a62-4f26-8e79-1a540aeda76f/map.xml
at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:507)
at org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:340)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor$1.call(MapRecordProcessor.java:135)
at org.apache.hadoop.hive.ql.exec.mr.ObjectCache.retrieve(ObjectCache.java:59)
... 18 more
Caused by: org.apache.hive.com.esotericsoftware.kryo.KryoException: Unable to find class: ejava.util.HashSet
... View more
Labels:
11-12-2020
11:45 AM
Hello I have a question, If there's compatibility between Cloudera NiFi components and the Confluent components, mainly between Cloudera NiFi's processor and Confluent Kafka brokers. Thank you.
... View more
11-14-2019
01:49 PM
I don't know what happens it doesn't shows me the option, and it is my user, in the current question it works but in the following question doesn't: Also when I try to go to my profile shows me the following message:
... View more
11-14-2019
11:13 AM
Hello, I don't know if this is the means to ask for help but because professional purposes, I have to remove a question I've made here in the community, excuse me, and I hope you can help me. Thanks.
... View more
11-12-2019
05:16 PM
Hello I have to restart my HDFS but it keeps all time in safe mode, I make test to my datanodes and the communication is not the problem, It says capacity 0 live nodes 0 dead nodes 0 and is in safe mode, Is there a way to make the node alive?
I hope you can help me, thank you so much.
... View more
Labels: