Error while trying to perform insert operation in Cloudera Hive

JSavy — Mon, 25 Nov 2024 17:26:50 GMT

Please help troubleshoot the following error encountered during insert operation in Hive.

Command executed:

INSERT INTO example (C1, C2) VALUES
(1, "|VALUE ONE"),
(1, "|VALUE TWO"),
(1, "NULL"),
(1, "|VALUE FOUR"),
(1, "|VALUE FIVE");

Result of execution:

INFO : Compiling command(queryId=hive_20241125083349_27568c92-ab64-4322-81fd-3bddb8bdbbe3): INSERT INTO example (C1, C2) VALUES

(1, "|VALUE ONE"),

(1, "|VALUE TWO"),

(1, "NULL"),

(1, "|VALUE FOUR"),

(1, "|VALUE FIVE")

INFO : Semantic Analysis Completed (retrial = false)

INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:int, comment:null), FieldSchema(name:_col1, type:varchar(20), comment:null)], properties:null)

INFO : Completed compiling command(queryId=hive_20241125083349_27568c92-ab64-4322-81fd-3bddb8bdbbe3); Time taken: 0.81 seconds

INFO : Executing command(queryId=hive_20241125083349_27568c92-ab64-4322-81fd-3bddb8bdbbe3): INSERT INTO example (C1, C2) VALUES

(1, "|VALUE ONE"),

(1, "|VALUE TWO"),

(1, "NULL"),

(1, "|VALUE FOUR"),

(1, "|VALUE FIVE")

INFO : Query ID = hive_20241125083349_27568c92-ab64-4322-81fd-3bddb8bdbbe3

INFO : Total jobs = 1

INFO : Launching Job 1 out of 1

INFO : Starting task [Stage-1:MAPRED] in serial mode

INFO : Subscribed to counters: [] for queryId: hive_20241125083349_27568c92-ab64-4322-81fd-3bddb8bdbbe3

INFO : Tez session hasn't been created yet. Opening session

ERROR : Failed to execute tez graph.

org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1730584072947_0051 failed 1 times (global limit =2; local limit is =1) due to AM Container for appattempt_1730584072947_0051_000001 exited with exitCode: 1

Failing this attempt.Diagnostics: [2024-11-25 08:34:04.226]Exception from container-launch.

Container id: container_e79_1730584072947_0051_01_000001

Exit code: 1

Exception message: Launch container failed

Shell output: main : command provided 1

main : run as user is tm_cc_user_2

main : requested yarn user is tm_cc_user_2

Getting exit code file...

Creating script paths...

Writing pid file...

Writing to tmp file /yarn/nm/nmPrivate/application_1730584072947_0051/container_e79_1730584072947_0051_01_000001/container_e79_1730584072947_0051_01_000001.pid.tmp

Writing to cgroup task files...

Creating local dirs...

Launching container...

[2024-11-25 08:34:04.260]Container exited with a non-zero exit code 1. Error file: prelaunch.err.

Last 4096 bytes of prelaunch.err :

Last 4096 bytes of stderr :

[2024-11-25 08:34:04.261]Container exited with a non-zero exit code 1. Error file: prelaunch.err.

Last 4096 bytes of prelaunch.err :

Last 4096 bytes of stderr :

For more detailed output, check the application tracking page: https://conops-kdc1.fyre.ibm.com:8090/cluster/app/application_1730584072947_0051 Then click on links to logs of each attempt.

. Failing the application.

at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:979) ~[tez-api-0.9.1.7.1.8.0-801.jar:0.9.1.7.1.8.0-801]

at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:948) ~[tez-api-0.9.1.7.1.8.0-801.jar:0.9.1.7.1.8.0-801]

at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.startSessionAndContainers(TezSessionState.java:567) ~[hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:385) ~[hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:300) ~[hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession.open(TezSessionPoolSession.java:106) ~[hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.exec.tez.TezTask.ensureSessionHasResources(TezTask.java:410) ~[hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:215) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:213) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:357) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:330) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:246) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:109) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:749) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.Driver.run(Driver.java:504) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.Driver.run(Driver.java:498) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:166) [hive-exec-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:226) [hive-service-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:88) [hive-service-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:327) [hive-service-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]

at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_422]

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898) [hadoop-common-3.1.1.7.1.8.0-801.jar:?]

at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:345) [hive-service-3.1.3000.7.1.8.0-801.jar:3.1.3000.7.1.8.0-801]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_422]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_422]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_422]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_422]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_422]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_422]

at java.lang.Thread.run(Thread.java:750) [?:1.8.0_422]

ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

INFO : Completed executing command(queryId=hive_20241125083349_27568c92-ab64-4322-81fd-3bddb8bdbbe3); Time taken: 14.175 seconds

INFO : OK

Error: Error while compiling statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask (state=08S01,code=1)

Re: Error while trying to perform insert operation in Cloudera Hive

DianaTorres — Mon, 25 Nov 2024 23:00:41 GMT

@JSavy Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our Hive experts @Shmoo @mszurap @cravani who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: Error while trying to perform insert operation in Cloudera Hive

ggangadharan — Tue, 26 Nov 2024 07:05:20 GMT

From the attached console output noticed AM failed to submit the DAG.

ERROR : Failed to execute tez graph. org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1730584072947_0051 failed 1 times (global limit =2; local limit is =1) due to AM Container for appattempt_1730584072947_0051_000001 exited with exitCode: 1

Please check the appLogs application_1730584072947_0051 to identify the root cause of the failure.

Re: Error while trying to perform insert operation in Cloudera Hive

DianaTorres — Thu, 05 Dec 2024 17:40:03 GMT

@JSavy Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.

question Re: Error while trying to perform insert operation in Cloudera Hive in Support Questions

Error while trying to perform insert operation in Cloudera Hive

Re: Error while trying to perform insert operation in Cloudera Hive

Re: Error while trying to perform insert operation in Cloudera Hive

Re: Error while trying to perform insert operation in Cloudera Hive