Support Questions

Find answers, ask questions, and share your expertise

UnknownHostException Exception while inserting into Hive table

avatar
Explorer

Hi,

I am getting this error when trying to insert into a hive table, the host in question (hdata2) is accessible and other services are running fine from it.

klist shows valid kerberos ticket. I want to merge many tables into one, so was inserting executing external hql script.

Any idea where to look for, logs looks fine.

INFO : Tez session hasn't been created yet. Opening session ERROR : Failed to execute tez graph. java.lang.IllegalArgumentException: java.net.UnknownHostException: hdata2.xxxxxxxxxxxx.local at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:438) at org.apache.hadoop.yarn.util.timeline.TimelineUtils.buildTimelineTokenService(TimelineUtils.java:120) at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceInit(YarnClientImpl.java:165) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.tez.client.TezYarnClient.init(TezYarnClient.java:46) at org.apache.tez.client.TezClient.start(TezClient.java:345) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:196) at org.apache.hadoop.hive.ql.exec.tez.TezTask.updateSession(TezTask.java:272) at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:152) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1745) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1491) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1289) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1156) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1151) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:197) at org.apache.hive.service.cli.operation.SQLOperation.access$300(SQLOperation.java:76) at org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:253) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:264) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.UnknownHostException: hdata2.xxxxxxxxxxxx.local ... 30 more Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask (state=08S01,code=1)

Thanks

MB

1 REPLY 1

avatar
Expert Contributor

This is due to nodes in cluster cannot resolve names correctly.

Could be a node manager node or the very edge node (if running from there) where Beeline is started.

Need to ensure that, if using DNS, resolution occurs at low latency, if using /etc/hosts, this file needs to be checked across cluster nodes