Member since
06-12-2019
6
Posts
0
Kudos Received
0
Solutions
03-22-2020
09:24 PM
I've create a Python script for connect to Hiveserver2 to perform queries databases.
My code are working fine, it's running for a while until the error came out.
thrift.transport.TTransport.TTransportException: 'Error in sasl_decode (-1) SASL(-1): generic failure: Unable to find a callback: 32775'
From investigated, I guess it might be something about Thrift SASL library
https://github.com/cloudera/thrift_sasl/blob/master/thrift_sasl/__init__.py
def _read_frame(self):
header = self._trans.read(4)
(length,) = struct.unpack(">I", header)
if self.encode:
# If the frames are encoded (i.e. you're using a QOP of auth-int or
# auth-conf), then make sure to include the header in the bytes you send to
# sasl.decode()
encoded = header + self._trans.read(length)
success, decoded = self.sasl.decode(encoded)
if not success:
raise TTransportException(type=TTransportException.UNKNOWN,
message=self.sasl.getError())
I have no idea what's cause the exception occurred. Any suggestion would be nice!
How to fix this problem ?
Thanks
... View more
Labels:
- Labels:
-
Apache Hive
05-13-2019
04:49 AM
No, I mean just only my system. They not gave permission for user 'hive' for Kerberos. And I'm not able change the permission. Thanks
... View more
05-10-2019
11:02 AM
Here are the .ctg file yarn.nodemanager.linux-container-executor.group=hadoop
banned.users=hdfs,yarn,mapred,bin
min.user.id=1000 According to Kerberos, Hive user doesn't has permission to execute the command. so I ran with root instead and using beeline not hive CLI Thanks
... View more
05-10-2019
10:06 AM
Unfortunately, it didn't work. Got all the same errors
... View more
05-10-2019
04:44 AM
I try to insert the table into hdfs following by this tutorial guideline https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.1.0/using-hiveql/content/hive_create_an_external_table.html by using beeline with user hdfs. I'm done with put csv to hdfs and create external table, table but stuck at the step 'INSERT OVERWRITE TABLE ' ' SELECT * FROM ' '; Once run this command, returning with errors below 0: jdbc:hive2://hostname:21> INSERT OVERWRITE TABLE Sales SELECT * FROM sales_text;
INFO : Tez session hasn't been created yet. Opening session
ERROR : Failed to execute tez graph.
org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1556784628398_0008 failed 2 times due to AM Container for appattempt_1556784628398_0008_000002 exited with exitCode: -1000
For more detailed output, check the application tracking page: http://hostname:8088/cluster/app/application_1556784628398_0008 Then click on links to logs of each attempt.
Diagnostics: Application application_1556784628398_0008 initialization failed (exitCode=255) with output: main : command provided 0
main : run as user is hdfs
main : requested yarn user is hdfs
Requested user hdfs is banned
Failing this attempt. Failing the application.
at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:699)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:218)
at org.apache.hadoop.hive.ql.exec.tez.TezTask.updateSession(TezTask.java:286)
at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:165)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:162)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1765)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1506)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1303)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1170)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1165)
at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:197)
at org.apache.hive.service.cli.operation.SQLOperation.access$300(SQLOperation.java:76)
at org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)
at org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask (state=08S01,code=1) and did check for given url in yarnUI Diagnostics: Application application_1556784628398_0017 failed 2 times due to AM Container for appattempt_1556784628398_0017_000002 exited with exitCode: -1000 For more detailed output, check the application tracking page: http://hostname:8088/cluster/app/application_1556784628398_0017 Then click on links to logs of each attempt. Diagnostics: Application application_1556784628398_0017 initialization failed (exitCode=255) with output: main : command provided 0 main : run as user is hdfs main : requested yarn user is hdfs Requested user hdfs is banned Failing this attempt. Failing the application. For the logging provided in the AttempID Logs not available for container_e26_1556784628398_0017_02_000001. Aggregation may not be complete, Check back later or try the nodemanager at hostname:45454 Please give me any suggestions. Thank you in advanced
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Tez