Member since
02-18-2021
20
Posts
0
Kudos Received
0
Solutions
04-20-2021
11:54 AM
Hello Guys I'm using selecHiveQl to get data from Hive but I'm geting data repeatedly ? Hope someone can help Thanks in advance
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
03-30-2021
02:38 AM
I already tried it 11:35:11 CEST ERROR SelectHiveQL[id=0ccbb0ab-fcf7-3037-e2c0-0ea5f7799f7c] Unable to execute HiveQL select query SELECT * FROM global_2g; due to org.apache.commons.dbcp.SQLNestedException: Cannot create PoolableConnectionFactory (Could not establish connection to jdbc:hive2://173.249.11.251:10000/tables;: Required field 'serverProtocolVersion' is unset! Struct:TOpenSessionResp(status:TStatus(statusCode:ERROR_STATUS, infoMessages:[*org.apache.hive.service.cli.HiveSQLException:Failed to open new session: java.lang.RuntimeException:
... View more
03-30-2021
02:27 AM
thank you for the reply I'm not using any java code I'm just using apache nifi processor
... View more
03-30-2021
01:59 AM
Hello guys hope u doing well I'm trying to get data from Hive using apache nifi but I'm getting this error 10:49:06 CEST ERROR SelectHiveQL[id=0ccbb0ab-fcf7-3037-e2c0-0ea5f7799f7c] Unable to execute HiveQL select query SELECT * FROM global_2g; due to org.apache.commons.dbcp.SQLNestedException: Cannot create PoolableConnectionFactory (Could not establish connection to jdbc:hive2://0.0.0.0:10000/tables;: Required field 'serverProtocolVersion' is unset! Struct:TOpenSessionResp(status:TStatus(statusCode:ERROR_STATUS, infoMessages:[*org.apache.hive.service.cli.HiveSQLException:Failed to open new session: java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): User: taha is not allowed to impersonate anonymous:14:13, org.apache.hive.service.cli.session.SessionManager:createSession:SessionManager.java:434, org.apache.hive.service.cli.session.SessionManager:openSession:SessionManager.java:373, org.apache.hive.service.cli.CLIService:openSessionWithImpersonation:CLIService.java:195, org.apache.hive.service.cli.thrift.ThriftCLIService:getSessionHandle:ThriftCLIService.java:472, org.apache.hive.service.cli.thrift.ThriftCLIService:OpenSession:ThriftCLIService.java:322, org.apache.hive.service.rpc.thrift.TCLIService$Processor$OpenSession:getResult:TCLIService.java:1497, org.apache.hive.service.rpc.thrift.TCLIService$Processor$OpenSession:getResult:TCLIService.java:1482, org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39, org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39, org.apache.hive.service.auth.TSetIpAddressProcessor:process:TSetIpAddressProcessor.java:56, org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:286, java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1149, java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:624, java.lang.Thread:run:Thread.java:748, *java.lang.RuntimeException:java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): User: taha is not allowed to impersonate anonymous:22:8, org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:89, org.apache.hive.service.cli.session.HiveSessionProxy:access$000:HiveSessionProxy.java:36, org.apache.hive.service.cli.session.HiveSessionProxy$1:run:HiveSessionProxy.java:63, java.security.AccessController:doPrivileged:AccessController.java:-2, javax.security.auth.Subject:doAs:Subject.java:422, org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1762, org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:59, com.sun.proxy.$Proxy42:open::-1, Here's some configurations that can help : I already added this to hive-site.xml : <property>
<name>hive.server2.enable.doAs</name>
<value>false</value>
</property> If anyone can help thanks in advance
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
03-20-2021
03:24 AM
I'm using pyspark and I'm using hadoop 2.7.7 and not I'm not using llap
... View more
03-18-2021
02:45 AM
Hello guys I'm trying to show hive database using pyspark shell but I'm getting error "Invalid method name : 'get_all_functions' I'm using spark-3.1.1 and hive-1.2.2 : Thanks in advance
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark
03-15-2021
01:48 PM
Thank you for your reply I don't want to use spark warehouse, I want to use hive warehouse the global hive
... View more
03-15-2021
12:58 PM
Hello everyone I have a problem I'm trying to work with hive datasets using pyspark and I have 3 databases but I just get the default database it's like it create a new warehouse in same directory of python program Here's my program : from pyspark.sql import SparkSession spark = SparkSession \ .builder \ .appName("Python Spark SQL Hive integration example") \ .getOrCreate() spark.sql("show databases").show() and here's the output : and here's hive output : I want to connect to hive databases and thanks in advance
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark
03-01-2021
12:01 PM
And now I'm getting this error 20:57:07 CET WARNING PutHDFS[id=ecd594bf-0177-1000-916a-aeb3f6dc26ca] Error stopping FileSystem statistics thread: null 20:57:07 CET ERROR PutHDFS[id=ecd594bf-0177-1000-916a-aeb3f6dc26ca] Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.nio.channels.UnresolvedAddressException: java.nio.channels.UnresolvedAddressException 20:57:07 CET ERROR PutHDFS[id=ecd594bf-0177-1000-916a-aeb3f6dc26ca] HDFS Configuration error - null: java.nio.channels.UnresolvedAddressException 20:56:35 CET WARNING PutHDFS[id=ecd594bf-0177-1000-916a-aeb3f6dc26ca] Error stopping FileSystem statistics thread: null 20:56:35 CET ERROR PutHDFS[id=ecd594bf-0177-1000-916a-aeb3f6dc26ca] Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.nio.channels.UnresolvedAddressException: java.nio.channels.UnresolvedAddressException
... View more