Member since
02-02-2021
116
Posts
2
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
747 | 08-13-2021 09:44 AM | |
3712 | 04-27-2021 04:23 PM | |
1389 | 04-26-2021 10:47 AM | |
927 | 03-29-2021 06:01 PM | |
2761 | 03-17-2021 04:53 PM |
03-24-2021
07:11 PM
Thanks Daming Xue for the response. I previously saw this post and my understanding is that the user tried to downgrade his hive to 2.2 and it worked. Do you know where I can download the binaries for hive 2.2 as I am trying to install it from open source? Also here is the hive version: [root@test ~]# /usr/local/apache-hive-2.3.8-src/packaging/target/apache-hive-2.3.8-bin/apache-hive-2.3.8-bin/bin/hive --version Hive 2.3.8 Git file:///usr/local/apache-hive-2.3.8-src -r Unknown Compiled by root on Mon Mar 22 17:20:19 CDT 2021 From source with checksum d4bb475f3303053b26c5cf63f4fc68a1 And here is the "hive-jdbc-xxx.jar" /usr/local/apache-hive-2.3.8-src/packaging/target/apache-hive-2.3.8-bin/apache-hive-2.3.8-bin/lib/hive-jdbc-2.3.8.jar
... View more
03-24-2021
06:38 PM
Hi experts, I recently installed hive2.3.8 and trying to enable LLAP. I am getting the below error. beeline> !connect jdbc:hive2://test01.domain.com:2181,test02.domain.com:2181,test03.domain.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2 Connecting to jdbc:hive2://test01.domain.com:2181,test02.domain.com:2181,test03.domain.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2 Enter username for jdbc:hive2://test01.domain.com:2181,test02.domain.com:2181,test03.domain.com:2181/: Enter password for jdbc:hive2://test01.domain.com:2181,test02.domain.com:2181,test03.domain.com:2181/: 21/03/24 20:34:01 [main]: INFO jdbc.HiveConnection: Connected to test02.domain.com:10500 21/03/24 20:34:01 [main]: WARN jdbc.HiveConnection: Failed to connect to test02.domain.com:10500 21/03/24 20:34:01 [main]: ERROR jdbc.Utils: Unable to read HiveServer2 configs from ZooKeeper Error: Could not open client transport for any of the Server URI's in ZooKeeper: Failed to open new session: java.lang.IllegalArgumentException: hive configuration hive.server2.thrift.resultset.default.fetch.size does not exists. (state=08S01,code=0) beeline> Any help is much appreciated. Thanks,
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
03-22-2021
11:32 AM
@Shifu thanks for the response. So I resolved the following error by re-installing hive. 0: jdbc:hive2://test.domain.com:218> create table studenta (name STRING); Error: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:Exception thrown when executing query : SELECT DISTINCT 'org.apache.hadoop.hive.metastore.model.MTable' AS `NUCLEUS_TYPE`,`A0`.`CREATE_TIME`,`A0`.`LAST_ACCESS_TIME`,`A0`.`OWNER`,`A0`.`RETENTION`,`A0`.`IS_REWRITE_ENABLED`,`A0`.`TBL_NAME`,`A0`.`TBL_TYPE`,`A0`.`TBL_ID` FROM `TBLS` `A0` LEFT OUTER JOIN `DBS` `B0` ON `A0`.`DB_ID` = `B0`.`DB_ID` WHERE `A0`.`TBL_NAME` = ? AND `B0`.`NAME` = ?) But still getting the ranger error. I am able to create tables but when I try to select on the table I just created, I get the ranger error. 0: jdbc:hive2://test.domain.com:218> show tables; +-----------+ | tab_name | +-----------+ | student | | studenta | | studentb | | studentc | +-----------+ 4 rows selected (0.254 seconds) 0: jdbc:hive2://test.domain.com:218> create table studentd (name STRING); No rows affected (0.456 seconds) 0: jdbc:hive2://test.domain.com:218> show tables; +-----------+ | tab_name | +-----------+ | student | | studenta | | studentb | | studentc | | studentd | +-----------+ 5 rows selected (0.254 seconds) 0: jdbc:hive2://test.domain.com:218> select * from studentd; Error: Error running query: java.lang.AbstractMethodError: org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer.needTransform()Z (state=,code=0) Any help is much appreciated. Thanks,
... View more
03-21-2021
07:48 AM
Thanks @Shifu for the response. ok so I have installed hive 2.3.8 via open source, however, the cluster currently has hive 1.2 which was originally installed via hdp 2.6.1 When i use hive 1.2, I am able to run the same commands to create tables etc. However, when i use hive 2.3.8, i am able to run the same commands such as create table etc. I am able to create database or show database. I have also ran the script to upgrade the mysql schema to 2.3.0 mysql> select * from VERSION; +--------+----------------+----------------------------+ | VER_ID | SCHEMA_VERSION | VERSION_COMMENT | +--------+----------------+----------------------------+ | 1 | 2.3.0 | Hive release version 2.3.0 | +--------+----------------+----------------------------+ 1 row in set (0.00 sec) Any help is much appreciated. Thanks,
... View more
03-19-2021
06:23 PM
Hi experts, I am new to setting up hive LLAP. I am wondering is there a way to test hiveserver2 LLAP vs hiverserver2 Thanks,
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
03-19-2021
06:15 PM
0: jdbc:hive2://test.domain.com:218> select * from test.student; Error: Error running query: java.lang.AbstractMethodError: org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer.needTransform()Z (state=,code=0) 0: jdbc:hive2://test.domain.com:218> create table studenta (name STRING); Error: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:Exception thrown when executing query : SELECT DISTINCT 'org.apache.hadoop.hive.metastore.model.MTable' AS `NUCLEUS_TYPE`,`A0`.`CREATE_TIME`,`A0`.`LAST_ACCESS_TIME`,`A0`.`OWNER`,`A0`.`RETENTION`,`A0`.`IS_REWRITE_ENABLED`,`A0`.`TBL_NAME`,`A0`.`TBL_TYPE`,`A0`.`TBL_ID` FROM `TBLS` `A0` LEFT OUTER JOIN `DBS` `B0` ON `A0`.`DB_ID` = `B0`.`DB_ID` WHERE `A0`.`TBL_NAME` = ? AND `B0`.`NAME` = ?) at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:257) at org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:348) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:362) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:Exception thrown when executing query : SELECT DISTINCT 'org.apache.hadoop.hive.metastore.model.MTable' AS `NUCLEUS_TYPE`,`A0`.`CREATE_TIME`,`A0`.`LAST_ACCESS_TIME`,`A0`.`OWNER`,`A0`.`RETENTION`,`A0`.`IS_REWRITE_ENABLED`,`A0`.`TBL_NAME`,`A0`.`TBL_TYPE`,`A0`.`TBL_ID` FROM `TBLS` `A0` LEFT OUTER JOIN `DBS` `B0` ON `A0`.`DB_ID` = `B0`.`DB_ID` WHERE `A0`.`TBL_NAME` = ? AND `B0`.`NAME` = ?) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:862) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:867) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4356) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:354) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:199) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2183) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1839) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1526) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1232) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:255) ... 11 more Caused by: MetaException(message:Exception thrown when executing query : SELECT DISTINCT 'org.apache.hadoop.hive.metastore.model.MTable' AS `NUCLEUS_TYPE`,`A0`.`CREATE_TIME`,`A0`.`LAST_ACCESS_TIME`,`A0`.`OWNER`,`A0`.`RETENTION`,`A0`.`IS_REWRITE_ENABLED`,`A0`.`TBL_NAME`,`A0`.`TBL_TYPE`,`A0`.`TBL_ID` FROM `TBLS` `A0` LEFT OUTER JOIN `DBS` `B0` ON `A0`.`DB_ID` = `B0`.`DB_ID` WHERE `A0`.`TBL_NAME` = ? AND `B0`.`NAME` = ?) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:42225) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:42193) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result.read(ThriftHiveMetastore.java:42119) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_create_table_with_environment_context(ThriftHiveMetastore.java:1203) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.create_table_with_environment_context(ThriftHiveMetastore.java:1189) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.create_table_with_environment_context(HiveMetaStoreClient.java:2405) at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.create_table_with_environment_context(SessionHiveMetaStoreClient.java:93) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:752) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:740) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:173) at com.sun.proxy.$Proxy49.createTable(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2336) at com.sun.proxy.$Proxy49.createTable(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:852) ... 22 more (state=08S01,code=1) 0: jdbc:hive2://test.domain.com:218>
... View more
03-19-2021
06:13 PM
Hi experts, I am able to connect to hive via hiveserver2/beeline. I am able to "show databases;" or "create databases", however, I am unable to "select" or "create tables". Everything seems to work fine when I start the hive 1.2 service, but I get errors running certain queries when I run hive 2.3.8 service. Below are the errors: 0: jdbc:hive2://test.domain.com:218> show databases; +----------------------+ | database_name | +----------------------+ | default | | emp | | test | | test1 | | test2 | +----------------------+ 6 rows selected (0.116 seconds) 0: jdbc:hive2://test.domain.com:218> use test; No rows affected (0.261 seconds) 0: jdbc:hive2://test.domain.com:218> show tables; +-----------+ | tab_name | +-----------+ | student | +-----------+ 1 row selected (0.264 seconds) 0: jdbc:hive2://test.domain.com:218> select * from test.student; Error: Error running query: java.lang.AbstractMethodError: org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer.needTransform()Z (state=,code=0) Any help is much appreciated. Thanks,
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
03-19-2021
08:12 AM
@isoardi oh this is a cluster that I can use to test upgrades etc. But I did install HDP 2.6.x onto this cluster which is similar to our production environment.
... View more
03-19-2021
05:48 AM
Thanks @isoardi We currently have hive 1.2. Since hiveCLI is deprecated and as long as beeline or hiveserver2 works, then I should probably not bother fixing or worrying about hiveCLI right? This is a sandbox cluster and using this cluster to prepare to eventually upgrade the production cluster. Thanks,
... View more
03-18-2021
08:42 AM
Sorry forgot to mention that this does work with beeline and I assume it is using tez because I have it set to tez in the hive.execution.engine. The error above is in regards to hiveCLI only and in the application logs there seems to be some version mismatch which I am not exactly sure how to resolve. Any help is much appreciated. Thanks,
... View more