Cloudera Community
ryu
user rank
Contributor

Re: hiveCLI not working with tez but works with ma...

by Contributor in Support Questions
‎03-18-2021 08:37 AM
‎03-18-2021 08:37 AM
Thanks @ChethanYM for the reply.   I did find this error in the application log   2021-03-18 10:33:27,963 [INFO] [main] |app.DAGAppMaster|: Comparing client version with AM version, clientVersion=0.7.0.2.6.1.0-129, AMVersion=0.8.4.2.6.1.0-129 2021-03-18 10:33:27,964 [ERROR] [main] |app.DAGAppMaster|: Incompatible versions found, clientVersion=0.7.0.2.6.1.0-129, AMVersion=0.8.4.2.6.1.0-129   Not exactly sure how to resolve this ... View more

Re: hive databases not showing via beeline/hiveser...

by Contributor in Support Questions
‎03-17-2021 04:53 PM
‎03-17-2021 04:53 PM
Ok seems like I had hive.security.authoization.enabled to true in the hiveserver2-site.xml but had not enabled the ranger hive plugin yet. Once I set this property to false, I was able to see the hive databases with "show databases".   ... View more

Re: hive databases not showing via beeline/hiveser...

by Contributor in Support Questions
‎03-17-2021 03:19 PM
‎03-17-2021 03:19 PM
@ksuresh @mqureshi, @Sunile Manjee, @Shyam Sunder Rai - looping you in, any ideas on this ? ... View more

hive databases not showing via beeline/hiveserver2

by Contributor in Support Questions
‎03-17-2021 11:47 AM
‎03-17-2021 11:47 AM
Hi experts, I am trying to upgrade my current hive version from 1.2 to 2.3.8. I am able to connect to hive via hiveserver2 but when I do "show databases", there are no databases showing up.   0: jdbc:hive2://test02.domain.com:100> show databases; +----------------+ | database_name | +----------------+ +----------------+ No rows selected (0.124 seconds) 0: jdbc:hive2://test02.domain.com:100>   When accessing the mysql database I can see the databases in hive. mysql> use hive; Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -A Database changed mysql> select * from DBS; +-------+-----------------------+-------------------------------------------+---------+------------+------------+ | DB_ID | DESC | DB_LOCATION_URI | NAME | OWNER_NAME | OWNER_TYPE | +-------+-----------------------+-------------------------------------------+---------+------------+------------+ | 1 | Default Hive database | hdfs://test/apps/hive/warehouse | default | public | ROLE | | 6 | NULL | hdfs://test/apps/hive/warehouse/test.db | test | anonymous | USER | | 11 | NULL | hdfs://test/apps/hive/warehouse/test1.db | test1 | anonymous | USER | +-------+-----------------------+-------------------------------------------+---------+------------+------------+ 3 rows in set (0.00 sec)   I have already updated the mysql schema with the script provided. mysql> select * from VERSION; +--------+----------------+----------------------------+ | VER_ID | SCHEMA_VERSION | VERSION_COMMENT | +--------+----------------+----------------------------+ | 1 | 2.3.0 | Hive release version 2.3.0 | +--------+----------------+----------------------------+ 1 row in set (0.00 sec)   When I switch back to the older version of hive 1.2, I am able to see the databases via beeline/hiveserver2.   Can someone please let me know what I am missing? Any help is much appreciated. Thanks, ... View more

Re: Hive CLI error

by Contributor in Support Questions
‎03-15-2021 02:03 PM
‎03-15-2021 02:03 PM
Thanks @Shelton for the response. I believe I had already tried this. I tried to replace the ambari tez configuration again but still the same error. Also our production cluster currently has the old value, but for some reason the production cluster is working fine. ... View more

Re: Hive CLI error

by Contributor in Support Questions
‎03-15-2021 11:59 AM
‎03-15-2021 11:59 AM
I have about 7 nodes in the cluster HDP version 2.6.1.0-129   And I have recently deployed a new cluster. When trying to access the hiveCLI, the "incompatible" error came from the application logs.   2021-03-15 11:40:46,401 [INFO] [main] |app.DAGAppMaster|: Comparing client version with AM version, clientVersion=0.7.0.2.6.1.0-129, AMVersion=0.8.4.2.6.1.0-129 2021-03-15 11:40:46,402 [ERROR] [main] |app.DAGAppMaster|: Incompatible versions found, clientVersion=0.7.0.2.6.1.0-129, AMVersion=0.8.4.2.6.1.0-129 And this is the error that I got when tried to run hive CLI in the terminal on one of the nodes in the cluster.   [root@test02 ~]# hive Picked up _JAVA_OPTIONS: -Xmx2048m -XX:MaxPermSize=512m -Djava.awt.headless=true Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 Picked up _JAVA_OPTIONS: -Xmx2048m -XX:MaxPermSize=512m -Djava.awt.headless=true Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 log4j:WARN No such property [maxFileSize] in org.apache.log4j.DailyRollingFileAppender. Logging initialized using configuration in file:/etc/hive/2.6.1.0-129/0/hive-log4j.properties Exception in thread "main" java.lang.RuntimeException: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. No cluster diagnostics found. at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:560) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. No cluster diagnostics found. at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:699) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:218) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:557) ... 8 more ... View more

Re: YARN resourcemanager error

by Contributor in Support Questions
‎03-15-2021 11:53 AM
‎03-15-2021 11:53 AM
Thanks @GangWar for the response. What if we do not have Oozie installed in the cluster? Would I still be able to run the commands in the link? ... View more

Hive CLI error

by Contributor in Support Questions
‎03-15-2021 07:44 AM
‎03-15-2021 07:44 AM
Hi experts, I have been having trounble accessing the hiveCLI with tez and I found this in the application logs.   2021-03-15 09:28:10,781 [ERROR] [main] |app.DAGAppMaster|: Incompatible versions found, clientVersion=0.7.0.2.6.1.0-129, AMVersion=0.8.4.2.6.1.0-129   Can someone please tell me how to resolve this?   Thanks, ... View more

hiveCLI not working with tez but works with mapred...

by Contributor in Support Questions
‎03-14-2021 01:04 PM
‎03-14-2021 01:04 PM
Hi experts, I am having issues accessing the hive CLI when using tez but it works with mapreduce. I get the following error: [root@test02 ~]# hive Picked up _JAVA_OPTIONS: -Xmx2048m -XX:MaxPermSize=512m -Djava.awt.headless=true Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 Picked up _JAVA_OPTIONS: -Xmx2048m -XX:MaxPermSize=512m -Djava.awt.headless=true Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 log4j:WARN No such property [maxFileSize] in org.apache.log4j.DailyRollingFileAppender. Logging initialized using configuration in file:/etc/hive/2.6.1.0-129/0/hive-log4j.properties Exception in thread "main" java.lang.RuntimeException: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. No cluster diagnostics found. at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:560) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. No cluster diagnostics found. at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:699) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:218) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:557) ... 8 more [root@test02 ~]#   Any help is much appreciated.   Thanks, ... View more

Re: Hive installation error

by Contributor in Support Questions
‎03-02-2021 09:21 AM
‎03-02-2021 09:21 AM
Thanks @GangWar for the response. Definitely helps. While trying to initialize the metastore, I am now getting the following error after running the following command: [root@test02 bin]# ./schematool -dbType mysql -initSchema -passWord <<password>> -userName <<username>> --verbose The connection to the metastore seems successful but the schema initialization failed. Error: Duplicate key name 'PCS_STATS_IDX' (state=42000,code=1061) Closing: 0: jdbc:mysql://test.domain.com/hive?createDatabaseIfNotExist=true org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !! Underlying cause: java.io.IOException : Schema script failed, errorcode 2 org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !! at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:590) at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:563) at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1145) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: java.io.IOException: Schema script failed, errorcode 2 at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:980) at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:959) at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:586) ... 8 more *** schemaTool failed *** ... View more
Contact Me
Online
Offline
Last Visited
‎10-19-2023 07:39 AM
Community Statistics
Member Since ‎02-02-2021 04:11 PM
Last Visited ‎10-19-2023 07:39 AM
Posts 116
Kudos received 2