@Tongzhou Zhou Try this: 1. Ensure hive-site.xml in hive-conf dir and spark-conf is identical, below command should not return anything. diff /etc/hive/conf/hive-site.xml /etc/spark2/conf/hive-site.xml 2. Invoke REPL spark session (pyspark or spark-shell) $pyspark 3. Show hive databases spark.sql("show databases") Are you able to access hive tables now? ... View more

After commenting below properties it's works for me as well. ## To be commented out when not using [user] block / paintext passwordMatcher = org.apache.shiro.authc.credential.PasswordMatcher iniRealm.credentialsMatcher = $passwordMatcher ... View more

After copying hive-site.xml from hive-conf dir to spark-conf dir, I restarted the spark services that reverted those changes, I copied hive-site.xml again and it's working now. cp /etc/hive/conf/hive-site.xml /etc/spark2/conf ... View more

I tried starting HS2 after setting JAVA_HOME but it did not help. 2018-09-14 08:29:31: Starting HiveServer2 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Hive Session ID = d410dd44-b3ed-4c73-a391-f414da52f946 Hive Session ID = c7b15435-16b1-4f74-ac9a-a5f5fb09af35 Hive Session ID = 2bbef091-f52a-44a6-b1af-d1f78b30fb88 Hive Session ID = 4b405953-cf8d-4d72-a10c-49ccf873e03b Hive Session ID = cc1d904c-b920-42da-8787-c9be4afabc2b This is error what I see when I invoke Hive : Error: org.apache.hive.jdbc.ZooKeeperHiveClientException: Unable to read HiveServer2 configs from ZooKeeper (state=,code=0) ... View more

Thanks @Jay Kumar SenSharma for your prompt responses! I have manually validated hive-site.xml, it has correct entry. Later I started hiveserver2 services as suggested manually. Here is what I see in nohup.out file. +======================================================================+ | Error: JAVA_HOME is not set | +----------------------------------------------------------------------+ | Please download the latest Sun JDK from the Sun Java web site | | > http://www.oracle.com/technetwork/java/javase/downloads | | | | HBase requires Java 1.8 or later. | +======================================================================+ 2018-09-13 23:25:07: Starting HiveServer2 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Hive Session ID = a7aa8a99-1a27-42b9-977a-d545742d1747 Hive Session ID = 41c8d3d5-e7ca-42df-acd5-2b8d1f23220c Hive Session ID = 84951be6-015e-4634-a4de-6a6f18d51bb8 Hive Session ID = 1964a526-53da-4b50-90a9-9bc90142e2ff Hive Session ID = f6188f9b-f3a9-43ec-a9ef-6a8a87a01498 I see JAVA_HOME not set error in nohup.out file, So ran the below command to set the JAVA_HOME and reran the command to start hiveserver2 manually, this time I did not get Error: JAVA_HOME is not set but still facing same issue. Do you suggest any other solution for this? My ambari dashboard looks like this (Image Attached), This cluster is running since 36 hours but no job ran because Hive is not working. Does this n/a and not data available is fine? All the links eg. resource manage, namenode web interface information. data node information are available and are showing correct information. FYI - Initially I was installing Hive Metastore(MySQL) and HiveServer2 service on worker2 node but had issue while testing connection to metastore (DBConnectionVerification.jar file issue) so moved metastore and service to master and that issue got resolved. ... View more

I have validated hive.server2.support.dynamic.service.discovery is true (check-box is selected) and I am still facing the same issue. ... View more

I am also facing same issue. After login into zk command like. I could only see below content. I can't see HS2 [zk: localhost:2181(CONNECTED) 10] ls / [registry, ambari-metrics-cluster, zookeeper, zk_smoketest, rmstore] [zk: localhost:2181(CONNECTED) 11] Could you Please help me on this? When I was starting HiveServer2 first time after installation I got below error. Tried multiple times but HS2 was never able to start. Traceback (most recent call last): File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/decorator.py", line 54, in wrapper return function(*args, **kwargs) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_service.py", line 189, in wait_for_znode raise Fail(format("ZooKeeper node /{hive_server2_zookeeper_namespace} is not ready yet")) Fail: ZooKeeper node /hiveserver2 is not ready yet The above exception was the cause of the following exception: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_server.py", line 137, in <module> HiveServer().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute method(env) File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 993, in restart self.start(env, upgrade_type=upgrade_type) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_server.py", line 53, in start hive_service('hiveserver2', action = 'start', upgrade_type=upgrade_type) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_service.py", line 101, in hive_service wait_for_znode() File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/decorator.py", line 62, in wrapper return function(*args, **kwargs) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_service.py", line 189, in wait_for_znode raise Fail(format("ZooKeeper node /{hive_server2_zookeeper_namespace} is not ready yet")) resource_management.core.exceptions.Fail: ZooKeeper node /hiveserver2 is not ready yet ... View more