We try to enable LLAP but HiveServer2 Interactive server fails to start, the errors shows that  Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server_interactive.py", line 616, in <module> HiveServerInteractive().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server_interactive.py", line 121, in start status = self._llap_start(env) File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server_interactive.py", line 271, in _llap_start code, output, error = shell.checked_call(cmd, user=params.hive_user, quiet = True, stderr=subprocess.PIPE, logoutput=True) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hdp/current/hive-server2-hive2/bin/hive --service llap --slider-am-container-mb 1024 --size 36864m --cache 5980m --xmx 28672m --loglevel INFO --output /var/lib/ambari-agent/tmp/llap-slider2019-12-19_06-29-37 --slider-placement 0 --skiphadoopversion --skiphbasecp --instances 1 --logger query-routing --args " -XX:+AlwaysPreTouch -Xss512k -XX:+UseG1GC -XX:TLABSize=8m -XX:+ResizeTLAB -XX:+UseNUMA -XX:+AggressiveOpts -XX:InitiatingHeapOccupancyPercent=40 -XX:G1ReservePercent=20 -XX:MaxGCPauseMillis=200 -XX:MetaspaceSize=1024m"' returned 3. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/2.6.1.0-129/hive2/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/2.6.1.0-129/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value WARN cli.LlapServiceDriver: Ignoring unknown llap server parameter: [hive.aux.jars.path] WARN cli.LlapServiceDriver: Java versions might not match : JAVA_HOME=[/usr/java/jdk1.8.0_161],process jre=[/usr/java/jdk1.8.0_161/jre] WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value Failed: java.lang.NullPointerException java.util.concurrent.ExecutionException: java.lang.NullPointerException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.hadoop.hive.llap.cli.LlapServiceDriver.run(LlapServiceDriver.java:613) at org.apache.hadoop.hive.llap.cli.LlapServiceDriver.main(LlapServiceDriver.java:113) Caused by: java.lang.NullPointerException at org.apache.hadoop.hive.llap.cli.LlapServiceDriver.downloadPermanentFunctions(LlapServiceDriver.java:661) at org.apache.hadoop.hive.llap.cli.LlapServiceDriver.access$300(LlapServiceDriver.java:84) at org.apache.hadoop.hive.llap.cli.LlapServiceDriver$4.call(LlapServiceDriver.java:463) at org.apache.hadoop.hive.llap.cli.LlapServiceDriver$4.call(LlapServiceDriver.java:455) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)  and we have found that zookeeper node /hiveserver2-hive2 not create.is this the reason that hiverserver2 interactive fails to start?Any help would be appieciated. ... View more

After upgrade hdp from 2.4.2.0 to 2.6.1.0,ranger web ui become unavailble.The new ranger admin installed on other machines is accessible. Is it because of conflict with the previous version?Thanks in advance. ERROR in xa_portal.log: ERROR org.springframework.web.context.ContextLoader (ContextLoader.java:331) - Context initialization failed org.springframework.beans.factory.BeanDefinitionStoreException: Invalid bean definition with name 'loggingDataSource' defined in ServletContext resource [/META-INF/applicationContext.xml]: C ould not resolve placeholder 'ranger.jpa.audit.jdbc.url' in string value "${ranger.jpa.audit.jdbc.url}"; nested exception is java.lang.IllegalArgumentException: Could not resolve placeholder 'ranger.jpa.audit.jdbc.url' in string value "${ranger.jpa.audit.jdbc.url}" ... View more

There are ranger hbase-plugin with AD but no kerberos in our environment. We have found that authentication only works for OS users but not for AD users. Must hbase authentication enable kerberos? Doesn't hbase support AD authention? ... View more

Our cluster version is hdp-2.6.1, ambari-2.5.1. When the user executes the hadoop fs -mkdir command, an error occurs which is "create gc thread. out of system resources". We know that when the value of HADOOP_CLIENT_HEAP_SIZE is too small, the hadoop fs -ls command will appear OOM, but our cluster's HADOOP_CLIENT_HEAP_SIZE has been set to 8G, which we think is already a large enough value. We checked the user's ulimit, the maximum number of open files is 11000, and the maximum number of processes is 1024, but the number of processes at the time of the problem is unknown. Is the reason for the emergence of OOM not the two mentioned above? Is there any other possible reason? ... View more

After adding a new data disk on the datanode, there is a corrupt blocks[1] on the ambari UI, but hdfs fsck / (even with the -includeSnapshot option) still shows There is no broken block, we restarted the ambari server, the ambari agent, the ambari metrics, still useless. Please help, thank you very much. ... View more