Hi,   I'm planning to use the provided Kafka service in HDP 2.6.5.    My use case is to have multiple producers pushing events to Kafka topics and have the data pushed to HDFS as a sink.   Is this flow achievable using what's provided by HDP out of the box?  I was looking at Confluent, but it's way too complicated for my use case.     Thanks. ... View more

Hi all, I'm facing difficulties in connecting to Hiveserver2 JDBC and Hiveserver2 interactive JDBC URLs on my HDP 2.6.5 cluster. Using DBeaver, I'm able to connect directly to port 10000 of Hive server. Connecting to the URLs shown in Hive summary page (port 2181) in Ambari throws several the following exception: Could not open client transport with JDBC Uri: jdbc:hive2://nn1.int.net:2181: null I'm using hive-uber JAR from https://github.com/timveil/hive-jdbc-uber-jar/releases; which works fine connecting to Hive service on port 10000. No issues connecting via beeline. Is there something I'm missing? Thanks. ... View more

Hi all, I have HDP2.6 running. I've configured Hiveserver2 authentication to use PAM. I've set hive.server2.authentication.pam.services=passwd. When I use beeline to connect to hive instance, hive-server2.err shows the following stacktrace: Exception in thread "HiveServer2-Handler-Pool: Thread-118" java.lang.NoClassDefFoundError: Could not initialize class net.sf.jpam.Pam at org.apache.hive.service.auth.PamAuthenticationProviderImpl.Authenticate(PamAuthenticationProviderImpl.java:43) at org.apache.hive.service.auth.PlainSaslHelper$PlainServerCallbackHandler.handle(PlainSaslHelper.java:106) at org.apache.hive.service.auth.PlainSaslServer.evaluateResponse(PlainSaslServer.java:102) at org.apache.thrift.transport.TSaslTransport$SaslParticipant.evaluateChallengeOrResponse(TSaslTransport.java:539) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:283) at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) I've checked hive log (hiveserver2.log) and upon startup, I could see that jpam-1.1.jar is specified in the classpath. Is there something I'm missing? Thanks. ... View more