Hi All, i am trying drill-jdbc connectivity through java code. Error is:- java.sql.SQLException: Failure in connecting to Drill: oadd.org.apache.drill.exec.rpc.RpcException: CONNECTION : java.net.ConnectException: Connection refused: no further information: localhost/127.0.0.1:31010 So the steps followed are below:- wget http://www-eu.apache.org/dist/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz tar -xvf apache-drill-1.12.0.tar.gz cd apache-drill-1.12.0 cd bin ./drillbit.sh start -Ddrill.exec.http.port=8765 To check check its running under zookeeeper cd /usr/hdp/current/zookeeper-client ./zkCli.sh ls /drill In apache-drill-1.12.0/bin started drill-localhost # ./drill-localhost received contents "OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 apache drill 1.12.0" normal database queries were working properly is there any dependancy between jdk -version? Java Code:- import java.sql.*; public class DrillJDBCExample { static final String JDBC_DRIVER = "org.apache.drill.jdbc.Driver"; static final String DB_URL = "jdbc:drill:drillbit=localhost:";//"jdbc:drill:zk=localhost:2181"; //"jdbc:drill:drillbit=localhost"; static final String USER = "admin"; static final String PASS = "admin"; public static void main(String[] args) throws ClassNotFoundException, SQLException { /* Class.forName("org.apache.drill.jdbc.Driver"); Connection connection =DriverManager.getConnection("jdbc:drill:drillbit=127.0.0.1:8765"); Statement st = connection.createStatement(); ResultSet rs = st.executeQuery("SELECT * from cp.`employee`"); while(rs.next()){ System.out.println(rs.getString(1)); } }*/ Connection conn = null; Statement stmt = null; try{ Class.forName(JDBC_DRIVER); conn = DriverManager.getConnection(DB_URL,USER,PASS); stmt = conn.createStatement(); // Perform a select on data in the classpath storage plugin. String sql = "select employee_id,first_name,last_name from cp.`employee.json`"; ResultSet rs = stmt.executeQuery(sql); while(rs.next()) { int id = rs.getInt("employee_id"); String first = rs.getString("first_name"); String last = rs.getString("last_name"); System.out.print("ID: " + id); System.out.print(", First: " + first); System.out.println(", Last: " + last); } rs.close(); stmt.close(); conn.close(); } catch(SQLException se) { //Handle errors for JDBC se.printStackTrace(); } catch(Exception e) { //Handle errors for Class.forName e.printStackTrace(); } finally { try{ if(stmt!=null) stmt.close(); } catch(SQLException se2) { } try { if(conn!=null) conn.close(); } catch(SQLException se) { se.printStackTrace(); } } } } Error Logs:- SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. java.sql.SQLException: Failure in connecting to Drill: oadd.org.apache.drill.exec.rpc.RpcException: HANDSHAKE_COMMUNICATION : Channel closed /127.0.0.1:60181 <--> localhost/127.0.0.1:8765. at org.apache.drill.jdbc.impl.DrillConnectionImpl.<init>(DrillConnectionImpl.java:162) at org.apache.drill.jdbc.impl.DrillJdbc41Factory.newDrillConnection(DrillJdbc41Factory.java:64) at org.apache.drill.jdbc.impl.DrillFactory.newConnection(DrillFactory.java:69) at oadd.net.hydromatic.avatica.UnregisteredDriver.connect(UnregisteredDriver.java:126) at org.apache.drill.jdbc.Driver.connect(Driver.java:72) at java.sql.DriverManager.getConnection(Unknown Source) at java.sql.DriverManager.getConnection(Unknown Source) at com.mapr.drill.DrillJDBCExample.main(DrillJDBCExample.java:29) Caused by: oadd.org.apache.drill.exec.rpc.RpcException: HANDSHAKE_COMMUNICATION : Channel closed /127.0.0.1:60181 <--> localhost/127.0.0.1:8765. at oadd.org.apache.drill.exec.client.DrillClient$FutureHandler.connectionFailed(DrillClient.java:675) at oadd.org.apache.drill.exec.rpc.user.QueryResultHandler$ChannelClosedHandler.connectionFailed(QueryResultHandler.java:389) at oadd.org.apache.drill.exec.rpc.BasicClient$ConnectionMultiListener$HandshakeSendHandler.failed(BasicClient.java:254) at oadd.org.apache.drill.exec.rpc.RequestIdMap$RpcListener.setException(RequestIdMap.java:134) at oadd.org.apache.drill.exec.rpc.RequestIdMap$SetExceptionProcedure.apply(RequestIdMap.java:74) at oadd.org.apache.drill.exec.rpc.RequestIdMap$SetExceptionProcedure.apply(RequestIdMap.java:64) at oadd.com.carrotsearch.hppc.IntObjectHashMap.forEach(IntObjectHashMap.java:692) at oadd.org.apache.drill.exec.rpc.RequestIdMap.channelClosed(RequestIdMap.java:58) at oadd.org.apache.drill.exec.rpc.RemoteConnection.channelClosed(RemoteConnection.java:175) at oadd.org.apache.drill.exec.rpc.RpcBus$ChannelClosedHandler.operationComplete(RpcBus.java:167) at oadd.org.apache.drill.exec.rpc.RpcBus$ChannelClosedHandler.operationComplete(RpcBus.java:146) at oadd.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) at oadd.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:567) at oadd.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:406) at oadd.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:82) at oadd.io.netty.channel.AbstractChannel$CloseFuture.setClosed(AbstractChannel.java:943) at oadd.io.netty.channel.AbstractChannel$AbstractUnsafe.doClose0(AbstractChannel.java:592) at oadd.io.netty.channel.AbstractChannel$AbstractUnsafe.close(AbstractChannel.java:584) at oadd.io.netty.channel.DefaultChannelPipeline$HeadContext.close(DefaultChannelPipeline.java:1099) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeClose(AbstractChannelHandlerContext.java:615) at oadd.io.netty.channel.AbstractChannelHandlerContext.close(AbstractChannelHandlerContext.java:600) at oadd.io.netty.channel.ChannelOutboundHandlerAdapter.close(ChannelOutboundHandlerAdapter.java:71) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeClose(AbstractChannelHandlerContext.java:615) at oadd.io.netty.channel.AbstractChannelHandlerContext.close(AbstractChannelHandlerContext.java:600) at oadd.io.netty.channel.ChannelDuplexHandler.close(ChannelDuplexHandler.java:73) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeClose(AbstractChannelHandlerContext.java:615) at oadd.io.netty.channel.AbstractChannelHandlerContext.close(AbstractChannelHandlerContext.java:600) at oadd.io.netty.channel.AbstractChannelHandlerContext.close(AbstractChannelHandlerContext.java:466) at oadd.org.apache.drill.exec.rpc.RpcExceptionHandler.exceptionCaught(RpcExceptionHandler.java:39) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:275) at oadd.io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:253) at oadd.io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:275) at oadd.io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:253) at oadd.io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:275) at oadd.io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:253) at oadd.io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:275) at oadd.io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:253) at oadd.io.netty.channel.ChannelHandlerAdapter.exceptionCaught(ChannelHandlerAdapter.java:79) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:275) at oadd.io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:253) at oadd.io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:275) at oadd.io.netty.channel.AbstractChannelHandlerContext.notifyHandlerException(AbstractChannelHandlerContext.java:809) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:341) at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324) at oadd.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:242) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339) at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324) at oadd.io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339) at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324) at oadd.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:847) at oadd.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131) at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511) at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468) at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382) at oadd.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354) at oadd.io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) at java.lang.Thread.run(Unknown Source) Caused by: oadd.org.apache.drill.exec.rpc.ChannelClosedException: Channel closed /127.0.0.1:60181 <--> localhost/127.0.0.1:8765. at oadd.org.apache.drill.exec.rpc.RpcBus$ChannelClosedHandler.operationComplete(RpcBus.java:166) ... 52 more Followed documents are:- 1) https://drill.apache.org/docs/ 2) https://community.hortonworks.com/articles/10551/apache-drill-unofficial-introduction.html ... View more

Hi , i am trying to add service Ambari metric Service for hdp2.6.3. - got 1 alert PFA. hbase-alert.png - i was able to start AMS service -so i tried to acess http:127.0.0.1:6188 got below logs from "/var/log/ambari-metrics-monitor/ambari-metrics-monitor.out" 2018-03-05 16:05:55,395 [INFO] emitter.py:154 - Calculated collector shard based on hostname : sandbox-hdp.hortonworks.com 2018-03-05 16:05:55,399 [WARNING] emitter.py:146 - Error sending metrics to server. [Errno 111] Connection refused 2018-03-05 16:05:55,399 [WARNING] emitter.py:111 - Retrying after 5 ... 2018-03-05 16:06:00,400 [WARNING] emitter.py:146 - Error sending metrics to server. [Errno 111] Connection refused 2018-03-05 16:06:00,401 [WARNING] emitter.py:111 - Retrying after 5 ... 2018-03-05 16:06:05,403 [WARNING] emitter.py:146 - Error sending metrics to server. [Errno 111] Connection refused 2018-03-05 16:06:05,403 [WARNING] emitter.py:111 - Retrying after 5 ... 2018-03-05 16:06:10,405 [WARNING] emitter.py:120 - Metric collector host sandbox-hdp.hortonworks.com was blacklisted. 2018-03-05 16:06:10,405 [INFO] emitter.py:96 - No valid collectors found... - got few refernces fro whitelisting https://cwiki.apache.org/confluence/display/AMBARI/Ambari+Metrics+-+Whitelisting but it is for whitelisting apps not the hosts or ip address. Thanks , Sharda ... View more

Hi i was trying to install presto on hdp2.6.3 Presto CLI got installed successfully but while executing any query it is giving below errors. [root@sandbox-hdp ~]# /usr/lib/presto/bin/presto-cli --catalog hive --schema default presto:default> show tables; Error running command: Error starting query at http://localhost:8080/v1/statement returned an invalid response: JsonResponse{statusCode=404, statusMessage=Not Found, headers={X-Frame-Options=[DENY], Pragma=[no-cache], X-XSS-Protection=[1; mode=block], Content-Length=[45], X-Content-Type-Options=[nosniff], Content-Type=[text/plain;charset=ISO-8859-1]}, hasValue=false, value=null} [Error: { "status": 404, "message": "Not Found" }] i don't know why it is taking http://localhost:8080 in configuration i gave different values as "http-server.http.port= 8081" Discovery.URI value given is "http://sandbox-hdp.hortonworks.com:8081" Thanks, Sharda ... View more

Hi , i was trying to install presto in hdp 2.6.3 . failed the installation for presto worker install: error: resource_management.core.exceptions.ExecutionFailed: Execution of 'export JAVA8_HOME=/usr/jdk64/jdk1.8.0_112 && rpm -i /tmp/presto-server-rpm-0.161.rpm' returned 1. package presto-server-rpm-0:0.161-1.x86_64 is already installed steps followed for installing presto service:- Steps:- download ambari-presto-1.2.tar.gz create directory PRESTO # mkdir /var/lib/ambari-server/resources/stacks/HDP/2.6/services/PRESTO # cd /var/lib/ambari-server/resources/stacks/HDP/2.6/services/PRESTO/ untar ambari-presto in recently created directory # tar -xvf ambari-presto-1.2.tar.gz -C /var/lib/ambari-server/resources/stacks/HDP/2.6/services/PRESTO/ move ambari-presto files in PRESTO/ # mv /var/lib/ambari-server/resources/stacks/HDP/2.6/services/PRESTO/ambari-presto-1.2/* /var/lib/ambari-server/resources/stacks/HDP/2.6/services/PRESTO remove ambari-presto # rm -rf /var/lib/ambari-server/resources/stacks/HDP/2.6/services/PRESTO/ambari-presto-1.2 # chmod -R +x /var/lib/ambari-server/resources/stacks/HDP/2.6/services/PRESTO/* change below files in configs - jvm.config add :- "-DHADOOP_USER_NAME=hive" - /etc/ambari-server/conf/ambari.properties :- "agent.package.install.task.timeout=5000" - even after this you may get a error regarding jdk version incompatibility steps followed to resolve this # ambari-server setup # select option to configure jdk and install jdk 1.8 update https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-administration/content/ch_changing_the_jdk_version_on_an_existing_cluster.html restart ambari server to apply changes # ambari-server restart login to ambari UI Click on add service select Presto click next followed configurations as per https://prestodb.io/ambari-presto-service/getting-started.html Thanks, Sharda ... View more

Hi , i was trying to work on hdp services just to try for a long time i was trying to check whether curl is working or not hdp 2.6.3 + hdp2.5 i tried random commands to check network connectivity. below are the command which i tried :- [root@sandbox-hdp knox-server]# curl localhost curl localhost curl: (7) couldn't connect to host [root@sandbox-hdp knox-server]# curl 127.0.0.1 curl: (7) couldn't connect to host [root@sandbox-hdp knox-server]# curl google.com <HTML><HEAD><meta http-equiv="content-type" content="text/html;charset=utf-8"> <TITLE>302 Moved</TITLE></HEAD><BODY> <H1>302 Moved</H1> The document has moved <A HREF="http://www.google.co.in/?gfe_rd=cr&dcr=0&ei=UTFnWsWoD8-L8Qes5J3IBw">here</A>. </BODY></HTML> How to resolve curl localhost for hdp or is it intentionally kept it that way.? ping is working for localhost and private ip addresses but curl is not working for localhost and private ip addresses in the hdp host-vm network. ... View more