Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.
saipardhu147
New Contributor

Kafka setup Multibroker on multiple servers AWS EC...

by New Contributor in Support Questions
‎01-19-2018 07:50 PM
‎01-19-2018 07:50 PM
Hi I was trying to setup my kafka cluster on multiple servers as brokers. I'm not really sure what should be the configurations for this scenario. I checked online and on official Apache website but it only has the setup for multibroker within the same server but not that I wanted to. Could anyone please help me with this. It'd be highly appreciated. My current setup: server.properties:(Have the same setting on all my nodes with different broker.id and respective host.name) broker.id=0 host.name=master delete.topic.enable=true log.dirs=/home/ec2-user/data/kafka/kafka-logs zookeeper.connect=master:2181,slave:2181,slave1:2181,slave2:2181 zookeeper.properties: dataDir=/home/ec2-user/data/zookeeper clientPort=2181 maxClientCnxns=0 Thanks ... View more
Labels:

Re: Error while connecting Hive using JDBC in R sc...

by New Contributor in Support Questions
‎12-29-2017 01:44 AM
‎12-29-2017 01:44 AM
@Jay Kumar SenSharma. Thanks, the connection to 10000 was refused when I did telnet. Also i don't see anything running on that port when I did netstat. Apparently, I didn't know that hiveserver2 must be started explicitly and hence was the error. Do you know what is the property that needs to added to hive-site.xml inorder for me to access the web UI? Nevertheless, thank you very much. You've helped me great. ... View more

Error while connecting Hive using JDBC in R script

by New Contributor in Support Questions
‎12-28-2017 10:13 PM
‎12-28-2017 10:13 PM
Hi I have an R script that tries to connect to hive using JDBC to pull tables from the hive and perform some processing on the data. However I'm getting an error at the connection part and am not really sure how to resolve this. Tried different sources on net but couldn't find an answer. Below is my R code where the error appears and also the error seen on the screen. cp = c(paste0(BASE_PATH, JAR_DIRECTORY, HADOOP_COMMON_JAR), paste0(BASE_PATH, JAR_DIRECTORY, HIVE_JDBC_JAR)) .jinit(classpath=cp) drv <- JDBC("org.apache.hive.jdbc.HiveDriver", paste0(BASE_PATH, JAR_DIRECTORY, HIVE_JDBC_JAR), identifier.quote="`") conn <- dbConnect(drv, "jdbc:hive2://10.0.1.10:10000") //Error is here Error: Error in .jcall(drv@jdrv, "Ljava/sql/Connection;", "connect", as.character(url)[1], : java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://xx.x.x.x:10000: java.net.ConnectException: Connection refused (Connection refused) Calls: dbConnect -> dbConnect -> .local -> .jcall -> .jcheck -> . Call Execution halted Any help would be appreciated and I'm happy to provide more insights if required Thanks ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎01-19-2018 07:50 PM
Public Statistics
Date Registered ‎12-28-2017 10:11 PM
Last Visited ‎01-19-2018 07:50 PM
Total Messages Posted 3