About guntaka

guntaka · ‎01-18-2018

@Jay Kumar SenSharma The unlink and re-install doesn't seem to work. It gives me an error saying "The directory already exists and it's not a symlink". As I mentioned earlier, it's being created when I hit install but ahead of time. Is there any reason why this is happening? I'm using HDP-2.6.4 and Ambari-2.5.2

guntaka · ‎01-18-2018

@Jay Kumar SenSharmaThis symlink dates to the current installation not a remain of the previous install.Just curious on why this is causing a conflict.

guntaka · ‎01-18-2018

@Jay Kumar SenSharmaIt’s a symlink. How do I handle a symlink?

guntaka · ‎01-18-2018

The install part is failing at the zookeeper client install using ambari-blueprints. It says mkdir: cannot create directory `/usr/hdp/current/zookeeper-client': File exists Here's the error log from the Ambari UI zookeeper-err.txt.

guntaka · ‎11-14-2017

Is there a difference between the kafka-connector in the python module and the confluent's one? This is the gihub link for the one mentioned in the python module,

guntaka · ‎11-14-2017

I see Flume is deprecated and will be removed from HDP in the future releases as mentioned in the HDP-2.6.2-Release Notes. Are there any other techniques that could be used with kafka to get data into HDFS?

guntaka · ‎11-14-2017

Setting to 6667 worked. Thanks

guntaka · ‎11-13-2017

I'm looking for ways to get data from Kafka to Python. Currently I'm using this pipeline. Has anyone faced issues with using Flume? Flume(exec-source and Kafka-sink) --> Kafka --> Flume(kafka-source and HDFS-sink) Other options: In case I have a kafka-consumer written, is there a python way of getting the data from Kafka consumer to HDFS (other than Confluent's Connect API)? Or are there any other means I can get the data from Kafka t HDFS?

guntaka · ‎11-13-2017

The listener port is 6667. and I'm using 9092 for the bootstrap server when I try to produce messages. The kafka server starts fine and give this error after a while.

guntaka · ‎11-10-2017

@dbains The listeners is using the default port 9092. The producer is not producing messages is what I observed. When I start the console producer it just goes blank showing nothing. The only thing I see in the logs is this. [2017-11-10 14:07:21,947] INFO [Group Metadata Manager on Broker 1001]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager)

Online	Offline
Last Visited	‎03-04-2019 08:27 PM

Member Since	‎10-20-2017 06:06 PM
Last Visited	‎03-04-2019 08:27 PM
Posts	59

Cloudera Community

Re: Zookeeper client Install failed: cannot create...

Re: Zookeeper client Install failed: cannot create...

Re: Zookeeper client Install failed: cannot create...

Zookeeper client Install failed: cannot create dir...

Re: Ways to get data from Kafka to HDFS

Re: Ways to get data from Kafka to HDFS

Re: Kafka on HDP 2.6,2 doesn't consume messages fr...

Ways to get data from Kafka to HDFS

Re: Kafka on HDP 2.6,2 doesn't consume messages fr...

Re: Kafka on HDP 2.6,2 doesn't consume messages fr...