Member since
05-30-2018
26
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9500 | 06-01-2018 05:48 AM |
06-14-2018
05:09 AM
I am using normal kafka in ubuntu. I created /home/kafka/bin/tmp/a.txt Then tried to produce it as bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test < /tmp/a.txt But it gives me same error as bash: /tmp/a.txt: No such file or directory
... View more
06-12-2018
04:48 AM
Hi @Vinicius Higa Murakami I removed zookeeper,kafka and their respective log directories. I installed zookeeper and kafka again. So for the first time messages were consumed and published too on the terminal interface. After that I stopped kafka and restarted kafka again... from this point the message is not getting consumed. Why this is happening ? This is very unusal from kafka 😞
... View more
06-11-2018
10:47 AM
I am following https://kafka.apache.org/quickstart and few weeks earlier everything was working well, but when I started it over again today is not working, I am using kafka_2.11-1.1.0.
I created the new topic 'rahul' with the following command : bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic rahul
Created topic "rahul" I also re-checked the topics with bin/kafka-topics.sh --list --zookeeper localhost:2181 `__consumer_offsets
rahhy
rahul` started the producer: bin/kafka-console-producer.sh --broker-list localhost:9092 --topic rahul
hey
>hi
>hello But when the time comes to consumer to show the messages: there is nothing although the command seems to be executed, but no messages. bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic rahul --from-beginning
I even tried consuming both ways as zookeeper and bootstrap server, but none of them are giving messages published.
... View more
Labels:
- Labels:
-
Apache Kafka
06-09-2018
10:16 AM
@Vinicius Higa Murakami Actually The data is in influxdb ...so how the data can come from influxdb to kafka and then finally into HDFS ?
... View more
06-09-2018
06:35 AM
I understood the concept of `Producer` and `Consumer` done by you manually above and also by referring to Step 3,4 and 5 in https://kafka.apache.org/quickstart
But referring to
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_kafka-component-guide/content/ch_kafka-development.html
Do I need to put codes of `Producer` and `Consumer` from this link to a `gedit` file, so that data can be send from Kafka to HDFS ??
... View more
06-08-2018
01:05 PM
1 Kudo
I want to push data into HDFS through Kakfa. So I not getting how to first get data into kafka, if the data format is csv/xsl what should be the procedure to get that data into kafka and further push it in HDFS ?
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Kafka
06-07-2018
03:10 PM
@Vinicius I m right now at a beginner stage of learning kafka. Just running a single instance on my local system ...havn't thought of working on clusters. But It is nice to get in touch with u and enhance my knowledge. Thanks once again 🙂
... View more
06-07-2018
11:53 AM
its working Thank you experts @Felix Albani and @Vinicius Higa Murakami
... View more
06-07-2018
06:00 AM
Yes, it is working as a root user Thanks @Vinicius Higa Murakami
... View more