About rk241091

rk241091 · ‎06-14-2018

I am using normal kafka in ubuntu. I created /home/kafka/bin/tmp/a.txt Then tried to produce it as bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test < /tmp/a.txt But it gives me same error as bash: /tmp/a.txt: No such file or directory

rk241091 · ‎06-12-2018

Hi @Vinicius Higa Murakami I removed zookeeper,kafka and their respective log directories. I installed zookeeper and kafka again. So for the first time messages were consumed and published too on the terminal interface. After that I stopped kafka and restarted kafka again... from this point the message is not getting consumed. Why this is happening ? This is very unusal from kafka 😞

rk241091 · ‎06-11-2018

I am following https://kafka.apache.org/quickstart and few weeks earlier everything was working well, but when I started it over again today is not working, I am using kafka_2.11-1.1.0. I created the new topic 'rahul' with the following command : bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic rahul Created topic "rahul" I also re-checked the topics with bin/kafka-topics.sh --list --zookeeper localhost:2181 `__consumer_offsets rahhy rahul` started the producer: bin/kafka-console-producer.sh --broker-list localhost:9092 --topic rahul hey >hi >hello But when the time comes to consumer to show the messages: there is nothing although the command seems to be executed, but no messages. bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic rahul --from-beginning I even tried consuming both ways as zookeeper and bootstrap server, but none of them are giving messages published.

rk241091 · ‎06-11-2018

Okay... I will work upon it. I will let you know the progess 🙂

rk241091 · ‎06-09-2018

@Vinicius Higa Murakami Actually The data is in influxdb ...so how the data can come from influxdb to kafka and then finally into HDFS ?

rk241091 · ‎06-09-2018

I understood the concept of `Producer` and `Consumer` done by you manually above and also by referring to Step 3,4 and 5 in https://kafka.apache.org/quickstart But referring to https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_kafka-component-guide/content/ch_kafka-development.html Do I need to put codes of `Producer` and `Consumer` from this link to a `gedit` file, so that data can be send from Kafka to HDFS ??

rk241091 · ‎06-08-2018

I want to push data into HDFS through Kakfa. So I not getting how to first get data into kafka, if the data format is csv/xsl what should be the procedure to get that data into kafka and further push it in HDFS ?

rk241091 · ‎06-07-2018

@Vinicius I m right now at a beginner stage of learning kafka. Just running a single instance on my local system ...havn't thought of working on clusters. But It is nice to get in touch with u and enhance my knowledge. Thanks once again 🙂

rk241091 · ‎06-07-2018

its working Thank you experts @Felix Albani and @Vinicius Higa Murakami

rk241091 · ‎06-07-2018

Yes, it is working as a root user Thanks @Vinicius Higa Murakami

rk241091 · ‎06-07-2018

Yes, it is working as a root user Thanks @Felix Albani

rk241091 · ‎06-06-2018

when I am trying to start kafka with the following command : `bin/kafka-server-start.sh config/server.properties` I am getting this error every time Cannot open file /opt/kafka_2.11-1.1.0/bin/../logs/kafkaServer-gc.log due to Permission denied. how to fix this ...

rk241091 · ‎06-05-2018

When trying to use kafka connect using following command : bin /connect-standalone .sh config /connect-standalone .properties config /connect-file-source .properties config /connect-file-sink .properties It throws a error as `WARN FAILED http_8083@773e2eb5{HTTP/1.1}{0.0.0.0:8083}: java.net.BindException: Address already in use (org.eclipse.jetty.util.component.AbstractLifeCycle:212)` and finally ends with the line `INFO Kafka Connect stopped` How can I change my Kafka-Connect port from 8083 to other port ?

rk241091 · ‎06-04-2018

While going through the apache official page <https://kafka.apache.org/quickstart> A text file is created as `echo -e "foo\nbar" > test.txt` And to use kakfa connect following command is used `bin/connect-standalone.sh config/connect-standalone.properties config/connect-file-source.properties config/connect-file-sink.properties` But while above command gets executed it shows a message kafka-connect stopped

rk241091 · ‎06-04-2018

Thanks @Abdelkrim Hadjidj I understood the difference 🙂

rk241091 · ‎06-02-2018

Kafka uses Producer/Consumer concept whime MQTT uses Subscribe/Publish concept ...so How Kafka is different from MQTT ? Can Kafka handle more works than MQTT with its features ?

rk241091 · ‎06-01-2018

Okay ! after a bit of search on stackoverflow I came across the command `sudo chown -R $USER:$USER /home/rahul/nifi-1.6.0` that will give the permission to the folder to alter the changes with permission to read and write, and Bingo !!! it worked . And after firing the command mentioned in above, there is no error as following : Exception in thread "main" java.io.IOException: /home/nifi-1.6.0/run directory does not have read/write privilege Thanks @Matt Clarke @Jay Kumar SenSharma

rk241091 · ‎06-01-2018

Still showing same error

rk241091 · ‎06-01-2018

I started nifi just now and it is showing too in the nifi-bootstrap.log I ran ps -ef|grep "TIME\|nifi-1" which gave following result as shown in the image, but still java.io.exception is there...

rk241091 · ‎05-31-2018

I have installed Nifi-1.6.0 and when I fire the command `./nifi.sh start` in terminal, it is showing `Exception in thread "main" java.io.IOException: /home/nifi-1.6.0/run directory does not have read/write privilege `. Although on browser GUI, Nifi is coming well on `localhost:8080/nifi `.

rk241091 · ‎05-31-2018

While I am making a dataflow from MQTT-FX to influxdb in Apache nifi, I am getting a error `Cannot automatically terminate 'Message' relationship because a Connection already exists with this relationship` while configuring the Consumemqtt processor. How to resolve this ?

rk241091 · ‎05-31-2018

Thank you Rob

rk241091 · ‎05-31-2018

Thanks Matt 🙂

rk241091 · ‎05-31-2018

I want to add a Influxdb processor in Apache Nifi. Kindly tell me how to proceed. I am using Apache nifi-1.4.0 and I need to add Influxdb processor .

rk241091 · ‎05-30-2018

Kindly help me with the procedure how to upgrade to latest Nifi version ? I have installed Nifi-1.4.0 but i need to update it to nifi-1.6.0 which is the latest version.

Online	Offline
Last Visited	‎06-14-2018 05:19 AM

Date Registered	‎05-30-2018 12:07 PM
Last Visited	‎06-14-2018 05:19 AM
Total Messages Posted	26
Total Kudos Received	1

Re: Exception in thread "main" java.io.IOException...

Re: how to push data (csv/xsl ) in kafka ?

Re: kafka consumer not showing the consumed messag...

kafka consumer not showing the consumed messages ?

Re: how to push data (csv/xsl ) in kafka ?

Re: how to push data (csv/xsl ) in kafka ?

Re: how to push data (csv/xsl ) in kafka ?

how to push data (csv/xsl ) in kafka ?

Re: How to resolve `java.net.BindException: Addres...

Re: How to resolve `java.net.BindException: Addres...

Re: Cannot open file /opt/kafka_2.11-1.1.0/bin/../...

Re: Cannot open file /opt/kafka_2.11-1.1.0/bin/../...

Cannot open file /opt/kafka_2.11-1.1.0/bin/../logs...

How to resolve `java.net.BindException: Address al...

Kafka connect not working ?

Re: how is Kafka different from Mosquitto(MQTT) ?

how is Kafka different from Mosquitto(MQTT) ?

Re: Exception in thread "main" java.io.IOException...

Re: Exception in thread "main" java.io.IOException...

Re: Exception in thread "main" java.io.IOException...

Exception in thread "main" java.io.IOException: /h...

Cannot automatically terminate 'Message' relations...

Re: How to upgrade to latest Nifi version ?

Re: How to upgrade to latest Nifi version ?

how to add influxdb processor in nifi-1.4.0 ?

How to upgrade to latest Nifi version ?