Kafka connect

[#1]

I have a use case where i need to move data from a mysql database to Hbase on a realtime basis using kafka as the intemediate data store. Will Kafka connect help to achieve this usecase.

[#2 · Accepted solution]

@ARUN

You can take the following references to achieve the same using MySQL -->Kafka --> HBase:

1). https://github.com/wushujames/kafka-mysql-connector

2) https://github.com/mravi/kafka-connect-hbase

.

If you are open for other options like using "sqoop" then you can refer to the following as well:

1). https://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_importing_data_into_hbase

2). http://www.dummies.com/programming/big-data/hadoop/importing-data-into-hbase-with-sqoop/

3). https://acadgild.com/blog/how-to-import-table-from-mysql-to-hbase/

.

[#3]

Thanks @Jay SenSharma, It helps, our case is more of realtime in nature. so the usage of sqoop is not possible