Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Need Solution to Push Real Time Data from Kafka to DB2

Highlighted

Need Solution to Push Real Time Data from Kafka to DB2

New Contributor

Usecase:

Real time data needs to push from Apache kafka to DB2 9.1.6. There might be couple of business logics will apply after fetching the data from kafka. What is the best solution to do this usecase? How efficiently DB2 can handle the real time data?

One of the Option:

  1. Kafka -> Spark streaming(processing) -> DB2 9.1.6
2 REPLIES 2
Highlighted

Re: Need Solution to Push Real Time Data from Kafka to DB2

Mentor

@Vikas Reddy

Confluent has some amazing solutions jdbc,REST,Sinks and source connectors that I think is mature.Syncsort has a DB2 certified connector but you can combine a bunch of technics with Kafka connect to achieve.

https://docs.confluent.io/current/connect/index.html

https://www.confluent.io/product/connectors/

The above links are good resources.

Hope that helps

Re: Need Solution to Push Real Time Data from Kafka to DB2

Rising Star

I would suggest you NiFi. It is available as HDF by Hortonworks. It is very easy to be used since it is a graphical tool, it allows real time solutions and data transformation. It has a built in connector for Kafka and a built in JDBC connector you can use to write to DB2.

Don't have an account?
Coming from Hortonworks? Activate your account here