Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

kafka real time with cloudera and IBM MQ

kafka real time with cloudera and IBM MQ

New Contributor

Is it possible to capture IBM MQ data with Kafka-Cloudera?

 

The confluent company offers a "IBM MQ Connector" to capture IBM MQ data, but I'm not sure if I can do the same with Kafka-Cloudera.

 

4 REPLIES 4
Highlighted

Re: kafka real time with cloudera and IBM MQ

Super Collaborator
You can use the flume jms source (http://flume.apache.org/FlumeUserGuide.html#jms-source) to consume messages of the IBM MQ queue and either use a kafka channel or kafka sink to send those messages to kafka.

-pd

Re: kafka real time with cloudera and IBM MQ

New Contributor

I understand, but what about this connectorIs it possible to integrate it into Cloudera?

Re: kafka real time with cloudera and IBM MQ

Super Collaborator
It is possible to use it, although kafka connect isn't officially supported by cloudera:

https://www.cloudera.com/documentation/kafka/latest/topics/kafka_known_issues.html

-pd

Re: kafka real time with cloudera and IBM MQ

New Contributor

I understand.

 

and if instead of using Kafka I bet for spark streaming? I see that there is also a connector for MQ, is it compatible with Cloudera?