Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How the Client can access Kafka through knox?

Highlighted

How the Client can access Kafka through knox?

Contributor

Here are more details:

I have Knox installed on edge node and Kafka was installed on NameNode. Client wants to access Kafka via knox gate way. Can some one please let me know which steps need to be followed

3 REPLIES 3
Highlighted

Re: How the Client can access Kafka through knox?

Knox does not support Kafka at this point in time. I was about to say why would you do such a thing But then I realized that there can be some valid usecases for small volume topics that should be consumed from outside the cluster.

https://knox.apache.org/books/knox-0-8-0/user-guide.html

First Kafka would need a REST consumer API there seem to be an implementation from confluence:

http://docs.confluent.io/1.0/kafka-rest/docs/intro.html

https://github.com/confluentinc/kafka-rest

You could then write a knox service for it if you really wanted to.

https://knox.apache.org/books/knox-0-8-0/dev-guide.html

Highlighted

Re: How the Client can access Kafka through knox?

Contributor

Thank you. Let me check

Highlighted

Re: How the Client can access Kafka through knox?

Explorer

It's been a while since this question was asked. Does Knox now "play nicer" with Kafka? Regardless of volume, it would sure be nice to insulate sources that want to push data to the HDP/HDF ecosystem from kerberos.

Don't have an account?
Coming from Hortonworks? Activate your account here