Reply
Highlighted
Explorer
Posts: 7
Registered: ‎08-24-2017

Deploy Kafka Streams application

I'm using Cloudera Enterprise v5.10.1 including Kafka.  We're developing some Kafka streams applications that consumer from Kafka topics, are robust, scalable and performant.  Currently these applications are being deployed using an Oozie workflow and essentially run forever (ie. I don't use a coordinator).  Essentially if I want to scale it up I can just launch another instance using Oozie.

 

My question is there a better way to deploy Kafka streams application in Cloudera v5.10.1?  I know there are frameworks like Mesos, Docker, etc... but not sure how well it would fit in with Cloudera.

Announcements