Trying to find a solution similar to what Streams Messaging Manager provides for monitoring Kafka and Spark streams for Cloudera distribution or opensource community.
Have worked with Kafka Manager, but it does not give the message flow. The API does not have extended features. Is there a better approach to monitor or analyse the Kafka & Spark streaming data flows ?
SMM is indeed the best way to monitor Kafka.
If you start from scratch or have HDP/HDF it is quite easy to put SMM on top.
If you are a CDH user I would advise you to contact your local Cloudera contact to discuss what is possible/desirable in your specific situation.