I am trying to test performance of a spark streaming application that I wrote which reads/writes data to Kafka. Code is working fine but I cannot see the Streaming tab in the UI. I am using Ambari, but I am assuming this is Spark feature. I am using Spark /usr/hdp/184.108.40.206-91/spark2/. Please let me know if I have missed to configure anything.
I looked at the Spark Streaming code. Wondering if there is version mismatch between Spark and Kafka or something is causing this tab to not appear. Cannot even find the error "Parent SparkUI to attach this tab to not found!"