Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark streaming triggering another spark job continuosly after reading the topic

Spark streaming triggering another spark job continuosly after reading the topic

New Contributor

Hi All,

I am doing a spark Structured to read some data from Topic. Irrespective of the data present in the topic I want to trigger another spark job from the streaming job. Once message is coming My streaming is able to read and trigger a spark job(hardcoded) but when the kafka message produce another message after 1 hour,it should read and retrigger that job(which is hardcoded as a child job inside streaming job).but this is not happening. Streaming job is nt reading . We are using spark 2.2 in hortonworks cluster.