Solace Integration with Spark Structured Streaming

eswarloges — Sat, 09 Jan 2021 17:24:12 GMT

Hi All,

I am new to solace and spark structured streaming. I would like to write a solace consumer using spark structured streaming and with the below code

var df = spark.readStream.format("solacestream").load

I am getting java.lang.ClassNotFoundException: solacestream.DefaultSource

Any hint of the format of the solace jms and how to pass in the connection parameters as option to the spark will be helpful. Thanks

Re: Solace Integration with Spark Structured Streaming

eswarloges — Tue, 12 Jan 2021 11:21:51 GMT

After initial read on Spark Structured Streaming , for custom receivers class named DefaultSource should be present in the package mentioned in the format of readStream.

question Solace Integration with Spark Structured Streaming in Support Questions

Solace Integration with Spark Structured Streaming

Re: Solace Integration with Spark Structured Streaming