@lweichberger, I suspect the same about the version mismatch. https://spark.apache.org/docs/2.3.0/streaming-kafka-0-8-integration.html As per the example given in above link, when I create the streaming context ssc = StreamingContext(sc, 5) I get the JavaAbstractMethodError from py4j. Using spark-sql-kafka, I can get the structured stream with new API. But I like to fix the existing version issue. ... View more