I noticed that Spark Structured *Stateful* Streaming is not working in CDH 6.3.0. The states are not getting timed out as expected when I use:
mapGroupsWithState
This feature is available in Spark 2.4.1.
Which version of CDH would this work in? In other words which version of CDH contains Spark 2.4.1?