Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Structured Streaming - Spark 2.0

Structured Streaming - Spark 2.0

New Contributor

Does Cloudera recommend using Structured Streaming in production for any of its latest CDH distributions? Or is it still not supported by Cloudera? Structured Streaming was released with Spark 2.0 in mid 2016

5 REPLIES 5

Re: Structured Streaming - Spark 2.0

Rising Star

Hi Mark,

 

Structured Streaming isn't currently supported by Cloudera: https://www.cloudera.com/documentation/spark2/latest/topics/spark2_known_issues.html#ki_structured_s...

 

It has been in the code base since Spark 2.0, but even the latest release (2.1.1) says that it is an 'alpha' component: http://spark.apache.org/docs/latest/structured-streaming-programming-guide.html

 

Jeremy

Highlighted

Re: Structured Streaming - Spark 2.0

New Contributor
Hi Jeremy.

Do you know when in the road map will this be supported?

Re: Structured Streaming - Spark 2.0

New Contributor

Hi @Jeremy Beard, I ask the same question as @Nkululeko. Do you know when spark structured streaming will be available?

Re: Structured Streaming - Spark 2.0

New Contributor

Hello @Jeremy Beard ,

 

Is there any update to this subject on the Structured Streaming support in Cloudera?

 

Thanks,

 

Alex

Re: Structured Streaming - Spark 2.0

Rising Star

Hi Alex,

 

Yes, Structured Streaming is supported by Cloudera as of Spark 2.4, which is currently available in CDH 6.1.

 

Jeremy