question Will Spark SQL be officially supported in CDH6.0? in Archives of Support Questions (Read Only)

Will Spark SQL be officially supported in CDH6.0?

Rod — Fri, 16 Sep 2022 13:24:33 GMT

Since the spark sql binary is not shipped with CDH6.0 I wonder whether it is officially supported.

Re: Will Spark SQL be officially supported in CDH6.0?

saranvisa — Tue, 03 Jul 2018 11:05:06 GMT

@Rod

CDH 6.0 will support Spark 2.2.0 and Spark 2.2.0 will support Spark SQL as per below link

https://spark.apache.org/docs/2.2.0/sql-programming-guide.html#sql

Not sure this is the answer for your question, if not, please give some more details

Re: Will Spark SQL be officially supported in CDH6.0?

Rod — Tue, 03 Jul 2018 22:19:34 GMT

Well... that means it might work. My question is more whether it is going to be officially supported by Cloudera. In the sense that if some problems or incompatibilities are found Cloudera will be responsible for fixing them. To be more precise I am asking about Spark SQL CLI.

Re: Will Spark SQL be officially supported in CDH6.0?

Rod — Tue, 03 Jul 2018 22:25:54 GMT

The question refers in particular to Spark SQL CLI. As of now, the Spark SQL CLI is not shipped with CDH6 and it is known to NOT be supported in some of the previous versions. Is it supported in CDH6?

Re: Will Spark SQL be officially supported in CDH6.0?

AutoIN — Fri, 06 Jul 2018 03:34:17 GMT

@Rod No, it is unsupported (as of writing) in both CDH5 and CDH6.

https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_600_unsupported_features.html#spark

Spark SQL CLI is not supported