question SparkSession class not found in spark-sql-2.1 in Archives of Support Questions (Read Only)

SparkSession class not found in spark-sql-2.1

RaviPapisetti — Fri, 16 Sep 2022 12:22:03 GMT

Hi,

Unable to import SparkSession class that is available from Spark-sql version 2.x. Here is my gradle entry:

sparkVersion = '1.6.0-cdh5.11.0'

spark_sql = "org.apache.spark:spark-sql_2.10:$sparkVersion"

Here I assume spark-sql_2.10 is spark 2.x version, not 1.6.

When I expanded spark-sql_2.10-1.6.0-cdh5.11.0-sources.jar, i don't see SparkSession class in org.apache.spark.sql package.

Can you please clarify when I am not able to see SparkSession class or point to right repository etnry.

Appreciate your help.

Thanks,

Ravi Papisetti

Re: SparkSession class not found in spark-sql-2.1

RaviPapisetti — Mon, 09 Oct 2017 23:23:46 GMT

This issue got resolved after changing to spark 2.1 version. I understand that in cloudera mvn artifactory, number associated to spark-core-2.10 is scala version, 1.6.0 associated with CDH is spark version.

Re: SparkSession class not found in spark-sql-2.1

tyagim — Tue, 03 Apr 2018 12:41:48 GMT

can you post your maven dependencies for spark?