Reply
Explorer
Posts: 62
Registered: ‎01-22-2014
Accepted Solution

Unable to use the Spark Conecxt Variable in the Spark-Shell (Scala) in CDH5.1

Hi,

 

I am using Spark 1.0.0 in a CDH 5.1 VM.  I am trying to use the Spark-Shell (Scala). But I am getting the below error regularly and not able to use thecontect variable

 

Please assist.

 

Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_55)
Type in expressions to have them evaluated.
Type :help for more information.
Spark context available as sc.

scala> val text = sc.textfile("/user/cloudera/test1")
<console>:12: error: value textfile is not a member of org.apache.spark.SparkContext
val text = sc.textfile("/user/cloudera/test1")

 

Cloudera Employee
Posts: 366
Registered: ‎07-29-2013

Re: Unable to use the Spark Conecxt Variable in the Spark-Shell (Scala) in CDH5.1

Announcements