Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

CHD 5.4.2 spark, kafka to Hbase example error

CHD 5.4.2 spark, kafka to Hbase example error

New Contributor

I'm follow this link "Using Spark and Kafka" section to dump data from kafka, spark to Hbase

In this line

val ssc = new StreamingContext(master, "MetricAggregatorTest", Seconds(2),
      System.getenv("SPARK_HOME"), StreamingContext.jarOfClass(this.getClass))

I  get error

 

<console>:31: error: type mismatch; found   : Option[String] required: Seq[String]
Error occurred in an application involving default arguments.
             System.getenv("SPARK_HOME"), StreamingContext.jarOfClass(this.getClass))
                                                             ^

 How could I get correct return result with jarOfClass?

1 REPLY 1

Re: CHD 5.4.2 spark, kafka to Hbase example error

Master Guru
The referenced example seems too old for the current Spark versions. Please checkout the Cloudera Labs' SparkOnHBase project instead: https://github.com/cloudera-labs/SparkOnHBase