Reply
Highlighted
New Contributor
Posts: 1
Registered: ‎02-28-2018

spark-solr is not working

I want to push data to solr-6.3.0 using spark-1.6.0. httpclient-4.4.1 and httpcore-4.4.1 is used. i am getting below exception when i am doing spark submit.

 

Caused by: java.lang.AbstractMethodError
at org.apache.spark.Logging$class.log(Logging.scala:50)
at com.lucidworks.spark.util.SolrJsonSupport$.log(SolrJsonSupport.scala:22)
at com.lucidworks.spark.util.SolrJsonSupport$.getJson(SolrJsonSupport.scala:71)
at com.lucidworks.spark.util.SolrJsonSupport$.getJson(SolrJsonSupport.scala:34)
at com.lucidworks.spark.util.SolrQuerySupport$.getUniqueKey(SolrQuerySupport.scala:86)
at com.lucidworks.spark.rdd.SolrRDD.<init>(SolrRDD.scala:32)
at com.lucidworks.spark.SolrRelation.<init>(SolrRelation.scala:79)
at solr.DefaultSource.createRelation(DefaultSource.scala:39)
at org.apache.spark.sql.execution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:222)
at org.apache.spark.sql.DataFrameWriter.dataSource$lzycompute$1(DataFrameWriter.scala:181)
at org.apache.spark.sql.DataFrameWriter.org$apache$spark$sql$DataFrameWriter$$dataSource$1(DataFrameWriter.scala:181)
at org.apache.spark.sql.DataFrameWriter$$anonfun$save$1.apply$mcV$sp(DataFrameWriter.scala:188)
at org.apache.spark.sql.DataFrameWriter.executeAndCallQEListener(DataFrameWriter.scala:154)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:188)

 

Thanks,

M Rabindra

Announcements