Member since
07-11-2018
1
Post
0
Kudos Received
0
Solutions
07-11-2018
07:01 AM
i have written scala program to load data from rdbms to elasticsearch but showing error like error: value saveToEs is not a member of org.apache.spark.sql.DataFrame here is my program... import org.apache.spark.SparkContext import org.elasticsearch.spark.rdd.EsSpark
spark.conf.set("es.index.auto.create", "true") val elasticOptions = Map("es.mapping.id" -> "id",
"es.nodes" -> "localhost",
"es.port" -> "9200",
"es.index.auto.create" -> "yes"
) val sqlContext = new org.apache.spark.sql.SQLContext(sc) val mydata = sqlContext.load("jdbc", Map("url" ->"jdbc:postgresql://localhost:5432/testdb?user=postgres&password=postgres", "dbtable" -> "mytable")) mydata.saveToEs(s"$elasticIndex/$elasticMappingLib", elasticOptions)
... View more