Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

ERROR ApplicationMaster: User class threw exception: org.elasticsearch.hadoop.EsHadoopIllegalStateException: No HTTP-enabled data nodes found....

Highlighted

ERROR ApplicationMaster: User class threw exception: org.elasticsearch.hadoop.EsHadoopIllegalStateException: No HTTP-enabled data nodes found....

New Contributor

Hi Hortonworks Community ,

I am trying to read data from elasticsearch cluster by spark2. But when I ran the job, I had error the following:

ERROR ApplicationMaster: User class threw exception: org.elasticsearch.hadoop.EsHadoopIllegalStateException: No HTTP-enabled data nodes found; if you are using client-only nodes make sure to configure es-hadoop as such through [es.nodes.client.only] property
 org.elasticsearch.hadoop.EsHadoopIllegalStateException: No HTTP-enabled data nodes found; if you are using client-only nodes make sure to configure es-hadoop as such through [es.nodes.client.only] property
     at org.elasticsearch.hadoop.rest.RestRepository.doGetReadTargetShards(RestRepository.java:295)
     at org.elasticsearch.hadoop.rest.RestRepository.getReadTargetShards(RestRepository.java:276)

My config es:

private def setUpSparkConf(esHost: String, esPort: String, esIndex: String, esType: String): SparkConf = {
val sparkConf = new SparkConf().setAppName("es-export")
.set("spark.yarn.executor.memoryOverhead", "5000")
.set("spark.yarn.driver.memoryOverhead", "5000")
.set("spark.es.resource", esIndex + "/" + esType)
.set("spark.es.nodes", esHost)
.set("spark.es.port", esPort)
sparkConf
}

With esHost: <ipdress>, esPort: 9200 (http port).

Thank you,

Don't have an account?
Coming from Hortonworks? Activate your account here