SparkContext giving error in initialization : org.apache.hadoop.ipc.StandbyException

Question

while running a normal spark job SparkContext is not getting initialized giving below error:

[Thread-6] ERROR org.apache.spark.SparkContext - Error initializing SparkContext.
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby.

I believe it is pointing to standby NN.

This error is coming after we enabled Namenode HA in our cloudera's cluster.

I have checked hive-site.xml, core-site.xml and spark-defaults.xml.

These all are havinf correct configs pointing to nameservice id.

EricL · Accepted Answer

Hmm, looks like Spark is not able to reach to NN, are both of your NN up and running? Can you run normal HDFS commands and operations?

Can you also share the spark-defaults.conf file which is under /etc/spark/conf or /etc/spark2/conf directory for review?

Thanks

EricL · Answer

@yukti1,Are you able to share full spark log so that we can see a bit more context? Hitting SBNN is common, but it should be back to Active NN after that, and it should not be causing failure. I suspect there is something else, so full log might help to understand a bit more.CheersEric

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.