Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

SPNEGO ERROR when spark client conenct to oozie in Kerberized cluster

New Contributor
Hello Recently we've an error in oozie when we run spark application. Cluster is kerberoized, Is there any config parameter passed to oozie job to let spark job successfully connect to the secured Oozie server? 79022 [Driver] ERROR org.apache.spark.deploy.yarn.ApplicationMaster - User class threw exception: IO_ERROR : java.io.IOException: Error while connecting Oozie server. No of retries = 1. Exception = Could not authenticate, org.apache.hadoop.security.authentication.client.AuthenticationException: Invalid SPNEGO sequence, status code: 403 IO_ERROR : java.io.IOException: Error while connecting Oozie server. No of retries = 1. Exception = Could not authenticate, org.apache.hadoop.security.authentication.client.AuthenticationException: Invalid SPNEGO sequence, status code: 403 at org.apache.oozie.client.OozieClient$ClientCallable.call(OozieClient.java:569) at org.apache.oozie.client.OozieClient.getCoordJobInfo(OozieClient.java:1415) at com.obs.edh.utils.watchdog.services.OozieService$$anonfun$5.apply(OozieService.scala:76) at com.obs.edh.utils.watchdog.services.OozieService$$anonfun$5.apply(OozieService.scala:76) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at com.obs.edh.utils.watchdog.services.OozieService.getCleanCoordinators(OozieService.scala:76) at com.obs.edh.utils.watchdog.services.RerunService.launch(RerunService.scala:42) at com.obs.edh.utils.watchdog.app.Main$.main(Main.scala:19) at com.obs.edh.utils.watchdog.app.Main.main(Main.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$4.run(ApplicationMaster.scala:721) Caused by: java.io.IOException: Error while connecting Oozie server. No of retries = 1. Exception = Could not authenticate, org.apache.hadoop.security.authentication.client.AuthenticationException: Invalid SPNEGO sequence, status code: 403 at org.apache.oozie.client.retry.ConnectionRetriableClient.execute(ConnectionRetriableClient.java:66) at org.apache.oozie.client.OozieClient.createRetryableConnection(OozieClient.java:504) at org.apache.oozie.client.OozieClient$ClientCallable.call(OozieClient.java:560)
1 REPLY 1

Cloudera Employee

Hello @deebify 

 

You can add the credentials to the workflow.

 

See example here.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.