Member since
08-29-2019
1
Post
0
Kudos Received
0
Solutions
08-29-2019
05:31 AM
Hello Recently we've an error in oozie when we run spark application. Cluster is kerberoized, Is there any config parameter passed to oozie job to let spark job successfully connect to the secured Oozie server? 79022 [Driver] ERROR org.apache.spark.deploy.yarn.ApplicationMaster - User class threw exception: IO_ERROR : java.io.IOException: Error while connecting Oozie server. No of retries = 1. Exception = Could not authenticate, org.apache.hadoop.security.authentication.client.AuthenticationException: Invalid SPNEGO sequence, status code: 403 IO_ERROR : java.io.IOException: Error while connecting Oozie server. No of retries = 1. Exception = Could not authenticate, org.apache.hadoop.security.authentication.client.AuthenticationException: Invalid SPNEGO sequence, status code: 403 at org.apache.oozie.client.OozieClient$ClientCallable.call(OozieClient.java:569) at org.apache.oozie.client.OozieClient.getCoordJobInfo(OozieClient.java:1415) at com.obs.edh.utils.watchdog.services.OozieService$$anonfun$5.apply(OozieService.scala:76) at com.obs.edh.utils.watchdog.services.OozieService$$anonfun$5.apply(OozieService.scala:76) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at com.obs.edh.utils.watchdog.services.OozieService.getCleanCoordinators(OozieService.scala:76) at com.obs.edh.utils.watchdog.services.RerunService.launch(RerunService.scala:42) at com.obs.edh.utils.watchdog.app.Main$.main(Main.scala:19) at com.obs.edh.utils.watchdog.app.Main.main(Main.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$4.run(ApplicationMaster.scala:721) Caused by: java.io.IOException: Error while connecting Oozie server. No of retries = 1. Exception = Could not authenticate, org.apache.hadoop.security.authentication.client.AuthenticationException: Invalid SPNEGO sequence, status code: 403 at org.apache.oozie.client.retry.ConnectionRetriableClient.execute(ConnectionRetriableClient.java:66) at org.apache.oozie.client.OozieClient.createRetryableConnection(OozieClient.java:504) at org.apache.oozie.client.OozieClient$ClientCallable.call(OozieClient.java:560)
... View more
Labels: