Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

Datameer-Yarn2-Kerberos Integration issues

avatar
Contributor

Hello All,

 

I configured the cluste CDH 5.0.0 with kerberos and intergrated with Datameer all works  without kerberos but when I enable the kerberos, they job gets launced and finished but for some reason it is not giving below  error on datameer dashboard but the example PI runs from unix command prompt for datameer user id. 

 

Please give me some direction to move forward - kind of stuk for a week without able to move forward with YARN2/Kerberos/Datameer but same environment works with MRv1 with kerberos.

 

[anonymous]  INFO [2014-07-19 10:04:38.803] [MrPlanRunnerThread-0] (ClientServiceDelegate.java:273) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
[anonymous]  INFO [2014-07-19 10:04:38.918] [MrPlanRunnerThread-0] (ClientServiceDelegate.java:273) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
[anonymous]  INFO [2014-07-19 10:04:38.935] [pool-6-thread-1] (HdfsUploader.java:42) - Push job-log to hdfs://10.131.108.48:8020/user/datameer/joblogs/70/007-job.log
[anonymous]  WARN [2014-07-19 10:04:39.030] [MrPlanRunnerThread-0] (UserGroupInformation.java:1551) - PriviledgedActionException as:datameer/chapdc3hdpnm01.ops.tiaa-cref.org@HADOOP.TIAA-CREF.K5.ORG (auth:KERBEROS) cause:java.io.IOException: org.apache.hadoop.ipc.RemoteException(java.lang.NullPointerException): java.lang.NullPointerException
	at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getTaskAttemptCompletionEvents(HistoryClientService.java:272)
	at org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getTaskAttemptCompletionEvents(MRClientProtocolPBServiceImpl.java:173)
	at org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:283)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1026)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1986)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1982)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1980)

[anonymous]  INFO [2014-07-19 10:04:39.031] [MrPlanRunnerThread-0] (DelegateInputFormat.java:106) - Releasing splits (UUID: 82f442f9-096d-48b8-b16a-c4d958784eb8)  from cache, still cached split-arrays: 0
[anonymous]  INFO [2014-07-19 10:04:39.099] [MrPlanRunnerThread-0] (ClientServiceDelegate.java:273) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
[anonymous]  INFO [2014-07-19 10:04:39.215] [MrPlanRunnerThread-0] (ClientServiceDelegate.java:273) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
[anonymous]  INFO [2014-07-19 10:04:39.329] [MrPlanRunnerThread-0] (ClientServiceDelegate.java:273) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
[anonymous]  WARN [2014-07-19 10:04:39.441] [MrPlanRunnerThread-0] (UserGroupInformation.java:1551) - PriviledgedActionException as:datameer/chapdc3hdpnm01.ops.tiaa-cref.org@HADOOP.TIAA-CREF.K5.ORG (auth:KERBEROS) cause:java.io.IOException: org.apache.hadoop.ipc.RemoteException(java.lang.NullPointerException): java.lang.NullPointerException
	at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getCounters(HistoryClientService.java:223)
	at org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getCounters(MRClientProtocolPBServiceImpl.java:159)
	at org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:281)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1026)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1986)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1982)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1980)
Who agreed with this topic