Member since
01-18-2020
10
Posts
0
Kudos Received
0
Solutions
05-06-2022
09:11 AM
Hi guys, I am not able to see YARN Cluster Utilization Report on CDP after kerberos (active directory) is enabled. Earlier it was working fine. Cloudera Manager showing warning : Bad : Failed to run MapReduce job to aggregate YARN container usage metrics. The service monitor logs showing error: IllegalArgumentException: Null real user I have verified that MapReduce Job User specified in yarn configs is a linux user present on all cluster nodes and also have principal created on AD. Also, Container Usage Metrics are getting generated at /tmp/cmYarnContainerMetrics. But I can see that no mapreduce job output generated at Output Directory "/tmp/cmYarnContainerMetricsAggregate" after enabling kerberos. Any idea why? Below is the complete stack trace: 2022-05-06 21:00:32,833 WARN com.cloudera.cmon.firehose.polling.yarn.YarnUsageAggregator: Failed to run MapReduce job for yarn
java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Null real user
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at com.cloudera.cmon.firehose.polling.yarn.YarnUsageAggregator.doWork(YarnUsageAggregator.java:367)
at com.cloudera.cmon.firehose.polling.yarn.YarnUsageAggregator.doWork(YarnUsageAggregator.java:79)
at com.cloudera.cmon.firehose.polling.AbstractFileSystemClientTask.doWorkWithClientConfig(AbstractFileSystemClientTask.java:55)
at com.cloudera.cmon.firehose.polling.AbstractCdhWorkUsingClientConfigs.doWork(AbstractCdhWorkUsingClientConfigs.java:45)
at com.cloudera.cmon.firehose.polling.CdhTask$InstrumentedWork.doWork(CdhTask.java:229)
at com.cloudera.cmf.cdhclient.CdhExecutor$SecurityWrapper$1.run(CdhExecutor.java:189)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
at com.cloudera.cmf.cdh7client.security.UserGroupInformationImpl.doAs(UserGroupInformationImpl.java:42)
at com.cloudera.cmf.cdhclient.CdhExecutor$SecurityWrapper.doWork(CdhExecutor.java:186)
at com.cloudera.cmf.cdhclient.CdhExecutor$1.call(CdhExecutor.java:125)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalArgumentException: Null real user
at org.apache.hadoop.security.UserGroupInformation.createProxyUser(UserGroupInformation.java:1489)
at com.cloudera.cmf.cdh7client.security.UserGroupInformationImpl.createProxyUser(UserGroupInformationImpl.java:67)
at com.cloudera.cmf.cdh7client.CDH7ObjectFactoryImpl.createProxyUser(CDH7ObjectFactoryImpl.java:91)
at com.cloudera.cmf.cdhclient.util.ImpersonatingTaskWrapper.doWork(ImpersonatingTaskWrapper.java:95)
... 11 more Thanks, Az
... View more
Labels:
05-31-2020
03:18 AM
Hi, Can you please have look at this: HBase 2nd Incremental Backup/Restore not Working
... View more
05-20-2020
01:42 PM
@Moka Have you resolved your issue? What steps did you followed?
... View more
04-29-2020
03:39 AM
Hi Victor, did you find the solution. We are also into the same scenario and unable to install kerberos on HDP 3.1 though same steps worked smoothly on HDP 2.6. Kindly suggest if any recommendations.
... View more
01-18-2020
01:40 PM
Have you resolved your issue? I am facing the same issue. Any suggestion would be very helpful. Thanks in advance!
... View more