Failed To Generate Keytab file.

[#1]

Ambari: 2.7.1.0

HDF: 3.3

Cluster.json

{"blueprint": "bd-hdf", "Clusters": {"cluster_name": "HDFVivek"}, "host_groups": [{"hosts": [{"fqdn": "y.y.y.y"}], "name": "controller"}, {"hosts": [{"fqdn": "x.x.x.x"}], "name": "worker"}], "credentials": [{"alias": "kdc.admin.credential", "type": "TEMPORARY", "key": "test", "principal": "test/admin@z.z.z.z"}], "default_password": "hadoop", "security": {"type": "KERBEROS"}}

Blueprint.json

{"Blueprints": {"stack_name": "HDF", "stack_version": "3.3", "security": {"type": "KERBEROS"}}, "host_groups": [{"cardinality": "1", "name": "controller", "components": [{"name": "NIFI_MASTER"}, {"name": "DRPC_SERVER"}, {"name": "METRICS_COLLECTOR"}, {"name": "METRICS_GRAFANA"}, {"name": "KAFKA_BROKER"}, {"name": "ZOOKEEPER_SERVER"}, {"name": "STREAMLINE_SERVER"}, {"name": "METRICS_MONITOR"}, {"name": "SUPERVISOR"}, {"name": "NIFI_CA"}, {"name": "NIMBUS"}, {"name": "ZOOKEEPER_CLIENT"}, {"name": "NIFI_REGISTRY_MASTER"}, {"name": "REGISTRY_SERVER"}, {"name": "STORM_UI_SERVER"}], "configurations": []}, {"cardinality": "1+", "name": "worker", "components": [{"name": "METRICS_MONITOR"}, {"name": "SUPERVISOR"}, {"name": "ZOOKEEPER_SERVER"}, {"name": "STREAMLINE_SERVER"}, {"name": "KERBEROS_CLIENT"}], "configurations": []}], "configurations": [{"nifi-ambari-config": {"nifi.node.protocol.port": "9089", "nifi.node.port": "9092", "nifi.provenance.repository.dir.default": "/nifi/provenance_repository", "nifi.database.dir": "/nifi/database_repository", "nifi.content.repository.dir.default": "/nifi/content_repository", "nifi.flowfile.repository.dir": "/nifi/flowfile_repository", "nifi.max_mem": "1g", "nifi.security.encrypt.configuration.password": "admin@Admin1234", "nifi.internal.dir": "/nifi", "nifi.node.ssl.port": "9093"}}, {"nifi-registry-ambari-config": {"nifi.registry.security.encrypt.configuration.password": "admin@Admin1234"}}, {"ams-hbase-env": {"hbase_master_heapsize": "512", "hbase_regionserver_heapsize": "768", "hbase_master_xmn_size": "192"}}, {"streamline-logsearch-conf": {}}, {"storm-site": {"topology.metrics.consumer.register": "[{\"class\": \"org.apache.hadoop.metrics2.sink.storm.StormTimelineMetricsSink\", \"parallelism.hint\": 1, \"whitelist\": [\"kafkaOffset\\\\..+/\", \"__complete-latency\", \"__process-latency\", \"__execute-latency\", \"__receive\\\\.population$\", \"__sendqueue\\\\.population$\", \"__execute-count\", \"__emit-count\", \"__ack-count\", \"__fail-count\", \"memory/heap\\\\.usedBytes$\", \"memory/nonHeap\\\\.usedBytes$\", \"GC/.+\\\\.count$\", \"GC/.+\\\\.timeMs$\"]}]", "metrics.reporter.register": "org.apache.hadoop.metrics2.sink.storm.StormTimelineMetricsReporter", "storm.cluster.metrics.consumer.register": "[{\"class\": \"org.apache.hadoop.metrics2.sink.storm.StormTimelineMetricsReporter\"}]"}}, {"registry-common": {"registry.storage.connector.connectURI": "jdbc:mysql://y.y.y.y:3306/registry", "registry.storage.type": "mysql", "jar.storage.type": "local", "registry.storage.connector.password": "admin@Admin1234"}}, {"registry-env": {}}, {"registry-logsearch-conf": {}}, {"streamline-common": {"streamline.storage.connector.password": "admin@Admin1234", "streamline.storage.type": "mysql", "jar.storage.type": "local", "streamline.storage.connector.connectURI": "jdbc:mysql://y.y.y.y:3306/streamline", "registry.url": "http://y.y.y.y:7788/api/v1", "streamline.dashboard.url": "http://y.y.y.y:9089"}}, {"nifi-registry-properties": {"nifi.registry.db.password": "admin@Admin1234"}}, {"ams-hbase-site": {"hbase.regionserver.global.memstore.upperLimit": "0.35", "hbase.regionserver.global.memstore.lowerLimit": "0.3", "hbase.tmp.dir": "/var/lib/ambari-metrics-collector/hbase-tmp", "hbase.hregion.memstore.flush.size": "134217728", "hfile.block.cache.size": "0.3", "hbase.rootdir": "file:///var/lib/ambari-metrics-collector/hbase", "hbase.cluster.distributed": "false", "phoenix.coprocessor.maxMetaDataCacheSize": "20480000", "hbase.zookeeper.property.clientPort": "61181"}}, {"ams-env": {"metrics_collector_heapsize": "512"}}, {"streamline-env": {}}, {"ams-site": {"timeline.metrics.service.webapp.address": "localhost:6188", "timeline.metrics.cluster.aggregate.splitpoints": "kafka.network.RequestMetrics.ResponseQueueTimeMs.request.OffsetFetch.98percentile", "timeline.metrics.downsampler.event.metric.patterns": "topology\\.%", "timeline.metrics.host.aggregate.splitpoints": "kafka.network.RequestMetrics.ResponseQueueTimeMs.request.OffsetFetch.98percentile", "timeline.metrics.service.handler.thread.count": "20", "timeline.metrics.service.watcher.disabled": "false", "timeline.metrics.host.aggregator.ttl": "86400"}}, {"kafka-broker": {"offsets.topic.replication.factor": "1"}}, {"ams-grafana-env": {"metrics_grafana_password": "admin@Admin1234"}}, {"nifi-logsearch-conf": {}}, {"zoo.cfg": {}}, {"nifi-env": {"nifi_group": "mynifigroup", "nifi_user": "mynifiuser"}}, {"storm-env": {}}, {"kerberos-env": {"kdc_hosts": "p.p.p.p", "admin_server_host": "p.p.p.p", "realm": "z.z.z.z", "encryption_types": "aes128-cts-hmac-sha1-96 aes256-cts-hmac-sha1-96 arcfour-hmac des-cbc-md5 des-hmac-sha1 des3-cbc-sha1 rc4-hmac", "kdc_type": "mit-kdc", "properties_attributes": {}, "properties": {}, "manage_identities": "true"}}, {"krb5-conf": {"domains": "z.z.z.z", "manage_krb5_conf": "false", "properties_attributes": {}, "properties": {}}}]}

While creating cluster with the above blueprint.
keytabs failed to generate.

Error:

2019-04-16 01:48:04,344 INFO [Server Action Executor Worker 10] CreateKeytabFilesServerAction:193 - Creating keytab file for amsmon/x.x.x.x@z.z.z.z on host x.x.x.x

2019-04-16 01:48:04,364 WARN [Server Action Executor Worker 10] ServerActionExecutor:471 - Task #10 failed to complete execution due to thrown exception: java.lang.NullPointerException:null

java.lang.NullPointerException

at org.apache.ambari.server.serveraction.kerberos.CreateKeytabFilesServerAction.cacheKeytab(CreateKeytabFilesServerAction.java:420)

at org.apache.ambari.server.serveraction.kerberos.CreateKeytabFilesServerAction.createKeytab(CreateKeytabFilesServerAction.java:352)

at org.apache.ambari.server.serveraction.kerberos.CreateKeytabFilesServerAction.processIdentity(CreateKeytabFilesServerAction.java:244)

at org.apache.ambari.server.serveraction.kerberos.KerberosServerAction.processIdentities(KerberosServerAction.java:458)

at org.apache.ambari.server.serveraction.kerberos.CreateKeytabFilesServerAction.execute(CreateKeytabFilesServerAction.java:105)

at org.apache.ambari.server.serveraction.ServerActionExecutor$Worker.execute(ServerActionExecutor.java:550)

at org.apache.ambari.server.serveraction.ServerActionExecutor$Worker.run(ServerActionExecutor.java:466)

at java.lang.Thread.run(Thread.java:748)

2019-04-16 01:48:05,170 ERROR [ambari-action-scheduler] ActionScheduler:482 - Operation completely failed, aborting request id: 4

[#2]

Looking at the stack trace, it seems like some keytab file was not created by the MIT KDC. Maybe there are messages in the Ambari server log that indicates why. Else maybe a look at the KDC or KAdmin logs will be needed to help figure out the issue.