Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Failed To Generate Keytab file.

Failed To Generate Keytab file.

Explorer

Ambari: 2.7.1.0

HDF: 3.3

Cluster.json

{"blueprint": "bd-hdf", "Clusters": {"cluster_name": "HDFVivek"}, "host_groups": [{"hosts": [{"fqdn": "y.y.y.y"}], "name": "controller"}, {"hosts": [{"fqdn": "x.x.x.x"}], "name": "worker"}], "credentials": [{"alias": "kdc.admin.credential", "type": "TEMPORARY", "key": "test", "principal": "test/admin@z.z.z.z"}], "default_password": "hadoop", "security": {"type": "KERBEROS"}}


Blueprint.json

{"Blueprints": {"stack_name": "HDF", "stack_version": "3.3", "security": {"type": "KERBEROS"}}, "host_groups": [{"cardinality": "1", "name": "controller", "components": [{"name": "NIFI_MASTER"}, {"name": "DRPC_SERVER"}, {"name": "METRICS_COLLECTOR"}, {"name": "METRICS_GRAFANA"}, {"name": "KAFKA_BROKER"}, {"name": "ZOOKEEPER_SERVER"}, {"name": "STREAMLINE_SERVER"}, {"name": "METRICS_MONITOR"}, {"name": "SUPERVISOR"}, {"name": "NIFI_CA"}, {"name": "NIMBUS"}, {"name": "ZOOKEEPER_CLIENT"}, {"name": "NIFI_REGISTRY_MASTER"}, {"name": "REGISTRY_SERVER"}, {"name": "STORM_UI_SERVER"}], "configurations": []}, {"cardinality": "1+", "name": "worker", "components": [{"name": "METRICS_MONITOR"}, {"name": "SUPERVISOR"}, {"name": "ZOOKEEPER_SERVER"}, {"name": "STREAMLINE_SERVER"}, {"name": "KERBEROS_CLIENT"}], "configurations": []}], "configurations": [{"nifi-ambari-config": {"nifi.node.protocol.port": "9089", "nifi.node.port": "9092", "nifi.provenance.repository.dir.default": "/nifi/provenance_repository", "nifi.database.dir": "/nifi/database_repository", "nifi.content.repository.dir.default": "/nifi/content_repository", "nifi.flowfile.repository.dir": "/nifi/flowfile_repository", "nifi.max_mem": "1g", "nifi.security.encrypt.configuration.password": "admin@Admin1234", "nifi.internal.dir": "/nifi", "nifi.node.ssl.port": "9093"}}, {"nifi-registry-ambari-config": {"nifi.registry.security.encrypt.configuration.password": "admin@Admin1234"}}, {"ams-hbase-env": {"hbase_master_heapsize": "512", "hbase_regionserver_heapsize": "768", "hbase_master_xmn_size": "192"}}, {"streamline-logsearch-conf": {}}, {"storm-site": {"topology.metrics.consumer.register": "[{\"class\": \"org.apache.hadoop.metrics2.sink.storm.StormTimelineMetricsSink\", \"parallelism.hint\": 1, \"whitelist\": [\"kafkaOffset\\\\..+/\", \"__complete-latency\", \"__process-latency\", \"__execute-latency\", \"__receive\\\\.population$\", \"__sendqueue\\\\.population$\", \"__execute-count\", \"__emit-count\", \"__ack-count\", \"__fail-count\", \"memory/heap\\\\.usedBytes$\", \"memory/nonHeap\\\\.usedBytes$\", \"GC/.+\\\\.count$\", \"GC/.+\\\\.timeMs$\"]}]", "metrics.reporter.register": "org.apache.hadoop.metrics2.sink.storm.StormTimelineMetricsReporter", "storm.cluster.metrics.consumer.register": "[{\"class\": \"org.apache.hadoop.metrics2.sink.storm.StormTimelineMetricsReporter\"}]"}}, {"registry-common": {"registry.storage.connector.connectURI": "jdbc:mysql://y.y.y.y:3306/registry", "registry.storage.type": "mysql", "jar.storage.type": "local", "registry.storage.connector.password": "admin@Admin1234"}}, {"registry-env": {}}, {"registry-logsearch-conf": {}}, {"streamline-common": {"streamline.storage.connector.password": "admin@Admin1234", "streamline.storage.type": "mysql", "jar.storage.type": "local", "streamline.storage.connector.connectURI": "jdbc:mysql://y.y.y.y:3306/streamline", "registry.url": "http://y.y.y.y:7788/api/v1", "streamline.dashboard.url": "http://y.y.y.y:9089"}}, {"nifi-registry-properties": {"nifi.registry.db.password": "admin@Admin1234"}}, {"ams-hbase-site": {"hbase.regionserver.global.memstore.upperLimit": "0.35", "hbase.regionserver.global.memstore.lowerLimit": "0.3", "hbase.tmp.dir": "/var/lib/ambari-metrics-collector/hbase-tmp", "hbase.hregion.memstore.flush.size": "134217728", "hfile.block.cache.size": "0.3", "hbase.rootdir": "file:///var/lib/ambari-metrics-collector/hbase", "hbase.cluster.distributed": "false", "phoenix.coprocessor.maxMetaDataCacheSize": "20480000", "hbase.zookeeper.property.clientPort": "61181"}}, {"ams-env": {"metrics_collector_heapsize": "512"}}, {"streamline-env": {}}, {"ams-site": {"timeline.metrics.service.webapp.address": "localhost:6188", "timeline.metrics.cluster.aggregate.splitpoints": "kafka.network.RequestMetrics.ResponseQueueTimeMs.request.OffsetFetch.98percentile", "timeline.metrics.downsampler.event.metric.patterns": "topology\\.%", "timeline.metrics.host.aggregate.splitpoints": "kafka.network.RequestMetrics.ResponseQueueTimeMs.request.OffsetFetch.98percentile", "timeline.metrics.service.handler.thread.count": "20", "timeline.metrics.service.watcher.disabled": "false", "timeline.metrics.host.aggregator.ttl": "86400"}}, {"kafka-broker": {"offsets.topic.replication.factor": "1"}}, {"ams-grafana-env": {"metrics_grafana_password": "admin@Admin1234"}}, {"nifi-logsearch-conf": {}}, {"zoo.cfg": {}}, {"nifi-env": {"nifi_group": "mynifigroup", "nifi_user": "mynifiuser"}}, {"storm-env": {}}, {"kerberos-env": {"kdc_hosts": "p.p.p.p", "admin_server_host": "p.p.p.p", "realm": "z.z.z.z", "encryption_types": "aes128-cts-hmac-sha1-96 aes256-cts-hmac-sha1-96 arcfour-hmac des-cbc-md5 des-hmac-sha1 des3-cbc-sha1 rc4-hmac", "kdc_type": "mit-kdc", "properties_attributes": {}, "properties": {}, "manage_identities": "true"}}, {"krb5-conf": {"domains": "z.z.z.z", "manage_krb5_conf": "false", "properties_attributes": {}, "properties": {}}}]}


While creating cluster with the above blueprint.
keytabs failed to generate.

Error:

2019-04-16 01:48:04,344 INFO [Server Action Executor Worker 10] CreateKeytabFilesServerAction:193 - Creating keytab file for amsmon/x.x.x.x@z.z.z.z on host x.x.x.x

2019-04-16 01:48:04,364 WARN [Server Action Executor Worker 10] ServerActionExecutor:471 - Task #10 failed to complete execution due to thrown exception: java.lang.NullPointerException:null

java.lang.NullPointerException

at org.apache.ambari.server.serveraction.kerberos.CreateKeytabFilesServerAction.cacheKeytab(CreateKeytabFilesServerAction.java:420)

at org.apache.ambari.server.serveraction.kerberos.CreateKeytabFilesServerAction.createKeytab(CreateKeytabFilesServerAction.java:352)

at org.apache.ambari.server.serveraction.kerberos.CreateKeytabFilesServerAction.processIdentity(CreateKeytabFilesServerAction.java:244)

at org.apache.ambari.server.serveraction.kerberos.KerberosServerAction.processIdentities(KerberosServerAction.java:458)

at org.apache.ambari.server.serveraction.kerberos.CreateKeytabFilesServerAction.execute(CreateKeytabFilesServerAction.java:105)

at org.apache.ambari.server.serveraction.ServerActionExecutor$Worker.execute(ServerActionExecutor.java:550)

at org.apache.ambari.server.serveraction.ServerActionExecutor$Worker.run(ServerActionExecutor.java:466)

at java.lang.Thread.run(Thread.java:748)

2019-04-16 01:48:05,170 ERROR [ambari-action-scheduler] ActionScheduler:482 - Operation completely failed, aborting request id: 4

1 REPLY 1

Re: Failed To Generate Keytab file.

Looking at the stack trace, it seems like some keytab file was not created by the MIT KDC. Maybe there are messages in the Ambari server log that indicates why. Else maybe a look at the KDC or KAdmin logs will be needed to help figure out the issue.