Unable to Start Infra Solr Instance in Ambari

[#1]

Failed to Start Infra Solr Instance in Ambari, 

Please find the logs,

--------------------------------------

Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA_SOLR/0.1.0/package/scripts/infra_solr.py", line 171, in <module>
InfraSolr().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA_SOLR/0.1.0/package/scripts/infra_solr.py", line 58, in start
setup_solr_znode_env()
File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA_SOLR/0.1.0/package/scripts/setup_infra_solr.py", line 142, in setup_solr_znode_env
java_opts=java_opts
File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/solr_cloud_util.py", line 162, in setup_kerberos_plugin
Execute(setup_kerberos_plugin_cmd)
File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 263, in action_run
returns=self.resource.returns)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'ambari-sudo.sh JAVA_HOME=/usr/lib/jvm/java INFRA_SOLR_CLI_OPTS="-Dzookeeper.sasl.client=true -Dzookeeper.sasl.client.username=zookeeper -Dzookeeper.sasl.clientconfig=Client" /usr/lib/ambari-infra-solr-client/solrCloudCli.sh --zookeeper-connect-string xxxx-0800600xx.xxxx.com:2181,xxxx-0800600xx.xxxx.com:2181,xxxx-0800600xx.xxxx.com:2181 --znode /infra-solr --jaas-file /etc/ambari-infra-solr/conf/infra_solr_jaas.conf --setup-kerberos-plugin --jaas-file /etc/ambari-infra-solr/conf/infra_solr_jaas.conf --secure --security-json-location /etc/ambari-infra-solr/conf/security.json' returned 1. Client environment:zookeeper.version=3.4.6-2557--1, built on 07/14/2015 12:48 GMT
Client environment:host.name=xxxx-0800600xx.xxxx.com
Client environment:java.version=13.0.2
Client environment:java.vendor=N/A
Client environment:java.home=/usr/lib/jvm/java-13-openjdk-13.0.2.8-1.rolling.el7.x86_64
Client environment:java.class.path=/usr/lib/ambari-infra-solr-client:/usr/lib/ambari-infra-solr-client/libs/ambari-infra-solr-client-2.7.3.0.139.jar:/usr/lib/ambari-infra-solr-client/libs/aws-java-sdk-core-1.11.5.jar:/usr/lib/ambari-infra-solr-client/libs/aws-java-sdk-kms-1.11.5.jar:/usr/lib/ambari-infra-solr-client/libs/aws-java-sdk-s3-1.11.5.jar:/usr/lib/ambari-infra-solr-client/libs/commons-cli-1.3.1.jar:/usr/lib/ambari-infra-solr-client/libs/commons-codec-1.8.jar:/usr/lib/ambari-infra-solr-client/libs/commons-io-2.5.jar:/usr/lib/ambari-infra-solr-client/libs/commons-lang-2.5.jar:/usr/lib/ambari-infra-solr-client/libs/commons-logging-1.1.3.jar:/usr/lib/ambari-infra-solr-client/libs/commons-math3-3.6.1.jar:/usr/lib/ambari-infra-solr-client/libs/easymock-3.4.jar:/usr/lib/ambari-infra-solr-client/libs/hamcrest-core-1.1.jar:/usr/lib/ambari-infra-solr-client/libs/httpclient-4.5.3.jar:/usr/lib/ambari-infra-solr-client/libs/httpcore-4.4.6.jar:/usr/lib/ambari-infra-solr-client/libs/httpmime-4.5.3.jar:/usr/lib/ambari-infra-solr-client/libs/jackson-annotations-2.9.4.jar:/usr/lib/ambari-infra-solr-client/libs/jackson-core-2.9.4.jar:/usr/lib/ambari-infra-solr-client/libs/jackson-core-asl-1.9.13.jar:/usr/lib/ambari-infra-solr-client/libs/jackson-databind-2.9.4.jar:/usr/lib/ambari-infra-solr-client/libs/jackson-dataformat-cbor-2.6.6.jar:/usr/lib/ambari-infra-solr-client/libs/jackson-mapper-asl-1.9.13.jar:/usr/lib/ambari-infra-solr-client/libs/jcl-over-slf4j-1.7.24.jar:/usr/lib/ambari-infra-solr-client/libs/jline-0.9.94.jar:/usr/lib/ambari-infra-solr-client/libs/joda-time-2.8.1.jar:/usr/lib/ambari-infra-solr-client/libs/junit-4.10.jar:/usr/lib/ambari-infra-solr-client/libs/log4j-1.2.17.jar:/usr/lib/ambari-infra-solr-client/libs/lucene-backward-codecs-7.5.0.jar:/usr/lib/ambari-infra-solr-client/libs/lucene-core-7.5.0.jar:/usr/lib/ambari-infra-solr-client/libs/netty-3.7.0.Final.jar:/usr/lib/ambari-infra-solr-client/libs/noggit-0.8.jar:/usr/lib/ambari-infra-solr-client/libs/objenesis-2.2.jar:/usr/lib/ambari-infra-solr-client/libs/slf4j-api-1.7.20.jar:/usr/lib/ambari-infra-solr-client/libs/slf4j-log4j12-1.7.20.jar:/usr/lib/ambari-infra-solr-client/libs/solr-solrj-7.5.0.jar:/usr/lib/ambari-infra-solr-client/libs/stax2-api-3.1.4.jar:/usr/lib/ambari-infra-solr-client/libs/woodstox-core-asl-4.4.1.jar:/usr/lib/ambari-infra-solr-client/libs/zookeeper-3.4.6.2.3.0.0-2557.jar
Client environment:java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib
Client environment:java.io.tmpdir=/tmp
Client environment:java.compiler=<NA>
Client environment:os.name=Linux
Client environment:os.arch=amd64
Client environment:os.version=3.10.0-1062.12.1.el7.x86_64
Client environment:user.name=root
Client environment:user.home=/root
Client environment:user.dir=/var/lib/ambari-agent
Initiating client connection, connectString=xxxx-0800600xx.xxxx.com:2181,xxxx-0800600xx.xxxx.com:2181,xxxx-0800600xx.xxxx.com:2181 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.SolrZkClient$1@1554909b
successfully logged in.
TGT refresh thread started.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.zookeeper.server.util.KerberosUtil (file:/usr/lib/ambari-infra-solr-client/libs/zookeeper-3.4.6.2.3.0.0-2557.jar) to method sun.security.krb5.Config.getInstance()
WARNING: Please consider reporting this to the maintainers of org.apache.zookeeper.server.util.KerberosUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Client will use GSSAPI as SASL mechanism.
TGT valid starting at: Thu Mar 19 10:25:52 UTC 2020
TGT expires: Thu Mar 19 20:25:52 UTC 2020
TGT refresh sleeping until: Thu Mar 19 18:55:01 UTC 2020
Opening socket connection to server xxxx-0800600xx.xxxx.com/10.80.60.xx:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to xxxx-0800600xx.xxxx.com/10.80.60.xx:2181, initiating session
Session establishment complete on server xxxx-0800600xx.xxxx.com/10.80.60.xx:2181, sessionid = 0x170f22bf6f80007, negotiated timeout = 60000
zkClient has connected
Setup kerberos plugin in security.json
KeeperErrorCode = NoAuth for /infra-solr/security.json
org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /infra-solr/security.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270)
at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:353)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:353)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:573)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.putFileContent(EnableKerberosPluginSolrZkCommand.java:63)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:49)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:32)
at org.apache.ambari.infra.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.infra.solr.AmbariSolrCloudClient.setupKerberosPlugin(AmbariSolrCloudClient.java:184)
at org.apache.ambari.infra.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:613)
Command failed, tries again (tries: 1)
KeeperErrorCode = NoAuth for /infra-solr/security.json
org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /infra-solr/security.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270)
at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:353)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:353)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:573)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.putFileContent(EnableKerberosPluginSolrZkCommand.java:63)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:49)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:32)
at org.apache.ambari.infra.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.infra.solr.AmbariSolrCloudClient.setupKerberosPlugin(AmbariSolrCloudClient.java:184)
at org.apache.ambari.infra.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:613)
Command failed, tries again (tries: 2)
KeeperErrorCode = NoAuth for /infra-solr/security.json
org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /infra-solr/security.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270)
at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:353)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:353)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:573)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.putFileContent(EnableKerberosPluginSolrZkCommand.java:63)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:49)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:32)
at org.apache.ambari.infra.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.infra.solr.AmbariSolrCloudClient.setupKerberosPlugin(AmbariSolrCloudClient.java:184)
at org.apache.ambari.infra.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:613)
Command failed, tries again (tries: 3)
KeeperErrorCode = NoAuth for /infra-solr/security.json
org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /infra-solr/security.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270)
at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:353)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:353)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:573)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.putFileContent(EnableKerberosPluginSolrZkCommand.java:63)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:49)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:32)
at org.apache.ambari.infra.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.infra.solr.AmbariSolrCloudClient.setupKerberosPlugin(AmbariSolrCloudClient.java:184)
at org.apache.ambari.infra.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:613)
Command failed, tries again (tries: 4)
KeeperErrorCode = NoAuth for /infra-solr/security.json
org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /infra-solr/security.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1270)
at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:353)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:353)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:573)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.putFileContent(EnableKerberosPluginSolrZkCommand.java:63)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:49)
at org.apache.ambari.infra.solr.commands.EnableKerberosPluginSolrZkCommand.executeZkCommand(EnableKerberosPluginSolrZkCommand.java:32)
at org.apache.ambari.infra.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.infra.solr.AmbariSolrCloudClient.setupKerberosPlugin(AmbariSolrCloudClient.java:184)
at org.apache.ambari.infra.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:613)
Command failed, tries again (tries: 5)
usage:
./solrCloudCli.sh --create-collection -z host1:2181,host2:2181/ambari-solr -c collection -cs conf_set
./solrCloudCli.sh --upload-config -z host1:2181,host2:2181/ambari-solr -d /tmp/myconfig_dir -cs config_set
./solrCloudCli.sh --download-config -z host1:2181,host2:2181/ambari-solr -cs config_set -d /tmp/myonfig_dir
./solrCloudCli.sh --check-config -z host1:2181,host2:2181/ambari-solr -cs config_set
./solrCloudCli.sh --create-shard -z host1:2181,host2:2181/ambari-solr -c collection -sn myshard
./solrCloudCli.sh --remove-admin-handlers -z host1:2181,host2:2181/ambari-solr -c collection
./solrCloudCli.sh --dump-collections -z host1:2181,host2:2181/ambari-solr -o collection-data.json
./solrCloudCli.sh --create-znode -z host1:2181,host2:2181 -zn /ambari-solr
./solrCloudCli.sh --check-znode -z host1:2181,host2:2181 -zn /ambari-solr
./solrCloudCli.sh --delete-znode -z host1:2181,host2:2181 -zn /ambari-solr
./solrCloudCli.sh --transfer-znode -z host1:2181,host2:2181 -cps /ambari-solr -cpd /ambari-solr-backup
./solrCloudCli.sh --cluster-prop -z host1:2181,host2:2181/ambari-solr -cpn urlScheme -cpn http
./solrCloudCli.sh --secure-znode -z host1:2181,host2:2181 -zn /ambari-solr -su logsearch,atlas,ranger --jaas-file /etc/myconf/jaas_file
./solrCloudCli.sh --unsecure-znode -z host1:2181,host2:2181 -zn /ambari-solr --jaas-file /etc/myconf/jaas_file
./solrCloudCli.sh --secure-solr-znode -z host1:2181,host2:2181 -zn /ambari-solr -su logsearch,atlas,ranger --jaas-file /etc/myconf/jaas_file
./solrCloudCli.sh --setup-kerberos-plugin -z host1:2181,host2:2181 -zn /ambari-solr --security-json-location /etc/infra-solr/conf/security.json

-c,--collection <collection name> Collection name
-cc,--create-collection Create collection in Solr (command)
-chc,--check-config Check configuration exists in Zookeeper (command)
-chz,--check-znode Check znode exists in Zookeeper (command)
-cp,--cluster-prop Set cluster property (command)
-cpd,--copy-dest </myznode | /my/path> ZNode or local destination (used for ZNode transfer)
-cpn,--property-name <cluster prop name> Cluster property name
-cps,--copy-src </myznode | /my/path> ZNode or local source (used for ZNode transfer)
-cpv,--property-value <cluster prop value> Cluster property value
-cs,--config-set <config_set> Configuration set
-csh,--create-shard Create shard in Solr (command)
-cz,--create-znode Create Znode (command)
-d,--config-dir <config_dir> Configuration directory
-dc,--download-config Download configuration set from Zookeeper (command)
-dcd,--dump-collections Dump collections data
-dz,--delete-znode Delete znode
-h,--help Print commands
-i,--interval <interval> Interval for retry logic in sec [default:5]
-idn,--include-doc-number Include the number of docs as well in collection dump
-ir,--implicit-routing Use implicit routing when creating a collection
-jf,--jaas-file <jaas_file> Location of the jaas-file to communicate with kerberized Solr
-ksl,--key-store-location <key store location> Location of the key store used to communicate with Solr using SSL
-ksp,--key-store-password <key store password> Key store password used to communicate with Solr using SSL
-kst,--key-store-type <key store type> Type of the key store used to communicate with Solr using SSL
-m,--max-shards <max number of shards> Max number of shards per node (default: replication * shards)
-o,--output <arg> File output for collections dump
-r,--replication <replication factor> Replication factor
-rah,--remove-admin-handlers Remove AdminHandlers request handler from solrconfig.xml (command)
-rf,--router-field <router_field> Router field for collection [default:_router_field_]
-rn,--router-name <router_name> Router name for collection [default:implicit]
-rt,--retry <number of retries> Number of retries for access Solr [default:10]
-s,--shards <shard number> Number of shards
-sec,--secure Flag for enable/disable kerberos (with --setup-kerberos or --setup-kerberos-plugin)
-sjl,--security-json-location <security.json location> Local security.json path
-skp,--setup-kerberos-plugin Setup kerberos plugin in security.json (command)
-sn,--shard-name <my_new_shard> Name of the shard for create-shard command
-ssz,--secure-solr-znode Set acls for solr znode (command)
-su,--sasl-users <atlas,ranger,logsearch-solr> Sasl users (comma separated list)
-sz,--secure-znode Set acls for znode (command)
-tm,--transfer-mode <copyFromLocal | copyToLocal> Transfer mode, if not used copy znode to znode.
-tsl,--trust-store-location <trust store location> Location of the trust store used to communicate with Solr using SSL
-tsp,--trust-store-password <trust store password> Trust store password used to communicate with Solr using SSL
-tst,--trust-store-type <trust store type> Type of the trust store used to communicate with Solr using SSL
-tz,--transfer-znode Transfer znode (copy from/to local or to another znode)
-uc,--upload-config Upload configuration set to Zookeeper (command)
-uz,--unsecure-znode Disable security for znode (command)
-z,--zookeeper-connect-string <host:port,host:port[/ambari-solr]> Zookeeper quorum [and Znode (optional)]
-zn,--znode </ambari-solr> Zookeeper ZNode
Maximum retries exceeded: 5
Return code: 1

--------------------------------------

Anybody knows solution, please let me know

Thanks in Advance.

[#2]

Tried a few solutions like

1: Regenerated keytabs, checked ticket issues, check read accesses of keytabs...
There were no problems.

2: And also tried to adding security.auth_to_local rules to zokeeper environment. I added rules for problematic services to SERVER_JVMFLAGS in zookeeper-env template like this and restart zookeeper and other related services.

-Dzookeeper.security.auth_to_local=RULE:[2:\$1@\$0](hbase@MY_REALM)s/.*/hbase/RULE:[2:\$1@\$0](infra-solr@MY_REALM)s/.*/infra-solr/RULE:[2:\$1@\$0](rm@MY_REALM)s/.*/rm/

This solution's also did not work,

Any one have an idea about the below exception in ambari-metrics-collector.log
your input is much appreciated

Please find the logs,

KeeperErrorCode = NoAuth for /infra-solr
org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /infra-solr
at org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setACL(ZooKeeper.java:1399)
at org.apache.ambari.infra.solr.util.AclUtils.setRecursivelyOn(AclUtils.java:75)
at org.apache.ambari.infra.solr.commands.SecureSolrZNodeZkCommand.executeZkCommand(SecureSolrZNodeZkCommand.java:62)
at org.apache.ambari.infra.solr.commands.SecureSolrZNodeZkCommand.executeZkCommand(SecureSolrZNodeZkCommand.java:38)
at org.apache.ambari.infra.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.infra.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.infra.solr.AmbariSolrCloudClient.secureSolrZnode(AmbariSolrCloudClient.java:192)
at org.apache.ambari.infra.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:625)

Thanks in Advance

[#3]

Did you manage to fix this? I'm hitting the same issue having upgraded my underlying CentOS pacakges.

[#4 · Accepted solution]

I ended up downgrading my Java package from:

1:1.8.0.252.b09-2.el7_8

to

1:1.8.0.171-8.b10.el7_5

Which seems to have fixed the issue

(running CentOS 7.x)

[#5]

Yes,

I end up downgrading Java version from 
1.8.0.252

to 

1.8.0.232

This issue got fixed.

Thanks