Member since
09-18-2015
216
Posts
206
Kudos Received
49
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 21 | 09-13-2017 06:04 AM | |
| 72 | 06-27-2017 06:31 PM | |
| 58 | 06-27-2017 06:27 PM | |
| 552 | 11-04-2016 08:02 PM | |
| 68 | 05-25-2016 03:42 PM |
12-15-2017
06:14 PM
Currently, distcp data from secure zone in one cluster to secure zone in another cluster is not pssible unless you copy encryption keys from source cluster to target cluster. If both clusters have same keys, specify the -skipcrccheck and -update flags to avoid verifying checksums. AFAIK, HDFS client (DistCp) patch will be required using which HDFS Client will decrypt the Source-data in folder-1 using key-1, pass it over wire and encrypt Target-data in folder-1 using key-2, its a work in progress currently.
... View more
09-13-2017
06:27 AM
@Bhushan kumar What do you mean by ldapsearch not working on Knox? I am assuming that you are trying to do ldapsearch from host where knox is installed and getting "ldapsearch: command not found" which means ldap client utilities are not installed. Installing openldap-clients should fix the issue. Below is example from Centos7: [root@pk-test4 ~]# yum provides ldapsearch
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
* base: mirror.sjc02.svwh.net
* extras: mirror.keystealth.org
* updates: centos.mia.host-engine.com
openldap-clients-2.4.40-13.el7.x86_64 : LDAP client utilities
Repo : base
Matched from:
Filename : /usr/bin/ldapsearch
openldap-clients-2.4.40-13.el7.x86_64 : LDAP client utilities
Repo : @base
Matched from:
Filename : /bin/ldapsearch
openldap-clients-2.4.40-13.el7.x86_64 : LDAP client utilities
Repo : @base
Matched from:
Filename : /usr/bin/ldapsearch
... View more
09-13-2017
06:21 AM
@saanvi I suggest asking this question in Microsoft forums..Here are some references though: https://www.sqlservercentral.com/Forums/Topic1383362-2799-1.aspx https://technet.microsoft.com/en-us/library/ms170438(v=sql.110).aspx
... View more
09-13-2017
06:13 AM
1 Kudo
Closest supported version is CentOS7.2 and you should refer below documentation for the same. https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.2.0/bk_ambari-installation/content/ch_Getting_Ready.html
... View more
09-13-2017
06:04 AM
There is no specific Architect certification or exam currently. Below are available certification exams: https://hortonworks.com/services/training/certification/
... View more
07-11-2017
07:03 PM
Muni, yes you can shut down phoenix while HBase will still be running. On other note, as Tim mentioned below, Pheonix is really good and doesn't consume much resources, try exploring it.
... View more
07-08-2017
03:23 AM
Hello @Marian Canciu Can you try below link. https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1004109
... View more
07-08-2017
03:21 AM
@Rishit shah Can you open a new question for this issue? This will help community with better search on issues.
... View more
07-08-2017
03:14 AM
@Sami Ahmad check this https://pig.apache.org/docs/r0.8.1/piglatin_ref2.html#REGEX_EXTRACT
... View more
06-27-2017
06:31 PM
1 Kudo
@Sami Ahmad Datanode directories is where HDFS data is actually stored while Namenode Directory is used for storing Namenode Metadata i.e. file, block information etc. associated with HDFS data stored on Datanodes. To add additional space to HDFS with additional disks, you should add disk to Datanode Directories i.e. if you add u02 to server(s), add the same to Datanode Directories. DataNode directories=/u01/hadoop1/hdfs/data,/u02/hadoop1/hdfs/data
... View more
06-27-2017
06:27 PM
1 Kudo
Well there are many disadvantages of using replication factor 1 and we strongly do not recommend it for below reasons: 1. Data loss --> One or more datanode or disk failure will result in data loss. 2. Performance issues --> Having replication factor of more than 1 results in more parallelization. 3. Handling Failure --> With replication factor > 1, one or more Datanode doesn't result in job failure.
... View more
05-09-2017
01:33 AM
To troubleshoot Ambari, use ambari-server log and not ambari-agent log. Default location is /var/log/ambari-server/ambari-server.log
... View more
03-25-2017
06:19 PM
Yes, there is always performance overhead of using upper/lower function as that will be called for each row.
... View more
03-25-2017
06:10 PM
You can download mysql rpm and then use yum for install. https://www.linode.com/docs/databases/mysql/how-to-install-mysql-on-centos-7
... View more
11-23-2016
03:39 AM
stderr: /var/lib/ambari-agent/data/errors-603.txt
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA/0.1.0/package/scripts/infra_solr.py", line 110, in <module>
InfraSolr().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA/0.1.0/package/scripts/infra_solr.py", line 45, in start
self.configure(env)
File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA/0.1.0/package/scripts/infra_solr.py", line 40, in configure
setup_infra_solr(name = 'server')
File "/var/lib/ambari-agent/cache/common-services/AMBARI_INFRA/0.1.0/package/scripts/setup_infra_solr.py", line 91, in setup_infra_solr
jaas_file=jaas_file
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/solr_cloud_util.py", line 163, in set_cluster_prop
Execute(set_cluster_prop_cmd)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 71, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 93, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 141, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'ambari-sudo.sh JAVA_HOME=/usr/lib/jvm/java-1.8.0-oracle-1.8.0.111-1jpp.4.el7.x86_64 /usr/lib/ambari-infra-solr-client/solrCloudCli.sh --zookeeper-connect-string test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure --cluster-prop --property-name urlScheme --property-value http --jaas-file /etc/ambari-infra-solr/conf/infra_solr_jaas.conf' returned 1. Using default ZkCredentialsProvider
Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
Client environment:host.name=test7398p.ttest.local
Client environment:java.version=1.8.0_111
Client environment:java.vendor=Oracle Corporation
Client environment:java.home=/usr/lib/jvm/java-1.8.0-oracle-1.8.0.111-1jpp.4.el7.x86_64/jre
Client environment:java.class.path=/usr/lib/ambari-infra-solr-client:/usr/lib/ambari-infra-solr-client/libs/zookeeper-3.4.6.jar:/usr/lib/ambari-infra-solr-client/libs/log4j-1.2.17.jar:/usr/lib/ambari-infra-solr-client/libs/jackson-core-asl-1.9.9.jar:/usr/lib/ambari-infra-solr-client/libs/woodstox-core-asl-4.4.1.jar:/usr/lib/ambari-infra-solr-client/libs/jackson-mapper-asl-1.9.13.jar:/usr/lib/ambari-infra-solr-client/libs/jcl-over-slf4j-1.7.7.jar:/usr/lib/ambari-infra-solr-client/libs/easymock-3.4.jar:/usr/lib/ambari-infra-solr-client/libs/ambari-logsearch-solr-client-2.4.1.0.22.jar:/usr/lib/ambari-infra-solr-client/libs/slf4j-api-1.7.2.jar:/usr/lib/ambari-infra-solr-client/libs/httpmime-4.4.1.jar:/usr/lib/ambari-infra-solr-client/libs/commons-codec-1.8.jar:/usr/lib/ambari-infra-solr-client/libs/commons-cli-1.3.1.jar:/usr/lib/ambari-infra-solr-client/libs/noggit-0.6.jar:/usr/lib/ambari-infra-solr-client/libs/httpclient-4.4.1.jar:/usr/lib/ambari-infra-solr-client/libs/commons-lang-2.5.jar:/usr/lib/ambari-infra-solr-client/libs/slf4j-log4j12-1.7.2.jar:/usr/lib/ambari-infra-solr-client/libs/objenesis-2.2.jar:/usr/lib/ambari-infra-solr-client/libs/junit-4.10.jar:/usr/lib/ambari-infra-solr-client/libs/httpcore-4.4.1.jar:/usr/lib/ambari-infra-solr-client/libs/stax2-api-3.1.4.jar:/usr/lib/ambari-infra-solr-client/libs/solr-solrj-5.5.2.jar:/usr/lib/ambari-infra-solr-client/libs/hamcrest-core-1.1.jar:/usr/lib/ambari-infra-solr-client/libs/commons-io-2.1.jar
Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
Client environment:java.io.tmpdir=/tmp
Client environment:java.compiler=<NA>
Client environment:os.name=Linux
Client environment:os.arch=amd64
Client environment:os.version=3.10.0-514.el7.x86_64
Client environment:user.name=root
Client environment:user.home=/root
Client environment:user.dir=/var/lib/ambari-agent
Initiating client connection, connectString=test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure sessionTimeout=15000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@200a570f
Waiting for client to connect to ZooKeeper
successfully logged in.
TGT refresh thread started.
Client will use GSSAPI as SASL mechanism.
TGT valid starting at: Tue Nov 22 19:36:51 CLST 2016
TGT expires: Wed Nov 23 19:36:51 CLST 2016
TGT refresh sleeping until: Wed Nov 23 15:18:01 CLST 2016
Opening socket connection to server test7454p.ttest.local/10.186.62.50:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7454p.ttest.local/10.186.62.50:2181, initiating session
Session establishment complete on server test7454p.ttest.local/10.186.62.50:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Client is connected to ZooKeeper
Using default ZkACLProvider
Set cluster prop: 'urlScheme'
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
zkClient has disconnected
Client will use GSSAPI as SASL mechanism.
Opening socket connection to server test7454p.ttest.local/10.186.62.50:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7454p.ttest.local/10.186.62.50:2181, initiating session
Session establishment complete on server test7454p.ttest.local/10.186.62.50:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
zkClient has disconnected
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 7 more
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 7 more
Command failed, tries again (tries: 1)
Client will use GSSAPI as SASL mechanism.
Opening socket connection to server test7426p.ttest.local/10.186.62.36:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7426p.ttest.local/10.186.62.36:2181, initiating session
Session establishment complete on server test7426p.ttest.local/10.186.62.36:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
zkClient has disconnected
Client will use GSSAPI as SASL mechanism.
Opening socket connection to server test7398p.ttest.local/10.186.62.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7398p.ttest.local/10.186.62.22:2181, initiating session
Session establishment complete on server test7398p.ttest.local/10.186.62.22:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 8 more
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 8 more
Command failed, tries again (tries: 2)
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
zkClient has disconnected
Client will use GSSAPI as SASL mechanism.
Opening socket connection to server test7454p.ttest.local/10.186.62.50:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7454p.ttest.local/10.186.62.50:2181, initiating session
Session establishment complete on server test7454p.ttest.local/10.186.62.50:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
zkClient has disconnected
Opening socket connection to server test7426p.ttest.local/10.186.62.36:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7426p.ttest.local/10.186.62.36:2181, initiating session
Session establishment complete on server test7426p.ttest.local/10.186.62.36:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 9 more
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 9 more
Command failed, tries again (tries: 3)
zkClient has disconnected
Client will use GSSAPI as SASL mechanism.
Opening socket connection to server test7398p.ttest.local/10.186.62.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7398p.ttest.local/10.186.62.22:2181, initiating session
Session establishment complete on server test7398p.ttest.local/10.186.62.22:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
zkClient has disconnected
............
............
Client will use GSSAPI as SASL mechanism.
Opening socket connection to server test7398p.ttest.local/10.186.62.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7398p.ttest.local/10.186.62.22:2181, initiating session
Session establishment complete on server test7398p.ttest.local/10.186.62.22:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 10 more
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 10 more
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
Command failed, tries again (tries: 4)
zkClient has disconnected
Client will use GSSAPI as SASL mechanism.
Opening socket connection to server test7454p.ttest.local/10.186.62.50:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7454p.ttest.local/10.186.62.50:2181, initiating session
Session establishment complete on server test7454p.ttest.local/10.186.62.50:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
zkClient has disconnected
Client will use GSSAPI as SASL mechanism.
Opening socket connection to server test7426p.ttest.local/10.186.62.36:2181. Will attempt to SASL-authenticate using Login Context section 'Client'
Socket connection established to test7426p.ttest.local/10.186.62.36:2181, initiating session
Session establishment complete on server test7426p.ttest.local/10.186.62.36:2181, sessionid = 0x3588e0eead6000f, negotiated timeout = 15000
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
Unable to read additional data from server sessionid 0x3588e0eead6000f, likely server has closed socket, closing socket connection and attempting reconnect
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Error updating path [/clusterprops.json]
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Watcher org.apache.solr.common.cloud.ConnectionManager@3a86aba1 name:ZooKeeperConnection Watcher:test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure got event WatchedEvent state:Disconnected type:None path:null path:null type:None
zkClient has disconnected
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 11 more
Error updating cluster property urlScheme
org.apache.solr.common.SolrException: Error updating cluster property urlScheme
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:768)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:37)
at org.apache.ambari.logsearch.solr.commands.SetClusterPropertyZkCommand.executeZkCommand(SetClusterPropertyZkCommand.java:26)
at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54)
at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.setClusterProp(AmbariSolrCloudClient.java:132)
at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:492)
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /clusterprops.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.setClusterProperty(ZkStateReader.java:738)
... 11 more
Command failed, tries again (tries: 5)
usage:
./solrCloudCli.sh --create-collection -z host1:2181,host2:2181/ambari-solr -c collection -cs conf_set
./solrCloudCli.sh --upload-config -z host1:2181,host2:2181/ambari-solr -d /tmp/myconfig_dir -cs config_set
./solrCloudCli.sh --download-config -z host1:2181,host2:2181/ambari-solr -cs config_set -d /tmp/myonfig_dir
./solrCloudCli.sh --check-config -z host1:2181,host2:2181/ambari-solr -cs config_set
./solrCloudCli.sh --create-shard -z host1:2181,host2:2181/ambari-solr -c collection -sn myshard
./solrCloudCli.sh --create-znode -z host1:2181,host2:2181 -zn /ambari-solr
./solrCloudCli.sh --check-znode -z host1:2181,host2:2181 -zn /ambari-solr
./solrCloudCli.sh --cluster-prop -z host1:2181,host2:2181/ambari-solr -cpn urlScheme -cpn http
./solrCloudCli.sh --create-sasl-users -z host1:2181,host2:2181 -zn /ambari-solr -csu logsearch,atlas,ranger
./solrCloudCli.sh --setup-kerberos -z host1:2181,host2:2181 --secure -zn /ambari-solr-secure -cfz /ambari-solr-unsecure -jf /etc/path/my_jaas.conf
./solrCloudCli.sh --setup-kerberos-plugin -z host1:2181,host2:2181 -zn /ambari-solr
-c,--collection <collection name> Collection name
-cc,--create-collection Create collection in Solr (command)
-cfz,--copy-from-znode </ambari-solr-secure> Copy-from-znode
-chc,--check-config Check configuration exists in Zookeeper (command)
-chz,--check-znode Check znode exists in Zookeeper (command)
-cp,--cluster-prop Set cluster property (command)
-cpn,--property-name <cluster prop name> Cluster property name
-cpv,--property-value <cluster prop value> Cluster property value
-cs,--config-set <config_set> Configuration set
-csh,--create-shard Create shard in Solr (command)
-csu,--create-sasl-users Create sasl users
-cz,--create-znode Create Znode (command)
-d,--config-dir <config_dir> Configuration directory
-dc,--download-config Download configuration set from Zookeeper (command)
-h,--help Print commands
-i,--interval <interval> Interval for retry logic in sec [default:5]
-jf,--jaas-file <jaas_file> Location of the jaas-file to communicate with kerberized Solr
-ksl,--key-store-location <key store location> Location of the key store used to communicate with Solr using SSL
-ksp,--key-store-password <key store password> Key store password used to communicate with Solr using SSL
-kst,--key-store-type <key store type> Type of the key store used to communicate with Solr using SSL
-m,--max-shards <max number of shards> Max number of shards per node (default: replication * shards)
-ns,--no-sharding Sharding not used when creating collection
-r,--replication <replication factor> Replication factor
-rf,--router-field <router_field> Router field for collection [default:_router_field_]
-rn,--router-name <router_name> Router name for collection [default:implicit]
-rt,--retry <number of retries> Number of retries for access Solr [default:10]
-s,--shards <shard number> Number of shards
-sec,--secure Flag for enable/disable kerberos (with --setup-kerberos or --setup-kerberos-plugin)
-sk,--setup-kerberos Setup kerberos (command)
-skp,--setup-kerberos-plugin Setup kerberos plugin in security.json (command)
-sn,--shard-name <my_new_shard> Name of the shard for create-shard command
-su,--sasl-users <atlas,ranger,logsearch-solr> Sasl users (comma separated list)
-tsl,--trust-store-location <trust store location> Location of the trust store used to communicate with Solr using SSL
-tsp,--trust-store-password <trust store password> Trust store password used to communicate with Solr using SSL
-tst,--trust-store-type <trust store type> Type of the trust store used to communicate with Solr using SSL
-uc,--upload-config Upload configuration set to Zookeeper (command)
-z,--zookeeper-connect-string <host:port,host:port[/ambari-solr]> Zookeeper quorum [and Znode (optional)]
-zn,--znode </ambari-solr> Zookeeper ZNode
Maximum retries exceeded: 5
Maximum retries exceeded: 5
Return code: 1
stdout: /var/lib/ambari-agent/data/output-603.txt
2016-11-22 19:36:48,305 - Group['ranger'] {}
2016-11-22 19:36:48,307 - Group['hadoop'] {}
2016-11-22 19:36:48,307 - Group['nifi'] {}
2016-11-22 19:36:48,307 - User['srv_nifi'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'nifi']}
2016-11-22 19:36:48,310 - User['srv_infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-22 19:36:48,311 - User['srv_ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2016-11-22 19:36:48,313 - User['srv_ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'ranger']}
2016-11-22 19:36:48,316 - User['srv_ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-22 19:36:48,317 - User['srv_zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2016-11-22 19:36:48,317 - Skipping setting uid for smoke user as host is sys prepped
2016-11-22 19:36:48,335 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2016-11-22 19:36:48,355 - Skipping Execute[('setenforce', '0')] due to not_if
2016-11-22 19:36:48,571 - Directory['/var/log/ambari-infra-solr'] {'owner': 'srv_infra-solr', 'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2016-11-22 19:36:48,574 - Directory['/var/run/ambari-infra-solr'] {'owner': 'srv_infra-solr', 'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2016-11-22 19:36:48,574 - Directory['/data3/ambari_infra_solr/data'] {'owner': 'srv_infra-solr', 'group': 'hadoop', 'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2016-11-22 19:36:48,575 - Directory['/data3/ambari_infra_solr/data/resources'] {'owner': 'srv_infra-solr', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2016-11-22 19:36:48,575 - Directory['/usr/lib/ambari-infra-solr'] {'group': 'hadoop', 'cd_access': 'a', 'create_parents': True, 'recursive_ownership': True, 'owner': 'srv_infra-solr', 'mode': 0755}
2016-11-22 19:36:48,656 - Directory['/etc/ambari-infra-solr/conf'] {'group': 'hadoop', 'cd_access': 'a', 'create_parents': True, 'mode': 0755, 'owner': 'srv_infra-solr', 'recursive_ownership': True}
2016-11-22 19:36:48,656 - File['/var/log/ambari-infra-solr/solr-install.log'] {'content': '', 'owner': 'srv_infra-solr', 'group': 'hadoop', 'mode': 0644}
2016-11-22 19:36:48,666 - File['/etc/ambari-infra-solr/conf/infra-solr-env.sh'] {'owner': 'srv_infra-solr', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0755}
2016-11-22 19:36:48,668 - File['/data3/ambari_infra_solr/data/solr.xml'] {'owner': 'srv_infra-solr', 'content': InlineTemplate(...), 'group': 'hadoop'}
2016-11-22 19:36:48,670 - File['/etc/ambari-infra-solr/conf/log4j.properties'] {'owner': 'srv_infra-solr', 'content': InlineTemplate(...), 'group': 'hadoop'}
2016-11-22 19:36:48,671 - Execute['ambari-sudo.sh JAVA_HOME=/usr/lib/jvm/java-1.8.0-oracle-1.8.0.111-1jpp.4.el7.x86_64 /usr/lib/ambari-infra-solr-client/solrCloudCli.sh --zookeeper-connect-string test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181 --znode /infra-solr-secure --create-znode --retry 5 --interval 10'] {}
2016-11-22 19:36:49,811 - File['/etc/ambari-infra-solr/conf/infra_solr_jaas.conf'] {'owner': 'srv_infra-solr', 'content': Template('infra_solr_jaas.conf.j2')}
2016-11-22 19:36:49,812 - Execute['ambari-sudo.sh JAVA_HOME=/usr/lib/jvm/java-1.8.0-oracle-1.8.0.111-1jpp.4.el7.x86_64 /usr/lib/ambari-infra-solr-client/solrCloudCli.sh --zookeeper-connect-string test7398p.ttest.local:2181,test7426p.ttest.local:2181,test7454p.ttest.local:2181/infra-solr-secure --cluster-prop --property-name urlScheme --property-value http --jaas-file /etc/ambari-infra-solr/conf/infra_solr_jaas.conf'] {}
Command failed after 1 tries
... View more
Labels:
11-04-2016
08:02 PM
1 Kudo
It seems you are trying to install Nifi/HDF using Ambari which is managing HDP cluster. At present, HDF cannot be installed using same Ambari which is already managing HDP cluster. You will have to install HDF using dedicated Ambari. Refer below: https://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.0.1/bk_ambari-installation/content/ch_getting_ready.html
... View more
11-03-2016
06:09 PM
Glad that it got resolved.
... View more
11-02-2016
06:08 PM
2 Kudos
To setup an Ambari managed HDP cluster, below services’ components require database for their respective metastore databases.
Ambari Server Hive Oozie Ranger
While a lab/sandbox environment can be setup with default databases for these components, using the same is strongly not recommended for Dev/QA/UAT/Production clusters. Due diligence and planning must be done to ensure that database selection is appropriate for enterprise standard production cluster. Below are key areas to be taken into consideration while planning to select a database for Ambari and HDP components. Supported Databases Refer below for supported databases for Ambari and different HDP components in current state. https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-installation/content/database_requirements.html High Availability Support It is strongly recommended to setup High Availability for different HDP components, which can be enabled for High Availability in a production cluster. High Availability is supported by different HDP components as below: https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-user-guide/content/ch_managing_service_high_availability.html The relational database that backs the Hive Metastore, Ambari Server, Oozie Server etc. itself should also be made highly available using best practices defined for the database system in use for HDP services and Ambari Server to be truly Highly Available and not to have database as single point of failure for the service. Therefore, it is important to select relational database, which supports highly availability, and it should be discussed with in-house DBA when planning for a new database or to use an existing in-house database for HDP deployment. Cost of licensing and support HDP support subscription doesn’t cover any licensing and support for databases being used for Ambari Server and HDP components i.e. Hive Metastore and would incur additional licensing and support cost. Therefore, cost of licensing and support should be considered as an important factor for selecting appropriate database for Ambari Server and HDP stack. Note: Contact in-house database team/database vendor for details on cost for licensing and support for databases. Database maintenance and management Database to be used for Ambari Server and HDP components would need maintenance and management which can be quite frequent/regular for database backup, HA setup and recovery etc. Therefore, while selecting a database for Ambari/HDP, it must be ensured that your organization has in-house skilled people/DBAs available to perform these activities. It is not a good practice to use different relational databases for different components i.e. Postgres for Ambari, MySQL for Hive etc. to avoid complexity for management and maintenance of these different databases. It is recommended to pick relational database of your choice and use the same i.e. MySQL for all components or Postgres for all components and so on.
... View more
- Find more articles tagged with:
- Ambari
- Database
- Deployment
- Design & Architecture
- FAQ
- hdp-2.5.0
06-17-2016
01:47 PM
@Anshul Sisodia If cluster is not kerberized, then set these in yarn-site.xml and try again:
yarn.timeline-service.http-authentication.proxyuser.${ambari user}.hosts=* yarn.timeline-service.http-authentication.proxyuser.${ambari user}.users=* yarn.timeline-service.http-authentication.proxyuser.${ambari user}.groups=* Default user for Ambari is root unless you are running Ambari as non-root user. Replace accordingly and then try.
... View more
06-17-2016
10:44 AM
1 Kudo
@Anshul Sisodia Confirm these properties and values in yarn-site.xml: yarn.resourcemanager.system-metrics-publisher.enabled=true
yarn.timeline-service.enabled=true
yarn.timeline-service.webapp.address=<Value must be the IP:PORT on which the Timeline Server is
running.> Once above is confirmed, ensure to perform Kerberos setup for Tez Views (Only required if cluster is Kerberized.) To set up basic Kerberos for views, see "Set Up Kerberos for Ambari Server" in the Ambari Security Guide. Then, add below properties to yarn-site.xml: yarn.timeline-service.http-authentication.proxyuser.${ambari principal name}.hosts=*
yarn.timeline-service.http-authentication.proxyuser.${ambari principal name}.users=*
yarn.timeline-service.http-authentication.proxyuser.${ambari principal name}.groups=* For example, if the Kerberos principal used for the Ambari server is ambari-service@EXAMPLE.COM , replace ${ambari principal name} with ambari-service . Restart Services as required based on above config changes. Then, go to Tez View Instance Definition, select custom in cluster configuration and enter values for below fields.
Property
Description
Example Value
YARN Timeline
Server URL
Click YARN
> Configs > Advanced > Application Timeline Server >
yarn.timeline-service.webapp.address.
When you enter the
value in the view definition, pre-pend "http://" to the value you
find in the YARN advanced configuration settings.
For example,
http://c6401.ambari.apache.org:8188
YARN
ResourceManager URL
Click YARN
> Configs > Advanced > Advanced yarn-site >
yarn.resourcemanager.webapp.address.
When you enter the
value in the view definition, pre-pend "http://" to the value you
find in the YARN advanced configuration settings.
For example, http://c6401.ambari.apache.org:8088. For clusters with
Resource Manager HA, specify both Resource Managers separated by comma.
Auth to Local
Auth to Local
Rule for cluster
core-site/hadoop.security.auth_to_local
Provide user permissions for Tez View and save the instance. You should be all good with Tez View working :).
... View more
06-15-2016
09:58 PM
As discussed with @avoma, issue is resolved, it was due to incorrect entries in /etc/hosts file.
... View more
06-15-2016
07:55 PM
2 Kudos
@avoma Are you able to do hadoop fs -ls to both clusters from HDP2.4.x cluster? Try hadoop fs -ls hdfs://source_cluster_Active_NN:8020/tmp hadoop fs -ls hdfs://destination_cluster_Active_NN:8020/tmp Also, check if host is reachable from destination cluster host. And if above works, then try running Distcp with other user than hdfs. Try below: hadoop distcp -strategy dynamic -prgbup \ -<overwrite/update> \ hdfs://source_cluster_Active_NN:8020/<test_file_path> \ hdfs://destination_cluster_Active_NN:8020/<Test_file_path>
... View more
05-26-2016
06:03 AM
3 Kudos
@Timothy Spann Here is a quick and dirty way to do it. Had some time, so tried @Ravi Mutyala's suggestion and it works :). hive> create table test_orc_sqoop (name varchar(20)) ;
OK
Time taken: 0.729 seconds
hive> select * from test_orc_sqoop;
OK
Time taken: 0.248 seconds
hive> exit;
[hdfs@test-mon-wmt ~]$ sqoop import --connect jdbc:mysql://mon-WMT-upgrade.cloud.hortonworks.com/test --username test --password hadoop --table test --hcatalog-database default --hcatalog-table test_orc_sqoop --hcatalog-storage-stanza "stored as orcfile" -m 1
Warning: /usr/hdp/2.4.2.0-258/hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /usr/hdp/2.4.2.0-258/accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
16/05/26 05:56:03 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-258
16/05/26 05:56:03 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
16/05/26 05:56:04 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
16/05/26 05:56:04 INFO tool.CodeGenTool: Beginning code generation
16/05/26 05:56:05 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `test` AS t LIMIT 1
16/05/26 05:56:05 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `test` AS t LIMIT 1
16/05/26 05:56:05 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/hdp/2.4.2.0-258/hadoop-mapreduce
Note: /tmp/sqoop-hdfs/compile/64f04ad998cebf113bf8ec1efdbf6b95/test.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/05/26 05:56:10 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hdfs/compile/64f04ad998cebf113bf8ec1efdbf6b95/test.jar
16/05/26 05:56:10 WARN manager.MySQLManager: It looks like you are importing from mysql.
16/05/26 05:56:10 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
16/05/26 05:56:10 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
16/05/26 05:56:10 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
16/05/26 05:56:10 INFO mapreduce.ImportJobBase: Beginning import of test
16/05/26 05:56:11 INFO hcat.SqoopHCatUtilities: Configuring HCatalog for import job
16/05/26 05:56:11 INFO hcat.SqoopHCatUtilities: Configuring HCatalog specific details for job
16/05/26 05:56:11 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `test` AS t LIMIT 1
16/05/26 05:56:11 INFO hcat.SqoopHCatUtilities: Database column names projected : [name]
16/05/26 05:56:11 INFO hcat.SqoopHCatUtilities: Database column name - info map :
name : [Type : 12,Precision : 20,Scale : 0]
16/05/26 05:56:12 INFO hive.metastore: Trying to connect to metastore with URI thrift://rm-wmt-upgrade.cloud.hortonworks.com:9083
16/05/26 05:56:12 INFO hive.metastore: Connected to metastore.
16/05/26 05:56:14 INFO hcat.SqoopHCatUtilities: HCatalog full table schema fields = [name]
16/05/26 05:56:18 INFO hcat.SqoopHCatUtilities: HCatalog table partitioning key fields = []
16/05/26 05:56:18 INFO hcat.SqoopHCatUtilities: HCatalog projected schema fields = [name]
16/05/26 05:56:18 INFO hcat.SqoopHCatUtilities: HCatalog job : Hive Home = /usr/hdp/current/hive-client
16/05/26 05:56:18 INFO hcat.SqoopHCatUtilities: HCatalog job: HCatalog Home = /usr/hdp/2.4.2.0-258//sqoop/../hive-hcatalog
16/05/26 05:56:18 INFO hcat.SqoopHCatUtilities: Adding jar files under /usr/hdp/2.4.2.0-258//sqoop/../hive-hcatalog/share/hcatalog to distributed cache
..............
...........
16/05/26 05:56:18 INFO hcat.SqoopHCatUtilities: Adding jar files under /usr/hdp/2.4.2.0-258//sqoop/../hive-hcatalog/share/hcatalog/storage-handlers to distributed cache (recursively)
16/05/26 05:56:18 WARN hcat.SqoopHCatUtilities: No files under /usr/hdp/2.4.2.0-258/sqoop/../hive-hcatalog/share/hcatalog/storage-handlers to add to distributed cache for hcatalog job
16/05/26 05:56:18 INFO hcat.SqoopHCatUtilities: Validating dynamic partition keys
16/05/26 05:56:18 WARN hcat.SqoopHCatUtilities: The HCatalog field name has type varchar(20). Expected = varchar based on database column type : VARCHAR
16/05/26 05:56:18 WARN hcat.SqoopHCatUtilities: The Sqoop job can fail if types are not assignment compatible
16/05/26 05:56:18 INFO mapreduce.DataDrivenImportJob: Configuring mapper for HCatalog import job
16/05/26 05:56:20 INFO impl.TimelineClientImpl: Timeline service address: http://rm-wmt-upgrade.cloud.hortonworks.com:8188/ws/v1/timeline/
16/05/26 05:56:21 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
16/05/26 05:57:07 INFO db.DBInputFormat: Using read commited transaction isolation
16/05/26 05:57:07 INFO mapreduce.JobSubmitter: number of splits:1
16/05/26 05:57:07 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1464036504999_0008
16/05/26 05:57:11 INFO impl.YarnClientImpl: Submitted application application_1464036504999_0008
16/05/26 05:57:11 INFO mapreduce.Job: The url to track the job: http://nn1-wmt-upgrade.cloud.hortonworks.com:8088/proxy/application_1464036504999_0008/
16/05/26 05:57:11 INFO mapreduce.Job: Running job: job_1464036504999_0008
16/05/26 05:57:56 INFO mapreduce.Job: Job job_1464036504999_0008 running in uber mode : false
16/05/26 05:57:56 INFO mapreduce.Job: map 0% reduce 0%
16/05/26 05:58:25 INFO mapreduce.Job: map 100% reduce 0%
16/05/26 05:58:27 INFO mapreduce.Job: Job job_1464036504999_0008 completed successfully
16/05/26 05:58:27 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=302189
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=87
HDFS: Number of bytes written=22
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=17899
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=17899
Total vcore-seconds taken by all map tasks=17899
Total megabyte-seconds taken by all map tasks=12207118
Map-Reduce Framework
Map input records=3
Map output records=3
Input split bytes=87
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=189
CPU time spent (ms)=2610
Physical memory (bytes) snapshot=172310528
Virtual memory (bytes) snapshot=2470862848
Total committed heap usage (bytes)=58130432
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=0
16/05/26 05:58:27 INFO mapreduce.ImportJobBase: Transferred 22 bytes in 129.1108 seconds (0.1704 bytes/sec)
16/05/26 05:58:27 INFO mapreduce.ImportJobBase: Retrieved 3 records.
[hdfs@test-mon-wmt ~]$ hive
WARNING: Use "yarn jar" to launch YARN applications.
Logging initialized using configuration in file:/etc/hive/2.4.2.0-258/0/hive-log4j.properties
hive> select * from test_orc_sqoop;
OK
abcd
abcdef
abcdefghi
Time taken: 4.31 seconds, Fetched: 3 row(s)
... View more
05-26-2016
05:59 AM
1 Kudo
I agree with @Ravi Mutyala.. So unaccepted the answer to get right answer in place..
... View more
05-26-2016
12:01 AM
Glad that its resolved :).
... View more
05-25-2016
03:42 PM
1 Kudo
@Radhakrishnan Rk Refer to below article I had posted earlier to migrate Hue from SQLite to MySQL. https://community.hortonworks.com/questions/399/how-to-move-hue-database-from-default-sqlite-datab.html
... View more
05-24-2016
06:21 PM
@chennuri gouri shankar Is Ambari Metrics running in embedded mode or distributed mode?
... View more
05-24-2016
06:07 PM
1 Kudo
@mike harding Yes, you need to setup Ambari Server for LDAP. Refer below for the same. http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_Ambari_Security_Guide/content/_configuring_ambari_for_ldap_or_active_directory_authentication.html
... View more
05-24-2016
04:43 PM
Yes, I think you can delete if you don't want those.
... View more
