Member since
05-29-2017
408
Posts
123
Kudos Received
9
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2789 | 09-01-2017 06:26 AM | |
1701 | 05-04-2017 07:09 AM | |
1462 | 09-12-2016 05:58 PM | |
2082 | 07-22-2016 05:22 AM | |
1631 | 07-21-2016 07:50 AM |
07-20-2016
07:11 AM
Thanks @james.jones, I would do that, but if I don't mentioned it then where exactly zookeeper will save solr configuration(solrconfig.xml).
... View more
07-20-2016
06:57 AM
Thanks a lot @james.jones, I tried to download config before I push with new. But I am getting below error. SO can you please help me how can I download it. [root@m1 ~]# /opt/lucidworks-hdpsearch/solr/server/scripts/cloud-scripts/zkcli.sh -zkhost m1.hdp22:2181,m2.hdp22:2181,w1.hdp22:2181 -cmd downconfig -confdir /opt/lucidworks-hdpsearch/solr/server/solr/configsets/data_driven_schema_configs_hdfs/conf -confname myconf /opt/lucidworks-hdpsearch/solr/server/scripts/cloud-scripts INFO - 2016-07-19 09:05:38.706; org.apache.solr.common.cloud.SolrZkClient; Using default ZkCredentialsProvider INFO - 2016-07-19 09:05:38.732; org.apache.zookeeper.Environment; Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT INFO - 2016-07-19 09:05:38.732; org.apache.zookeeper.Environment; Client environment:host.name=m1.hdp22 INFO - 2016-07-19 09:05:38.734; org.apache.zookeeper.Environment; Client environment:java.version=1.7.0_75 INFO - 2016-07-19 09:05:38.734; org.apache.zookeeper.Environment; Client environment:java.vendor=Oracle Corporation s-hdpsearch/solr/server/scripts/cloud-scripts/../../lib/ext/slf4j-log4j12-1.7.7.jar:/opt/lucidworks-hdpsearch/solr/server/scripts/cloud-scripts/../../lib/ext/jul-to-slf4j-1.7.7.jar INFO - 2016-07-19 09:05:38.737; org.apache.zookeeper.Environment; Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib INFO - 2016-07-19 09:05:38.737; org.apache.zookeeper.Environment; Client environment:java.io.tmpdir=/tmp INFO - 2016-07-19 09:05:38.737; org.apache.zookeeper.Environment; Client environment:java.compiler=<NA> INFO - 2016-07-19 09:05:38.737; org.apache.zookeeper.Environment; Client environment:os.name=Linux INFO - 2016-07-19 09:05:38.737; org.apache.zookeeper.Environment; Client environment:os.arch=amd64 INFO - 2016-07-19 09:05:38.737; org.apache.zookeeper.Environment; Client environment:os.version=2.6.32-504.el6.x86_64 INFO - 2016-07-19 09:05:38.737; org.apache.zookeeper.Environment; Client environment:user.name=root INFO - 2016-07-19 09:05:38.738; org.apache.zookeeper.Environment; Client environment:user.home=/root INFO - 2016-07-19 09:05:38.738; org.apache.zookeeper.Environment; Client environment:user.dir=/root INFO - 2016-07-19 09:05:38.741; org.apache.zookeeper.ZooKeeper; Initiating client connection, connectString=m1.hdp22:2181,m2.hdp22:2181,w1.hdp22:2181 sessionTimeout=30000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@259709b1 INFO - 2016-07-19 09:05:38.759; org.apache.zookeeper.ClientCnxn$SendThread; Opening socket connection to server w1.hdp22/192.168.56.51:2181. Will not attempt to authenticate using SASL (unknown error) INFO - 2016-07-19 09:05:38.760; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper INFO - 2016-07-19 09:05:38.763; org.apache.zookeeper.ClientCnxn$SendThread; Socket connection established to w1.hdp22/192.168.56.51:2181, initiating session INFO - 2016-07-19 09:05:38.771; org.apache.zookeeper.ClientCnxn$SendThread; Session establishment complete on server w1.hdp22/192.168.56.51:2181, sessionid = 0x356021b7ffb0128, negotiated timeout = 30000 INFO - 2016-07-19 09:05:38.778; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@ce124a7 name:ZooKeeperConnection Watcher:m1.hdp22:2181,m2.hdp22:2181,w1.hdp22:2181 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None INFO - 2016-07-19 09:05:38.779; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper INFO - 2016-07-19 09:05:38.779; org.apache.solr.common.cloud.SolrZkClient; Using default ZkACLProvider INFO - 2016-07-19 09:05:38.799; org.apache.zookeeper.ClientCnxn$EventThread; EventThread shut down INFO - 2016-07-19 09:05:38.799; org.apache.zookeeper.ZooKeeper; Session: 0x356021b7ffb0128 closed Exception in thread "main" java.io.IOException: Error downloading files from zookeeper path /configs/myconf to /opt/lucidworks-hdpsearch/solr/server/solr/configsets/data_driven_schema_configs_hdfs/conf at org.apache.solr.common.cloud.ZkConfigManager.downloadFromZK(ZkConfigManager.java:107) at org.apache.solr.common.cloud.ZkConfigManager.downloadConfigDir(ZkConfigManager.java:131) at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:233) Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /configs/myconf at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472) at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:328) at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:325) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61) at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:325) at org.apache.solr.common.cloud.ZkConfigManager.downloadFromZK(ZkConfigManager.java:92) ... 2 more
... View more
07-19-2016
11:03 AM
I have setup solr in cloud mode with three different zookeeper servers and running all three solr instance on three different servers. I have setup solr to save index data on hdfs only. After starting all three instances I want to create a simple collection with two replica and two shards. But I am getting following error during collection creation. It seems that somewhere solr.hdfs.home is having wrong value for hdfs location. I have tried to check location for this properties but could not get. Command to start Solr in Cloud mode on all three servers: [solr@m1 solr]$ bin/solr start -c -z m1.hdp22:2181,m2.hdp22:2181,w1.hdp22:2181 -Dsolr.directoryFactory=HdfsDirectoryFactory -Dsolr.lock.type=hdfs -Dsolr.hdfs.home=hdfs://HDPTSTHA/user/solr Started Solr server on port 8983 (pid=1495). Happy searching! [solr@m1 solr]$ bin/solr status Found 1 Solr nodes: Solr process 1495 running on port 8983 { "solr_home":"/opt/lucidworks-hdpsearch/solr/server/solr/", "version":"5.2.1 1684708 - shalin - 2015-06-10 23:20:13", "startTime":"2016-07-19T09:21:03.245Z", "uptime":"0 days, 0 hours, 0 minutes, 6 seconds", "memory":"83.1 MB (%16.9) of 490.7 MB", "cloud":{ "ZooKeeper":"m1.hdp22:2181,m2.hdp22:2181,w1.hdp22:2181", "liveNodes”:"3", "collections":"0"}} Command to create collection : [solr@m1 solr]$ /opt/lucidworks-hdpsearch/solr/bin/solr create -c labs -d /opt/lucidworks-hdpsearch/solr/server/solr/configsets/data_driven_schema_configs_hdfs/conf -n labs -s 2 -rf 2 Connecting to ZooKeeper at m1.hdp22:2181,m2.hdp22:2181,w1.hdp22:2181 Re-using existing configuration directory labs Creating new collection 'labs' using command: http://192.168.56.41:8983/solr/admin/collections?action=CREATE&name=labs&numShards=1&replicationFactor=1&maxShardsPerNode=1&collection.configName=labs { "responseHeader":{ "status":0, "QTime":13353}, "failure":{"":"org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error from server at http://192.168.56.41:8983/solr: Error CREATEing SolrCore 'labs_shard1_replica1': Unable to create core [labs_shard1_replica1] Caused by: Uri without authority: hdfs:/m1.hdp22:8020/user/solr/labs/core_node1/data"}} Dir structure : solr@m1 data_driven_schema_configs_hdfs]$ cd conf/ [solr@m1 conf]$ ll total 148 -rw-r--r-- 1 solr hadoop 3974 Jul 14 01:34 currency.xml -rw-r--r-- 1 solr hadoop 1348 Jul 14 01:34 elevate.xml drwxr-xr-x 2 solr hadoop 4096 Jul 14 01:34 lang -rw-r--r-- 1 solr hadoop 55543 Jul 14 01:34 managed-schema -rw-r--r-- 1 solr hadoop 308 Jul 14 01:34 params.json -rw-r--r-- 1 solr hadoop 873 Jul 14 01:34 protwords.txt -rw-r--r-- 1 solr hadoop 62546 Jul 19 05:19 solrconfig.xml -rw-r--r-- 1 solr hadoop 781 Jul 14 01:34 stopwords.txt -rw-r--r-- 1 solr hadoop 1119 Jul 14 01:34 synonyms.txt [solr@m1 conf]$ pwd /opt/lucidworks-hdpsearch/solr/server/solr/configsets/data_driven_schema_configs_hdfs/confsolrconfig.xml
... View more
Labels:
- Labels:
-
Apache Solr
07-15-2016
12:33 PM
@ilker danyal kanatlı I am also getting following error, Can you please help me . [solr@m1 solr]$ bin/solr create -c SolrCollection -d /opt/lucidworks-hdpsearch/solr/server/solr/configsets/data_driven_schema_configs -n mySolrConfigs -s 2 -rf 2 Connecting to ZooKeeper at m1.hdp22:2181,m2.hdp22:2181,w1.hdp22:2181 Re-using existing configuration directory mySolrConfigs Creating new collection 'SolrCollection' using command: http://192.168.56.41:8983/solr/admin/collections?action=CREATE&name=SolrCollection&numShards=2&replicationFactor=2&maxShardsPerNode=4&collection.configName=mySolrConfigs { "responseHeader":{ "status":0, "QTime":1365}, "failure":{"":"org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error from server at http://192.168.56.41:8983/solr: Error CREATEing SolrCore 'SolrCollection_shard1_replica2': Unable to create core [SolrCollection_shard1_replica2] Caused by: Open quote is expected for attribute \"{1}\" associated with an element type \"name\"."}}
... View more
07-15-2016
10:45 AM
@Harsh Jain I am getting following error so Can you please help me to get it resolved. solr@m1 solr]$ bin/solr create -c SolrCollection -d /opt/lucidworks-hdpsearch/solr/server/solr/configsets/data_driven_schema_configs/ -n mySolrConfigs -s 2 -rf 2 Connecting to ZooKeeper at m1.hdp22:2181,m2.hdp22:2181,w1.hdp22:2181 Re-using existing configuration directory mySolrConfigs Creating new collection 'SolrCollection' using command: http://192.168.56.41:8983/solr/admin/collections?action=CREATE&name=SolrCollection&numShards=2&replicationFactor=2&maxShardsPerNode=4&collection.configName=mySolrConfigs { "responseHeader":{ "status":0, "QTime":1299}, "failure":{"":"org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error from server at http://192.168.56.41:8983/solr: Error CREATEing SolrCore 'SolrCollection_shard2_replica1': Unable to create core [SolrCollection_shard2_replica1] Caused by: Open quote is expected for attribute \"{1}\" associated with an element type \"name\"."}}
... View more
07-13-2016
12:04 PM
Thanks a lot @lgeorge. So you mean to say If I have 5(2M+3W) nodes cluster then I have to install Solr on all 3 worker nodes only or I need to install on 1 master and all 3 worker nodes as a part of server & client. Also I would be very thankful if can you please help me to get following answer as well. 1. If I will install HDP-Search and it has banana so whether banana will run as root user or banana user ? 2. Can we do ldap integration for both Solr and Banana UI ? 3. How many resources we need for HDP search like heap,RAM or CPU ? Thanks in advance.
... View more
07-13-2016
08:52 AM
@james.jones I followed all steps and changed solrconfig.xml file as well. But still getting below error. [solr@sandbox ~]$ /opt/lucidworks-hdpsearch/solr/bin/solr create -c labs -d /opt/lucidworks-hdpsearch/solr/server/solr/configsets/data_driven_schema_configs_hdfs/conf -n labs -s 2 -rf 2 Connecting to ZooKeeper at sandbox.hortonworks.com:2181 Re-using existing configuration directory labs Creating new collection 'labs' using command: http://172.16.162.136:8983/solr/admin/collections?action=CREATE&name=labs&numShards=2&replicationFactor=2&maxShardsPerNode=2&collection.configName=labs { "responseHeader":{ "status":0, "QTime":1284}, "failure":{"":"org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error from server at http://172.16.162.136:8983/solr: Error CREATEing SolrCore 'labs_shard1_replica2': Unable to create core [labs_shard1_replica2] Caused by: Can't find resource 'solrconfig.xml' in classpath or '/configs/labs', cwd=/opt/lucidworks-hdpsearch/solr/server"}} [solr@sandbox ~]$ ll /opt/lucidworks-hdpsearch/solr/server/solr/configsets/data_driven_schema_configs_hdfs/conf total 148 -rw-r--r-- 1 solr solr 3974 2016-07-13 08:05 currency.xml -rw-r--r-- 1 solr solr 1348 2016-07-13 08:05 elevate.xml drwxr-xr-x 2 solr solr 4096 2016-07-13 08:05 lang -rw-r--r-- 1 solr solr 55543 2016-07-13 08:05 managed-schema -rw-r--r-- 1 solr solr 308 2016-07-13 08:05 params.json -rw-r--r-- 1 solr solr 873 2016-07-13 08:05 protwords.txt -rw-r--r-- 1 solr solr 62754 2016-07-13 08:08 solrconfig.xml -rw-r--r-- 1 solr solr 781 2016-07-13 08:05 stopwords.txt -rw-r--r-- 1 solr solr 1119 2016-07-13 08:05 synonyms.txt
... View more