Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: The Cloudera Community will undergo maintenance on Saturday, August 17 at 12:00am PDT. See more info here.

Add Collection to Cloudera Search?

Add Collection to Cloudera Search?

New Contributor

Hi

 

We are Trying the cloudera manager, and we are trying to run solr whit the Hue Web Interface

 

But we have some problems , that from our experience we dont now how to solve.

 

we have install 2 Solr Server form the cloudera manager

Solr Server 10.152.156.194 

Solr Server 10.166.54.144

 

1) cloudera search doesnt find any Collections, when we access throght Hue web gui to cloudera search..

 

Se han importado todas las recolecciones disponibles del URL Solr en hue.ini. ( we have import all collections Avaliable from Solr URL in Hue.ini)

 

in the hue.ini file we have this configuration( The solr URL we configure as HUE web gui ip)

////////////////////////////////////////////////////////////////////
[search]

# URL of the Solr Server
solr_url=http://10.147.150.216:8983/solr/

# Requires FQDN in solr_url if enabled
## security_enabled=false

## Query sent when no term is entered
## empty_query=*:*

 //////////////////////////////////////////////////////////////////////////////////////

 

also in the first server Solr we have create one collection but doesnt seems to apper in the hue web gui

$ solrctl instancedir --create collection1 $HOME/solr_configs

 

 

Also in the cloudera Manager we have the Ks_indexer stop because we have an error in the configuration to index hbase data in Solr

and in the Hue Web Gui Hbase have a problem in the API conector , that we dont Know

 

Sould we fix all problem to search in Solr or any one has any idea how to fix this problem

 

Thanks

7 REPLIES 7

Re: Add Collection to Cloudera Search?

Are the collection appearig in the search drop down?

 

Could you check if the template of the collection is not just empty?

 

In the template editor, in 1. Snippet, can you add some fields from the available field list?

Re: Add Collection to Cloudera Search?

New Contributor
 
Highlighted

Re: Add Collection to Cloudera Search?

New Contributor

yes the templait is empty we have this issue , when we try to add information to cloudera search from hue GUI

 

 

Captura de pantalla 2013-09-21 a las 14.06.12.png

 

we think that the issue comes from hue

 

because we have this error at the begging in the file run/cloudera-scm-agent/process/196-hue-HUE_SERVER and also the Hbase server in unable to conect. to port 9090

 

 

Re: Add Collection to Cloudera Search?

Do you have collections and core when you open http://10.147.150.216:8983/solr/ ? Hue is just a view and is going to see the same.

 

HBase configuration is unrelated to this and I replied to http://community.cloudera.com/t5/Web-UI-Hue-Beeswax/hbase-unable-to-connect-to-Hue-UI/m-p/1715#U1715...

Re: Add Collection to Cloudera Search?

New Contributor

in the 3 solr services i found in the :8983/solr gui

 

SolrCore Initialization Failures

Please check your logs for more information

 

 so i check the /var/log/solr# cat solr-cmf-solr1-SOLR_SERVER-ip-10.xx.xxx.xxx.internal.log.out  and i found like 58 times the same error
 
i think that the error is that zookeper in not able to find solr, it look that for me...
 
Sould i configure on every solr server, or from the cloudera manager? to correct this error?
 
Regard's
 
////////////////////////////////////////////////// log file//////////////////////////////////////////////////////////////////////////////////////////////// 
 
 

2013-09-22 17:49:07,560 INFO org.apache.solr.common.cloud.ConnectionManager: Client is connected to ZooKeeper
2013-09-22 17:49:07,619 INFO org.apache.solr.common.cloud.ZkStateReader: Updating cluster state from ZooKeeper...
2013-09-22 17:49:08,673 INFO org.apache.solr.cloud.ZkController: Register node as live in ZooKeeper:/live_nodes/ip-10-xxx-xxx-xxx:8983_solr
2013-09-22 17:49:08,679 INFO org.apache.solr.common.cloud.SolrZkClient: makePath: /live_nodes/ip-10-xxx-xxx-xxx:8983_solr
2013-09-22 17:49:08,713 INFO org.apache.solr.common.cloud.ZkStateReader: Updating live nodes... (2)
2013-09-22 17:49:08,772 INFO org.apache.solr.servlet.SolrDispatchFilter: user.dir=/run/cloudera-scm-agent/process/278-solr-SOLR_SERVER
2013-09-22 17:49:08,772 INFO org.apache.solr.servlet.SolrDispatchFilter: SolrDispatchFilter.init() done
2013-09-22 17:49:09,077 INFO org.apache.solr.common.cloud.ZkStateReader: Updating live nodes... (3)
2013-09-22 18:28:33,463 INFO org.apache.solr.common.cloud.ZkStateReader: A cluster state change: WatchedEvent state:SyncConnected type:NodeDeleted path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
2013-09-22 18:28:33,474 ERROR org.apache.solr.common.cloud.ZkStateReader:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /clusterstate.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:252)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkStateReader$2.process(ZkStateReader.java:219)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
2013-09-22 18:28:33,477 ERROR org.apache.zookeeper.ClientCnxn: Error while calling watcher
org.apache.solr.common.cloud.ZooKeeperException:
at org.apache.solr.common.cloud.ZkStateReader$2.process(ZkStateReader.java:238)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /clusterstate.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:252)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkStateReader$2.process(ZkStateReader.java:219)
... 2 more
2013-09-22 18:28:33,517 INFO org.apache.solr.common.cloud.ZkStateReader: Updating aliases...
2013-09-22 18:28:33,518 ERROR org.apache.solr.common.cloud.ZkStateReader:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /aliases.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:252)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkStateReader$4.process(ZkStateReader.java:319)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
2013-09-22 18:28:33,518 ERROR org.apache.zookeeper.ClientCnxn: Error while calling watcher
org.apache.solr.common.cloud.ZooKeeperException:
at org.apache.solr.common.cloud.ZkStateReader$4.process(ZkStateReader.java:333)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /aliases.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:252)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkStateReader$4.process(ZkStateReader.java:319)
... 2 more
2013-09-22 18:28:33,567 INFO org.apache.solr.common.cloud.ZkStateReader: Updating live nodes... (2)
2013-09-22 18:28:33,574 INFO org.apache.solr.common.cloud.ZkStateReader: Updating live nodes... (1)
2013-09-22 18:28:33,579 INFO org.apache.solr.common.cloud.ZkStateReader: Updating live nodes... (0)
2013-09-22 18:28:33,583 ERROR org.apache.solr.common.cloud.ZkStateReader:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /live_nodes
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
at org.apache.solr.common.cloud.ZkStateReader$3.process(ZkStateReader.java:267)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
2013-09-22 18:28:33,583 ERROR org.apache.zookeeper.ClientCnxn: Error while calling watcher
org.apache.solr.common.cloud.ZooKeeperException:
at org.apache.solr.common.cloud.ZkStateReader$3.process(ZkStateReader.java:285)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /live_nodes
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
at org.apache.solr.common.cloud.ZkStateReader$3.process(ZkStateReader.java:267)
... 2 more

........(58 error more)

 

2013-09-24 08:01:15,491 ERROR org.apache.solr.servlet.SolrDispatchFilter: null:org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /aliases.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:252)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:249)
at org.apache.solr.common.cloud.ZkStateReader.updateAliases(ZkStateReader.java:556)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:291)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:164)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.solr.servlet.SolrHadoopAuthenticationFilter.doFilter(SolrHadoopAuthenticationFilter.java:131)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:662)

 

Re: Add Collection to Cloudera Search?

Cloudera Employee
@raf10x, Thanks for reaching out..

I notice that you are running
"$ solrctl instancedir --create collection1 $HOME/solr_configs" for creating the collection.

But this statement doesn't create the collection, it just uploads the configs to the ZooKeeper. In order to create an actual collection you may have to use,

$solrctl collection --create <CollectionName> -s <#Shards> -r <#Replicas> -c <Config uploaded to the ZooKeeper>

Ex:
$solrctl instancedir --create collection1config $HOME/solr_configs
$solrctl collection --create collection1 -s 1 -r 1 -c collection1config

Re: Add Collection to Cloudera Search?

New Contributor

Hi Vamsee, 

 

Im getting the following error when I run the upload config command

 

solrctl instancedir --create collection1 $HOME/solr_configs

 

And after that I get error stating "Error: can't upload configuration". When checked the log file I get the following error

 

2013-12-27 19:46:10,261 INFO org.apache.solr.common.cloud.ZkStateReader: Updating cloud state from ZooKeeper...
2013-12-27 19:46:10,261 ERROR org.apache.solr.cloud.Overseer: Exception in Overseer main queue loop
java.lang.IllegalArgumentException: Path must not end with / character
at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:58)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1450)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:618)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.removeCore(Overseer.java:642)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.processMessage(Overseer.java:182)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:142)
at java.lang.Thread.run(Thread.java:724)
2013-12-27 19:46:11,763 INFO org.apache.solr.common.cloud.ZkStateReader: Updating cloud state from ZooKeeper...
2013-12-27 19:46:11,764 ERROR org.apache.solr.cloud.Overseer: Exception in Overseer main queue loop
java.lang.IllegalArgumentException: Path must not end with / character
at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:58)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1450)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:618)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.removeCore(Overseer.java:642)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.processMessage(Overseer.java:182)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:142)
at java.lang.Thread.run(Thread.java:724)

 

Please help me how to proceed further. Thank you.