question Re: problem of creating solr collection of cloudera search in Archives of Support Questions (Read Only)

problem of creating solr collection of cloudera search

shota — Fri, 16 Sep 2022 08:48:03 GMT

Hi all

I am testing CDH 4.4 on cluster with 25 nodes, already installed cloudera search, I have running solr servers correctly

but have problem with adding collections, I generated a skeleton of the instance directory:

[solr@hadoop ~]$ solrctl instancedir --list
collection1

after that creating collection gives an error:

[solr@hadoop ~]$ solrctl collection --create collection1 -s 2
Error: A call to SolrCloud WEB APIs failed: HTTP/1.1 500 Internal Server Error
Server: Apache-Coyote/1.1
Content-Type: application/xml;charset=UTF-8
Transfer-Encoding: chunked
Date: Thu, 19 Sep 2013 12:47:50 GMT
Connection: close

<?xml version="1.0" encoding="UTF-8"?>

<response>

<lst name="responseHeader">
<int name="status">
500</int>
<int name="QTime">
60012</int>
</lst>
<lst name="error">
<str name="msg">
createcollection the collection time out:60s</str>
<str name="trace">
org.apache.solr.common.SolrException: createcollection the collection time out:60s
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:175)
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)
at org.apache.solr.handler.admin.CollectionsHandler.handleCreateAction(CollectionsHandler.java:290)
at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:112)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:666)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:224)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:164)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.solr.servlet.SolrHadoopAuthenticationFilter.doFilter(SolrHadoopAuthenticationFilter.java:131)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:662)
</str>
<int name="code">
500</int>
</lst>

</response>

have some idea?

thank you anyway

Re: problem of creating solr collection of cloudera search

cconner — Thu, 19 Sep 2013 14:34:44 GMT

Hello,

It seems like it is timing out for some reason. Can you try the following:

- First make sure that you can go to the Solr Admin UI on one host:

http://<hostname>:8983/solr/

- Once you confirmed that UI works. Then try:

solrctl --solr http://<hostname>:8983/solr collection --create collection1 -s 2

If that works, then it seems whichever Solr instance solrctl is getting from ZK is having an issue. Perhaps check each UI to see if any aren't working or restart them all and try again?

Hope this helps.

Thanks

Chris

Re: problem of creating solr collection of cloudera search

shota — Fri, 20 Sep 2013 07:07:59 GMT

Hi cconner thank you for reply
yes solr admin UI works and I tried restart service, but same error:

[solr@hadoop ~]$ solrctl --solr http://some.host:8983/solr collection --create collection1 -s 2
Error: A call to SolrCloud WEB APIs failed: HTTP/1.1 500 Internal Server Error
Server: Apache-Coyote/1.1
Content-Type: application/xml;charset=UTF-8
Transfer-Encoding: chunked
Date: Fri, 20 Sep 2013 06:47:15 GMT
Connection: close
<?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader">
<int name="status">
500</int>
<int name="QTime">
60022</int>
</lst>
<lst name="error">
<str name="msg">
createcollection the collection time out:60s</str>
<str name="trace">
org.apache.solr.common.SolrException: createcollection the collection time out:60s
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:175)
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)........
...............................

Re: problem of creating solr collection of cloudera search

Vamsee — Tue, 24 Sep 2013 20:45:45 GMT

Hi @shota

This is more of a check rather than a solution...

Are you using Cloudera Manager(CM) to manage the Solr service? If so, please make sure CM reports the Solr service as green and healthy.

If you have installed Solr through packages(without CM), make sure there is only one Solr service running, by issuing the service "sudo ps -elf | grep solr"

Re: problem of creating solr collection of cloudera search

shota — Wed, 25 Sep 2013 06:37:03 GMT

hello

yes I am using Cloudera manager. I installed Solr using yum(CM uses yum for installing, as I know) and after that I added Solr service in the CM and it reports Solr service as green and healthy.

I can not find any solution 😞

thank you

Re: problem of creating solr collection of cloudera search

Vamsee — Wed, 25 Sep 2013 18:15:36 GMT

Hi @shota

We will help you figure out the problem! 🙂

FYI, if you are using CM; you needn't install any Solr packages manually. CM does the complete setup for you.

From what i understand from your previous comment, you installed some solr packages manually and just to make sure we are on right setup, executing "$ ps -elf | grep solr" should result in listing only one solr process running in your system.

Once you have confirmed this, you can try refreshing the entire service.. (Assuming you have no stored data in Solr)

Stop the Solr service from CM
Restart the ZooKeeper service from CM
Issue this command "$ solrctl init --force"
Start the Solr service back from CM

Now you can try creating some collections..

-Vamsee

Re: problem of creating solr collection of cloudera search

shota — Thu, 26 Sep 2013 07:29:52 GMT

@Vamsee wrote:
@Hi @shota

We will help you figure out the problem! 🙂

FYI, if you are using CM; you needn't install any Solr packages manually. CM does the complete setup for you.

From what i understand from your previous comment, you installed some solr packages manually and just to make sure we are on right setup, executing "$ ps -elf | grep solr" should result in listing only one solr process running in your system.

Once you have confirmed this, you can try refreshing the entire service.. (Assuming you have no stored data in Solr)
Stop the Solr service from CM
Restart the ZooKeeper service from CM
Issue this command "$ solrctl init --force"
Start the Solr service back from CM
Now you can try creating some collections..

-Vamsee

It works

thank you very much

Re: problem of creating solr collection of cloudera search

shan — Thu, 10 Oct 2013 05:05:36 GMT

I am trying to install cloudera search in ubuntu 12.04 using
sudo apt-get install solr-server and not manager

The CLI says there is no such package. I have gone through ur installation guide but donot understand why there is a problem.

Kindly help.

Regards,
Sushant

Re: problem of creating solr collection of cloudera search

cconner — Wed, 16 Oct 2013 17:31:14 GMT

Hello,

Just to clarify, are you trying to do:

sudo apt-get install solr-server and not manager

or:

sudo apt-get install solr-server

Can you attach the contents of this file:

/etc/apt/sources.list

Thanks

Chris

Re: problem of creating solr collection of cloudera search

Ken Vanderheyden — Fri, 12 Dec 2014 12:00:46 GMT

Hi,

I'm facing the same issue, and the proposed solution did not work.

When saving an index in hue search on a tab delimited file, in cloudera CDH 5 i get this error:

{"message": "Could not create instance directory. Check if [indexer] solr_zk_ensemble is correct in Hue config and look at the Solr error logs for more info.", "traceback": [], "detail": "None", "title": "Error"}

Been searching for this everywhere, with no fix so far.

Any help is appreciated.

Thanks,

Ken.

Re: problem of creating solr collection of cloudera search

SunSmiles — Thu, 06 Aug 2015 17:46:07 GMT

First, try to index only couple of records.

If that doesn't work then recheck the data values and data types used.

If it works then index the data in small batches ... I faced a similar issue if more than 200 records are indexed.