Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

expection in ambari infra solr instance

expection in ambari infra solr instance

Below exception is being thrown in the ambari infra solr logs. Any idea how to work around this problem ?

2016-10-19 15:41:53,003 [qtp100555887-308] ERROR [c:hadoop_logs s:shard0 r:core_node1 x:hadoop_logs_shard0_replica1] org.apache.solr.common.SolrException ( - org.apache.solr.common.SolrException: no servers hosting shard: shard1

	at org.apache.solr.handler.component.HttpShardHandler.prepDistributed(

	at org.apache.solr.handler.component.SearchHandler.getAndPrepShardHandler(

	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(

	at org.apache.solr.handler.RequestHandlerBase.handleRequest(

	at org.apache.solr.core.SolrCore.execute(

	at org.apache.solr.servlet.HttpSolrCall.execute(


	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(

	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(

	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(

	at org.eclipse.jetty.servlet.ServletHandler.doHandle(

	at org.eclipse.jetty.server.handler.ScopedHandler.handle(


	at org.eclipse.jetty.server.session.SessionHandler.doHandle(

	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(

	at org.eclipse.jetty.servlet.ServletHandler.doScope(

	at org.eclipse.jetty.server.session.SessionHandler.doScope(

	at org.eclipse.jetty.server.handler.ContextHandler.doScope(

	at org.eclipse.jetty.server.handler.ScopedHandler.handle(

	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(

	at org.eclipse.jetty.server.handler.HandlerCollection.handle(

	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(

	at org.eclipse.jetty.server.Server.handle(

	at org.eclipse.jetty.server.HttpChannel.handle(

	at org.eclipse.jetty.server.HttpConnection.onFillable(


	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(

	at org.eclipse.jetty.util.thread.QueuedThreadPool$



Re: expection in ambari infra solr instance

@Santhosh B Gowda

I guess you are hitting Please go through this link for more details. Also, note that this issue is still in open state.

Re: expection in ambari infra solr instance

It is also good to know, how solr reached to this state? Did you run any queries? Are your solr nodes in active/recovery state?


Re: expection in ambari infra solr instance

Can you restart the solr instance that is hosting the shard? After the restart, does the shard recover or stay dead?

Did the shard just die or was the solr instance killed, ran out of resources, etc.?

Re: expection in ambari infra solr instance

New Contributor

@Santhosh B Gowda

We had a similar issue where one of the cores wasn't allocated to a shard.
the root cause that made all this mess was that all servers had a very low configuration of open file descriptor limit (ulimit -n was 1024)
I found the following helped after fixing the ulimit issue:

on the "Cloud" view you can see the graph of correlation between collections, shards, cores, and solr nodes:

we were missing one of the links between shard to solr instance.

on the "Core Admin" view you can add the missing core, I kept the same standard as with all other cores:

instanceDir /opt/ambari_infra_solr/data/audit_logs_shard1_replica1

hope this helps!

Don't have an account?
Coming from Hortonworks? Activate your account here