Member since
02-11-2019
81
Posts
3
Kudos Received
0
Solutions
12-19-2019
11:56 AM
We don't have any indexes or collection in this cluster. Just trying to use it for Solr Search functions now. We were just running the tutorial to validate the Solr service configuration. Any steps we can take to re-initialize the service as new and get rid of any left over artifacts from the 5.14 will also be good as we don't have anything in the Search service yet. Regards
... View more
12-19-2019
11:19 AM
We weren't using the Solr service in the previous cluster. So we just removed the service during the upgrade and added it after the upgrade following the turorial we are able to create the 2 shard cores and the test collection. Just the execute query throws exception
... View more
12-18-2019
11:50 AM
Completed the Tutorial, but querying fails
Env:
Migrated from CDH 5.14 to CDH 6.2
Solr 7.4.0
Browsing to mysolrserver:8983/solr/test_collection/select?q=*:*&wt=json&indent=true
returns this error below.
{ "responseHeader":{ "zkConnected":true, "status":500, "QTime":1, "params":{ "q":"*:*", "indent":"true", "wt":"json"}}, "error":{ "trace":"java.lang.NullPointerException\n\tat org.apache.sentry.binding.solr.authz.SentrySolrPluginImpl.getShortUserName(SentrySolrPluginImpl.java:413)\n\tat org.apache.solr.handler.component.DocAuthorizationComponent.getUserName(DocAuthorizationComponent.java:80)\n\tat org.apache.solr.handler.component.DocAuthorizationComponent.prepare(DocAuthorizationComponent.java:95)\n\tat org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:272)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2548)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:764)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:521)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:376)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:322)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:513)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\n\tat org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:539)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:333)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:748)\n", "code":500}}
... View more
12-18-2019
10:30 AM
[The following question was moved here after originally being posted 12-18-1019 to this thread which was marked 'Solved' 12-17-2019 — Moderator]
The final step in the tutorial [presumably the one located here—Moderator]…Execute Query at the end of the tutorial results in this exception
trace":"java.lang.NullPointerException\n\tat org.apache.sentry.binding.solr.authz.SentrySolrPluginImpl.getShortUserName(SentrySolrPluginImpl.java:413)\n\tat org.apache.solr.handler.component.DocAuthorizationComponent.getUserName(DocAuthorizationComponent.java:80)\n\tat org.apache.solr.handler.component.DocAuthorizationComponent.prepare(DocAuthorizationComponent.java:95)\n\tat org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:272)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2548)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:764)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:521)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:376)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:322)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:513)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\n\tat org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:539)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:333)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:748)\n",
... View more
Labels:
- Labels:
-
Apache Solr
-
Cloudera Search
12-16-2019
02:10 PM
Hi Team,
Trying to follow the Tutorial in Cloudera Search deployment for CDH 6.2
Everything works until this command:
solrctl collection --create test_collection -s 2 -c test_collection_config
we get the exception:
{ "responseHeader":{ "status":0, "QTime":33610}, "failure":{ "gis18.example.com:8983_solr":"org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error from server at http://gis18.example.com:8983/solr: Error CREATEing SolrCore 'test_collection_shard1_replica_n1': Unable to create core [test_collection_shard1_replica_n1] Caused by: Permission denied: user=solr, access=WRITE, inode=\"/\":root:supergroup:drwxr-xr-x\n\tat org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:400)\n\tat org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:256)\n\tat org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:194)\n\tat org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1855)\n\tat org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1839)\n\tat org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1798)\n\tat org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:60)\n\tat org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3101)\n\tat org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1123)\n\tat org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:696)\n\tat org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)\n\tat org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523)\n\tat org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)\n\tat org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869)\n\tat org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815)\n\tat java.security.AccessController.doPrivileged(Native Method)\n\tat javax.security.auth.Subject.doAs(Subject.java:422)\n\tat org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)\n\tat org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675)\n",
Please help
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Cloudera Search
12-16-2019
12:23 PM
Hi,
New to Cloudera search.
How do I get the Solr.xml from zookeeper using solrctl tool or any other tools
Basically want to see the entire configuration for Solr service on the cluster
migrated cluster from 5.14 to 6.2
Cluster Info:
CDH 6.2
Lucene 7.4.0
... View more
Labels:
- Labels:
-
Apache Solr
-
Cloudera Search
11-28-2019
07:30 PM
I ended up creating a new column in new data frame via withColumn and used regex to populate the new column with the trimmed vals thanks
... View more
11-08-2019
08:51 PM
Need to remove leading zeros in a join expression DF1(TradeID) has values like "0000012345" and DF2(TradeRefNo) has no leading zeros i.e. "12345" val resultDf = Df1.join(Df2, Df1("TradeID") === Df2(TradeRefNo")) What's the best way to remove the leading from the first dataframe's DF1("TradeID") column values so the compare works correctly
... View more
Labels:
- Labels:
-
Apache Spark
10-05-2019
12:07 PM
So basically a situation where Hive is updating a table and impala clients are querying same table. Sometimes the impala queries throw missing hdfs files exception. How do we handle this
... View more
10-04-2019
09:42 PM
we have a beeline process that inserts data into a hive table
we can only access the table via impala views
so when the beeline job is done,
we want to refresh the tables and select rows from the table via impala views
could we write a user defined function that
1. refreshes the table in impala
2. selects * from the refreshed table
call that UDF from an impala view
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala