Member since
01-09-2015
16
Posts
2
Kudos Received
0
Solutions
02-06-2017
05:11 AM
Hello, I'm running Docker version 1.13.0, build 49bf474 on a CentOS server (CentOS Linux release 7.2.1511). I've just cloned clusterdock from https://github.com/clusterdock/framework and ran the following command: clusterdock_run ./bin/start_cluster cdh It is stuck in the Updating NameNode references in Hive metastore... phase. [root@node007 framework]# clusterdock_run ./bin/start_cluster cdh
INFO:clusterdock.cluster:Successfully started node-2.cluster (IP address: 192.168.123.3).
INFO:clusterdock.cluster:Successfully started node-1.cluster (IP address: 192.168.123.2).
INFO:clusterdock.cluster:Started cluster in 12.42 seconds.
INFO:clusterdock.topologies.cdh.actions:Changing server_host to node-1.cluster in /etc/cloudera-scm-agent/config.ini...
INFO:clusterdock.topologies.cdh.actions:Restarting CM agents...
cloudera-scm-agent is already stopped
Starting cloudera-scm-agent: [ OK ]
Stopping cloudera-scm-agent: [ OK ]
Starting cloudera-scm-agent: [ OK ]
INFO:clusterdock.topologies.cdh.actions:Waiting for Cloudera Manager server to come online...
INFO:clusterdock.topologies.cdh.actions:Detected Cloudera Manager server after 172.24 seconds.
INFO:clusterdock.topologies.cdh.actions:CM server is now accessible at http://node007.mycompany.local:32769
INFO:clusterdock.topologies.cdh.cm:Detected CM API v13.
INFO:clusterdock.topologies.cdh.cm_utils:Updating database configurations...
INFO:clusterdock.topologies.cdh.cm:Updating NameNode references in Hive metastore... Since the clusterdock is running on a CentOS server (CentOS Linux release 7.2.1511) without GUI capabilities, I've created an SSH tunnel from my machine to the server running clusterdock so that I could connect to Cloudera Manager from my local machine's web browser: ssh -L 32769:10.100.55.7:32769 root@10.100.55.7 When I connect to Cloudera Manager, I also see that Hive is stuck waiting for more than a few minutes: Update Hive Metastore to point to a NameNode's Nameservice name instead of hostname, normally performed after enabling HDFS High Availability. Back up Hive Metastore DB before running this command.
hive/hive.sh ["updatelocation","hdfs://node-1.cluster:8020"] See the screenshot below: I tried to view full log files, e.g. http://localhost:32769/cmf/process/67/logs?filename=stdout.log but I get HTTP ERROR 502
Problem accessing /cmf/process/67/logs. Reason:
BAD_GATEWAY And when I try to view the Role Log via http://localhost:32769/cmf/role/42/logs, I get the following: HTTP ERROR 500
Problem accessing /cmf/role/42/logs. Reason:
INTERNAL_SERVER_ERROR
Caused by:
java.lang.NullPointerException
at org.springframework.web.servlet.view.RedirectView.appendQueryProperties(RedirectView.java:252)
at org.springframework.web.servlet.view.RedirectView.renderMergedOutputModel(RedirectView.java:225)
at org.springframework.web.servlet.view.AbstractView.render(AbstractView.java:250)
at org.springframework.web.servlet.DispatcherServlet.render(DispatcherServlet.java:1047)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:817)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:669)
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:574)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:78)
at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:131)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at com.jamonapi.http.JAMonServletFilter.doFilter(JAMonServletFilter.java:48)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter.doFilter(JavaMelodyFacade.java:109)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:101)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:146)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:182)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.session.ConcurrentSessionFilter.doFilter(ConcurrentSessionFilter.java:125)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)
at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.handler.StatisticsHandler.handle(StatisticsHandler.java:53)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Powered by Jetty:// How can I fix this?
... View more
- Tags:
- clusterdock
- docker
Labels:
04-02-2015
12:51 AM
We have just upgraded our cluster to the latest version of CDH, now it is CDH 5.3.2 and we're using SolrJ version 4.4.0-cdh5.3.2 like: <dependency>
<groupId>org.apache.solr</groupId>
<artifactId>solr-solrj</artifactId>
<version>4.4.0-cdh5.3.2</version>
</dependency> And the same Java code as above, and we still get No live SolrServers available to handle this request exception. What should we do to send a document to Cloud Solr server via ZooKeeper?
... View more
03-31-2015
05:54 AM
1 Kudo
Hello, I'm using a CDH 5.3.0 cluster, and having problems when trying to use SolrJ (version 4.4.0-cdh5.3.0) to insert a document into Solr. According to the documentation, I can use code like the following to interact with ZooKeeper controlled SolrCloud server: import org.apache.solr.client.solrj.SolrServerException;
import org.apache.solr.client.solrj.impl.CloudSolrServer;
import org.apache.solr.common.SolrInputDocument;
import java.io.IOException;
public class standaloneCloud {
public static void main(String [] args) throws IOException, SolrServerException {
String myId = "myID";
String myUri = "this is for sure something usefull and stuff!";
String myLangCode = "ru";
String myType = "my_type!";
String zkHostString = "localhost:2181/solr"; // SSH tunnelled to ZooKeeper
CloudSolrServer server = new CloudSolrServer(zkHostString);
server.setDefaultCollection("collection3");
SolrInputDocument doc = new SolrInputDocument();
doc.addField("id", myId + "___" + "some keyword" );
doc.addField("uri", myUri );
doc.addField("alias", "some keyword" );
doc.addField("langCode", myLangCode );
doc.addField("type", myType);
server.add(doc);
server.commit();
}
} But when I run it, it gives the following exception: Exception in thread "main" org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:289)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:310)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at standaloneCloud.main(standaloneCloud.java:31)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140) I don't understand why it complains about no live Solr servers, because there are live Solr servers, there's a ZooKeeper at the given host:port, and I also checked that it returns the address of a valid Solr server on the cluster. To prove it, on the same cluster, I compile and run the following code that is very similar, only difference being the use of HttpSolrServer directly, instead of CloudSolrServer: import org.apache.solr.client.solrj.impl.HttpSolrServer;
import org.apache.solr.common.SolrInputDocument;
public class standalone {
public static void main(String [] args) {
try {
String myId = "myID";
String myUri = "this is for sure something usefull and stuff!";
String myLangCode = "ru";
String myType = "my_type!";
String solrString ="http://node04.demo.hadoop:8983/solr/collection3";
HttpSolrServer server = new HttpSolrServer(solrString);
SolrInputDocument doc = new SolrInputDocument();
doc.addField("id", myId + "___" + "some keyword" );
doc.addField("uri", myUri );
doc.addField("alias", "some keyword" );
doc.addField("langCode", myLangCode );
doc.addField("type", myType );
server.add(doc);
server.commit();
} catch (Exception e) {
System.out.println(e);
}
}
} The code above works perfectly fine and inserts the document to Solr to be indexed without any exceptions. So, why can't I use CloudSolrServer and send my document via ZooKeeper when I'm using SolrJ?
... View more
03-31-2015
12:57 AM
1 Kudo
Hello, According to http://www.cloudera.com/content/cloudera/en/training/certification/ccp-ds.html the whole procedure for being a Cloudera Certified Data Scientist has changed. But an important question has not been answered: As a person who passed the DS-200 Data Science Essentials test, but did not complete a practical challenge, what am I supposed to do? I can read that there are 3 new exams announced but Cloudera needs to take into account the fact that people like me: Paid for and attended the Data Science training. Studied hard for DS-200 exam. Paid for, took and passed the DS-200 exam. Is the Cloudera's plan to tell us something like: "Forget about the above. Wait for the new exams, and then we'll see."? I think an announcement (without required details) is not enough; Cloudera needs to make an explanation, including a justification. Kind regards.
... View more
01-09-2015
07:16 AM
Brad, Thank you very much, problem solved!
... View more
01-09-2015
06:56 AM
Hello Brad, Sorry, the problem persists. I clicked on the "Sign Out" link on the top right (next to my username), then logged in again, then tried to view the contents of the Data Science Challenge 3 but I cannot, still "Access Denied". Then I've tried signing out again. Still the same problem 😞
... View more
01-09-2015
06:39 AM
Hello,
I can't view the contents of the sub-forum: CCP: Data Scientist Challenge 3.
But I've already registered for CCP Data Science Challenge 3 (paid for it), received the description, started to examine the data sets, etc. When I try to view the forum it says:
"You do not have sufficient privileges for this resource or its parent to perform this action.
Click your browser's Back button to continue."
I have used a different e-mail address for Challenge registration (different from the one I used to register for community.cloudera.com), and I think this might be the problem, but I'm not sure.
Can one of the administrator check this and help me?
Kind regards,
Emre
... View more
Labels: