Error in service installing

[#1]

I'm installing Cloudera Manager 5.02 and encounter errors when installing services.

#########Error Info#############

A server error has occurred. Send the following information to Cloudera.

Path: http://192.168.28.40:7180/cmf/clusters/1/express-add-services/review

Version: Cloudera Express 5.0.2 (#297 built by jenkins on 20140606-2221 git: 80907df78ba6b50c21a598f0caff8b00685d5961)

java.lang.IllegalArgumentException:Host 093bced7-b29f-4716-8a60-8f209ac4d8d6 may not join service 'oozie': Host software version incompatible with service version
at OperationsManagerImpl.java line 760
in com.cloudera.server.cmf.components.OperationsManagerImpl createRole()

 Stack Trace:

1. OperationsManagerImpl.java line 760
   in com.cloudera.server.cmf.components.OperationsManagerImpl createRole()
2. RulesCluster.java line 586
   in com.cloudera.server.cmf.cluster.RulesCluster createAndConfigureServices()
3. ExpressAddServicesWizardController.java line 585
   in com.cloudera.server.web.cmf.wizard.express.ExpressAddServicesWizardController buildCustomCluster()
4. ExpressAddServicesWizardController.java line 521
   in com.cloudera.server.web.cmf.wizard.express.ExpressAddServicesWizardController buildCluster()
5. ExpressAddServicesWizardController.java line 492
   in com.cloudera.server.web.cmf.wizard.express.ExpressAddServicesWizardController buildAccs()
6. ExpressAddServicesWizardController.java line 433
   in com.cloudera.server.web.cmf.wizard.express.ExpressAddServicesWizardController handleReview()
7. ExpressAddServicesWizardController.java line 405
   in com.cloudera.server.web.cmf.wizard.express.ExpressAddServicesWizardController renderReviewStep()
8. <generated> line -1
   in com.cloudera.server.web.cmf.wizard.express.ExpressAddServicesWizardController$$FastClassByCGLIB$$71adc282 invoke()
9. MethodProxy.java line 191
   in net.sf.cglib.proxy.MethodProxy invoke()
10. Cglib2AopProxy.java line 688
    in org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation invokeJoinpoint()
11. ReflectiveMethodInvocation.java line 150
    in org.springframework.aop.framework.ReflectiveMethodInvocation proceed()
12. MethodSecurityInterceptor.java line 61
    in org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor invoke()
13. ReflectiveMethodInvocation.java line 172
    in org.springframework.aop.framework.ReflectiveMethodInvocation proceed()
14. Cglib2AopProxy.java line 621
    in org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor intercept()
15. <generated> line -1
    in com.cloudera.server.web.cmf.wizard.express.ExpressAddServicesWizardController$$EnhancerByCGLIB$$26be3314 renderReviewStep()
16. NativeMethodAccessorImpl.java line -2
    in sun.reflect.NativeMethodAccessorImpl invoke0()
17. NativeMethodAccessorImpl.java line 57
    in sun.reflect.NativeMethodAccessorImpl invoke()
18. DelegatingMethodAccessorImpl.java line 43
    in sun.reflect.DelegatingMethodAccessorImpl invoke()
19. Method.java line 606
    in java.lang.reflect.Method invoke()
20. HandlerMethodInvoker.java line 176
    in org.springframework.web.bind.annotation.support.HandlerMethodInvoker invokeHandlerMethod()
21. AnnotationMethodHandlerAdapter.java line 436
    in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter invokeHandlerMethod()
22. AnnotationMethodHandlerAdapter.java line 424
    in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter handle()
23. DispatcherServlet.java line 790
    in org.springframework.web.servlet.DispatcherServlet doDispatch()
24. DispatcherServlet.java line 719
    in org.springframework.web.servlet.DispatcherServlet doService()
25. FrameworkServlet.java line 669
    in org.springframework.web.servlet.FrameworkServlet processRequest()
26. FrameworkServlet.java line 574
    in org.springframework.web.servlet.FrameworkServlet doGet()
27. HttpServlet.java line 575
    in javax.servlet.http.HttpServlet service()
28. HttpServlet.java line 668
    in javax.servlet.http.HttpServlet service()
29. ServletHolder.java line 511
    in org.mortbay.jetty.servlet.ServletHolder handle()
30. ServletHandler.java line 1221
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
31. UserAgentFilter.java line 78
    in org.mortbay.servlet.UserAgentFilter doFilter()
32. GzipFilter.java line 131
    in org.mortbay.servlet.GzipFilter doFilter()
33. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
34. JAMonServletFilter.java line 48
    in com.jamonapi.http.JAMonServletFilter doFilter()
35. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
36. JavaMelodyFacade.java line 109
    in com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter doFilter()
37. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
38. FilterChainProxy.java line 311
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
39. FilterSecurityInterceptor.java line 116
    in org.springframework.security.web.access.intercept.FilterSecurityInterceptor invoke()
40. FilterSecurityInterceptor.java line 83
    in org.springframework.security.web.access.intercept.FilterSecurityInterceptor doFilter()
41. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
42. ExceptionTranslationFilter.java line 113
    in org.springframework.security.web.access.ExceptionTranslationFilter doFilter()
43. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
44. SessionManagementFilter.java line 101
    in org.springframework.security.web.session.SessionManagementFilter doFilter()
45. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
46. AnonymousAuthenticationFilter.java line 113
    in org.springframework.security.web.authentication.AnonymousAuthenticationFilter doFilter()
47. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
48. RememberMeAuthenticationFilter.java line 146
    in org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter doFilter()
49. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
50. SecurityContextHolderAwareRequestFilter.java line 54
    in org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter doFilter()
51. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
52. RequestCacheAwareFilter.java line 45
    in org.springframework.security.web.savedrequest.RequestCacheAwareFilter doFilter()
53. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
54. AbstractAuthenticationProcessingFilter.java line 182
    in org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter doFilter()
55. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
56. LogoutFilter.java line 105
    in org.springframework.security.web.authentication.logout.LogoutFilter doFilter()
57. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
58. SecurityContextPersistenceFilter.java line 87
    in org.springframework.security.web.context.SecurityContextPersistenceFilter doFilter()
59. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
60. ConcurrentSessionFilter.java line 125
    in org.springframework.security.web.session.ConcurrentSessionFilter doFilter()
61. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
62. FilterChainProxy.java line 173
    in org.springframework.security.web.FilterChainProxy doFilter()
63. DelegatingFilterProxy.java line 237
    in org.springframework.web.filter.DelegatingFilterProxy invokeDelegate()
64. DelegatingFilterProxy.java line 167
    in org.springframework.web.filter.DelegatingFilterProxy doFilter()
65. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
66. CharacterEncodingFilter.java line 88
    in org.springframework.web.filter.CharacterEncodingFilter doFilterInternal()
67. OncePerRequestFilter.java line 76
    in org.springframework.web.filter.OncePerRequestFilter doFilter()
68. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
69. ServletHandler.java line 399
    in org.mortbay.jetty.servlet.ServletHandler handle()
70. SecurityHandler.java line 216
    in org.mortbay.jetty.security.SecurityHandler handle()
71. SessionHandler.java line 182
    in org.mortbay.jetty.servlet.SessionHandler handle()
72. SecurityHandler.java line 216
    in org.mortbay.jetty.security.SecurityHandler handle()
73. ContextHandler.java line 766
    in org.mortbay.jetty.handler.ContextHandler handle()
74. WebAppContext.java line 450
    in org.mortbay.jetty.webapp.WebAppContext handle()
75. HandlerWrapper.java line 152
    in org.mortbay.jetty.handler.HandlerWrapper handle()
76. StatisticsHandler.java line 53
    in org.mortbay.jetty.handler.StatisticsHandler handle()
77. HandlerWrapper.java line 152
    in org.mortbay.jetty.handler.HandlerWrapper handle()
78. Server.java line 326
    in org.mortbay.jetty.Server handle()
79. HttpConnection.java line 542
    in org.mortbay.jetty.HttpConnection handleRequest()
80. HttpConnection.java line 928
    in org.mortbay.jetty.HttpConnection$RequestHandler headerComplete()
81. HttpParser.java line 549
    in org.mortbay.jetty.HttpParser parseNext()
82. HttpParser.java line 212
    in org.mortbay.jetty.HttpParser parseAvailable()
83. HttpConnection.java line 404
    in org.mortbay.jetty.HttpConnection handle()
84. SelectChannelEndPoint.java line 410
    in org.mortbay.io.nio.SelectChannelEndPoint run()
85. QueuedThreadPool.java line 582
    in org.mortbay.thread.QueuedThreadPool$PoolThread run()

[#2]

What operating system are you using?

Are you installing CDH using parcels or packages?

Cloudera Manager will use whatever binaries you've told it to use. It won't try to install a different CDH version if there's a network issue. If it detects that binaries are already installed, then it will assume you've correctly installed the binaries that you want and skip that step.

In rhel-based systems, you can use "yum" to see what packages are installed. For example:
yum search zookeeper

This is basically how you install and manage any packages on the operating system, and has nothing to do with Cloudera, but just how your operating system works.

That will tell you what packages have names containing "zookeeper" and some basic information about them.

You can then learn more about a specific packages using the info command:
yum info zookeeper

From the info command, pay careful attention to whether the package is installed or not, and what version is installed. You're trying to install CDH 5, so any package that is CDH 4 is wrong. You'll probably find that every package reported by Host Inspector as CDH 4 will also be CDH 4 in your package manager (ie yum).

To uninstall something, use the appropriate command, which for yum is:
yum erase zookeeper

Thanks,
Darren

[#3]

It seems that it's the source of yum's problem.

The output of "yum info hue" is

#######

Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.btte.net
 * epel: mirrors.hust.edu.cn
 * extras: mirrors.btte.net
 * updates: mirrors.btte.net
Available Packages
Name       : hue
Arch       : x86_64
Version    : 3.6.0+cdh5.1.0+86
Release    : 1.cdh5.1.0.p0.36.el5
Size       : 2.3 k
Repo       : cloudera-cdh5
Summary    : The hue metapackage
URL        : http://github.com/cloudera/hue
License    : ASL 2.0
Description: Hue is a browser-based desktop interface for interacting with Hadoop.
           : It supports a file browser, job tracker interface, cluster health monitor, and more.

However "yum info zookeeper" is

##############

Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.btte.net
 * epel: mirrors.hust.edu.cn
 * extras: mirrors.btte.net
 * updates: mirrors.btte.net
Available Packages
Name       : zookeeper
Arch       : x86_64
Version    : 3.4.5+26
Release    : 1.cdh4.7.0.p0.17.el5
Size       : 3.9 M
Repo       : cloudera-cdh4
Summary    : A high-performance coordination service for distributed applications.
URL        : http://zookeeper.apache.org/
License    : APL2
Description: ZooKeeper is a centralized service for maintaining configuration information,
           : naming, providing distributed synchronization, and providing group services.
           : All of these kinds of services are used in some form or another by distributed
           : applications. Each time they are implemented there is a lot of work that goes
           : into fixing the bugs and race conditions that are inevitable. Because of the
           : difficulty of implementing these kinds of services, applications initially
           : usually skimp on them ,which make them brittle in the presence of change and
           : difficult to manage. Even when done correctly, different implementations of these services lead to
           : management complexity when the applications are deployed.

[#4]

Your yum info zookeeper shows that the packages is available, not installed (that's "Available Packages" means).

Was there more text from "yum info zookeeper" other than what you included here? yum can list both available and installed packages.

Does /usr/lib/zookeeper exist? It should not, if zookeeper is not installed. If it exists, what does the file /usr/lib/zookeeper/cloudera/cdh_version.properties say? If these exist, but yum doesn't think zookeeper is installed, then your machine somehow got put into a bad state where files exist for packages that are not installed, and you'll need to figure out how you got into that state and how best to fix it. Or reformat the thing, if you can.

Before doing anything drastic, make sure that both yum and rpm think the package isn't installed. You can learn more about these tools elsewhere (I'm not an expert here anyway).

Thanks,
Darren

[#5]

"/usr/lib/zookeeper" doesn't exist, so I think zookeeper has been completely uninstalled.

All text from "yum info zookeeper" is shown, which means that the only available version of zookeeper is CDH4 for my yum.
I think that maybe the problem.

However, the CDH5 version of other components are available except zookeeper and solr.

[#6]

How are you installing CDH 5? Manually? Via CM wizard?

Are you using packages or parcels?

What repository are you using for packages / parcels?

It is very strange that you have some cdh5 packages but not zookeeper or solr.

You should try running Host Inspector when you think everything in CDH has been uninstalled to ensure that CM agrees it is all uninstalled.

[#7 · Accepted solution]

Thanks for your patient help. I solve this problem finally.

It's the problem of repository. There are both CDH4 and CDH5 repo files exist in the /etc/yum.repos.d. After I remove all CDH4 repo files, yum can find CDH5 version.

[#8]

What distribution/version of linux are you installing on?

We need to look at actual packages installed on your system.  The examples below assume you are  on a RHEL variant, adjust for debian as necessary. 

Can you please provide the following:

rpm -qa | grep -i hadoop

rpm -qa | grep -i hue

rpm -qa | grep -i zookeeper

rpm -qa | grep -i hive

rpm -qa | grep -i cloudera

When we are saying "uninstall" we are saying "remove the packages" for For CM/CDH so that you can properly do a parcel based install.  Can you please share the URL from our documentation that you are following to uninstall/install as well.

Thanks

Todd

[#9]

Hi,

Can help you

 http://www.cloudera.com/content/support/en/downloads/cloudera_manager/cm-5-1-0.html

 Cloudera Manager Installation Guide.pdf - check uninstall guide

  you need to record the paths which you install the CDH