Error during add datanode service

[#1]

Hi All,

we met following error below when adding datanode services which in previously never happen at our cluster.

Path: http://hostnamexxxxx:7180/cmf/services/25/addRole/checkDbTestConn

Version: Cloudera Express 5.2.0 (#60 built by jenkins on 20141012-2239 git: 179000584849e68f98ad2a7fe710723bd6c29c98)

java.lang.RuntimeException:Failed to fetch embedded db users
at DbUtil.java line 686
in com.cloudera.enterprise.dbutil.DbUtil fetchEmbeddedDbUsers()

 Stack Trace:

1. DbUtil.java line 686
   in com.cloudera.enterprise.dbutil.DbUtil fetchEmbeddedDbUsers()
2. DbTestConnUtil.java line 340
   in com.cloudera.server.web.cmf.DbTestConnUtil populateDbTestConnInfos()
3. AddRoleWizard.java line 244
   in com.cloudera.server.web.cmf.wizard.service.AddRoleWizard getTestDatabaseData()
4. GenericAddRoleWizardController.java line 330
   in com.cloudera.server.web.cmf.wizard.service.GenericAddRoleWizardController getDbSetupData()
5. <generated> line -1
   in com.cloudera.server.web.cmf.wizard.service.GenericAddRoleWizardController$$FastClassByCGLIB$$3016baee invoke()
6. MethodProxy.java line 191
   in net.sf.cglib.proxy.MethodProxy invoke()
7. Cglib2AopProxy.java line 688
   in org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation invokeJoinpoint()
8. ReflectiveMethodInvocation.java line 150
   in org.springframework.aop.framework.ReflectiveMethodInvocation proceed()
9. MethodSecurityInterceptor.java line 61
   in org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor invoke()
10. ReflectiveMethodInvocation.java line 172
    in org.springframework.aop.framework.ReflectiveMethodInvocation proceed()
11. Cglib2AopProxy.java line 621
    in org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor intercept()
12. <generated> line -1
    in com.cloudera.server.web.cmf.wizard.service.GenericAddRoleWizardController$$EnhancerByCGLIB$$69955bfd getDbSetupData()
13. NativeMethodAccessorImpl.java line -2
    in sun.reflect.NativeMethodAccessorImpl invoke0()
14. NativeMethodAccessorImpl.java line 57
    in sun.reflect.NativeMethodAccessorImpl invoke()
15. DelegatingMethodAccessorImpl.java line 43
    in sun.reflect.DelegatingMethodAccessorImpl invoke()
16. Method.java line 606
    in java.lang.reflect.Method invoke()
17. HandlerMethodInvoker.java line 176
    in org.springframework.web.bind.annotation.support.HandlerMethodInvoker invokeHandlerMethod()
18. AnnotationMethodHandlerAdapter.java line 436
    in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter invokeHandlerMethod()
19. AnnotationMethodHandlerAdapter.java line 424
    in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter handle()
20. DispatcherServlet.java line 790
    in org.springframework.web.servlet.DispatcherServlet doDispatch()
21. DispatcherServlet.java line 719
    in org.springframework.web.servlet.DispatcherServlet doService()
22. FrameworkServlet.java line 669
    in org.springframework.web.servlet.FrameworkServlet processRequest()
23. FrameworkServlet.java line 574
    in org.springframework.web.servlet.FrameworkServlet doGet()
24. HttpServlet.java line 707
    in javax.servlet.http.HttpServlet service()
25. HttpServlet.java line 820
    in javax.servlet.http.HttpServlet service()
26. ServletHolder.java line 511
    in org.mortbay.jetty.servlet.ServletHolder handle()
27. ServletHandler.java line 1221
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
28. UserAgentFilter.java line 78
    in org.mortbay.servlet.UserAgentFilter doFilter()
29. GzipFilter.java line 131
    in org.mortbay.servlet.GzipFilter doFilter()
30. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
31. JAMonServletFilter.java line 48
    in com.jamonapi.http.JAMonServletFilter doFilter()
32. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
33. JavaMelodyFacade.java line 109
    in com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter doFilter()
34. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
35. FilterChainProxy.java line 311
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
36. FilterSecurityInterceptor.java line 116
    in org.springframework.security.web.access.intercept.FilterSecurityInterceptor invoke()
37. FilterSecurityInterceptor.java line 83
    in org.springframework.security.web.access.intercept.FilterSecurityInterceptor doFilter()
38. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
39. ExceptionTranslationFilter.java line 113
    in org.springframework.security.web.access.ExceptionTranslationFilter doFilter()
40. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
41. SessionManagementFilter.java line 101
    in org.springframework.security.web.session.SessionManagementFilter doFilter()
42. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
43. AnonymousAuthenticationFilter.java line 113
    in org.springframework.security.web.authentication.AnonymousAuthenticationFilter doFilter()
44. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
45. RememberMeAuthenticationFilter.java line 146
    in org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter doFilter()
46. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
47. SecurityContextHolderAwareRequestFilter.java line 54
    in org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter doFilter()
48. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
49. RequestCacheAwareFilter.java line 45
    in org.springframework.security.web.savedrequest.RequestCacheAwareFilter doFilter()
50. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
51. AbstractAuthenticationProcessingFilter.java line 182
    in org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter doFilter()
52. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
53. LogoutFilter.java line 105
    in org.springframework.security.web.authentication.logout.LogoutFilter doFilter()
54. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
55. SecurityContextPersistenceFilter.java line 87
    in org.springframework.security.web.context.SecurityContextPersistenceFilter doFilter()
56. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
57. ConcurrentSessionFilter.java line 125
    in org.springframework.security.web.session.ConcurrentSessionFilter doFilter()
58. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
59. FilterChainProxy.java line 173
    in org.springframework.security.web.FilterChainProxy doFilter()
60. DelegatingFilterProxy.java line 237
    in org.springframework.web.filter.DelegatingFilterProxy invokeDelegate()
61. DelegatingFilterProxy.java line 167
    in org.springframework.web.filter.DelegatingFilterProxy doFilter()
62. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
63. CharacterEncodingFilter.java line 88
    in org.springframework.web.filter.CharacterEncodingFilter doFilterInternal()
64. OncePerRequestFilter.java line 76
    in org.springframework.web.filter.OncePerRequestFilter doFilter()
65. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
66. ServletHandler.java line 399
    in org.mortbay.jetty.servlet.ServletHandler handle()
67. SecurityHandler.java line 216
    in org.mortbay.jetty.security.SecurityHandler handle()
68. SessionHandler.java line 182
    in org.mortbay.jetty.servlet.SessionHandler handle()
69. SecurityHandler.java line 216
    in org.mortbay.jetty.security.SecurityHandler handle()
70. ContextHandler.java line 766
    in org.mortbay.jetty.handler.ContextHandler handle()
71. WebAppContext.java line 450
    in org.mortbay.jetty.webapp.WebAppContext handle()
72. HandlerWrapper.java line 152
    in org.mortbay.jetty.handler.HandlerWrapper handle()
73. StatisticsHandler.java line 53
    in org.mortbay.jetty.handler.StatisticsHandler handle()
74. HandlerWrapper.java line 152
    in org.mortbay.jetty.handler.HandlerWrapper handle()
75. Server.java line 326
    in org.mortbay.jetty.Server handle()
76. HttpConnection.java line 542
    in org.mortbay.jetty.HttpConnection handleRequest()
77. HttpConnection.java line 928
    in org.mortbay.jetty.HttpConnection$RequestHandler headerComplete()
78. HttpParser.java line 549
    in org.mortbay.jetty.HttpParser parseNext()
79. HttpParser.java line 212
    in org.mortbay.jetty.HttpParser parseAvailable()
80. HttpConnection.java line 404
    in org.mortbay.jetty.HttpConnection handle()
81. SelectChannelEndPoint.java line 410
    in org.mortbay.io.nio.SelectChannelEndPoint run()
82. QueuedThreadPool.java line 582
    in org.mortbay.thread.QueuedThreadPool$PoolThread run()

Caused by: org.postgresql.util.PSQLException:FATAL: password authentication failed for user "cloudera-scm"
at ConnectionFactoryImpl.java line 291
in org.postgresql.core.v3.ConnectionFactoryImpl doAuthentication()

 Stack Trace:

1. ConnectionFactoryImpl.java line 291
   in org.postgresql.core.v3.ConnectionFactoryImpl doAuthentication()
2. ConnectionFactoryImpl.java line 108
   in org.postgresql.core.v3.ConnectionFactoryImpl openConnectionImpl()
3. ConnectionFactory.java line 66
   in org.postgresql.core.ConnectionFactory openConnection()
4. AbstractJdbc2Connection.java line 125
   in org.postgresql.jdbc2.AbstractJdbc2Connection <init>()
5. AbstractJdbc3Connection.java line 30
   in org.postgresql.jdbc3.AbstractJdbc3Connection <init>()
6. AbstractJdbc3gConnection.java line 22
   in org.postgresql.jdbc3g.AbstractJdbc3gConnection <init>()
7. AbstractJdbc4Connection.java line 30
   in org.postgresql.jdbc4.AbstractJdbc4Connection <init>()
8. Jdbc4Connection.java line 24
   in org.postgresql.jdbc4.Jdbc4Connection <init>()
9. Driver.java line 393
   in org.postgresql.Driver makeConnection()
10. Driver.java line 267
    in org.postgresql.Driver connect()
11. DriverManager.java line 571
    in java.sql.DriverManager getConnection()
12. DriverManager.java line 215
    in java.sql.DriverManager getConnection()
13. SqlRunner.java line 109
    in com.cloudera.enterprise.dbutil.SqlRunner open()
14. SqlRunner.java line 80
    in com.cloudera.enterprise.dbutil.SqlRunner runSingleQuery()
15. DbUtil.java line 679
    in com.cloudera.enterprise.dbutil.DbUtil fetchEmbeddedDbUsers()
16. DbTestConnUtil.java line 340
    in com.cloudera.server.web.cmf.DbTestConnUtil populateDbTestConnInfos()
17. AddRoleWizard.java line 244
    in com.cloudera.server.web.cmf.wizard.service.AddRoleWizard getTestDatabaseData()
18. GenericAddRoleWizardController.java line 330
    in com.cloudera.server.web.cmf.wizard.service.GenericAddRoleWizardController getDbSetupData()
19. <generated> line -1
    in com.cloudera.server.web.cmf.wizard.service.GenericAddRoleWizardController$$FastClassByCGLIB$$3016baee invoke()
20. MethodProxy.java line 191
    in net.sf.cglib.proxy.MethodProxy invoke()
21. Cglib2AopProxy.java line 688
    in org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation invokeJoinpoint()
22. ReflectiveMethodInvocation.java line 150
    in org.springframework.aop.framework.ReflectiveMethodInvocation proceed()
23. MethodSecurityInterceptor.java line 61
    in org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor invoke()
24. ReflectiveMethodInvocation.java line 172
    in org.springframework.aop.framework.ReflectiveMethodInvocation proceed()
25. Cglib2AopProxy.java line 621
    in org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor intercept()
26. <generated> line -1
    in com.cloudera.server.web.cmf.wizard.service.GenericAddRoleWizardController$$EnhancerByCGLIB$$69955bfd getDbSetupData()
27. NativeMethodAccessorImpl.java line -2
    in sun.reflect.NativeMethodAccessorImpl invoke0()
28. NativeMethodAccessorImpl.java line 57
    in sun.reflect.NativeMethodAccessorImpl invoke()
29. DelegatingMethodAccessorImpl.java line 43
    in sun.reflect.DelegatingMethodAccessorImpl invoke()
30. Method.java line 606
    in java.lang.reflect.Method invoke()
31. HandlerMethodInvoker.java line 176
    in org.springframework.web.bind.annotation.support.HandlerMethodInvoker invokeHandlerMethod()
32. AnnotationMethodHandlerAdapter.java line 436
    in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter invokeHandlerMethod()
33. AnnotationMethodHandlerAdapter.java line 424
    in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter handle()
34. DispatcherServlet.java line 790
    in org.springframework.web.servlet.DispatcherServlet doDispatch()
35. DispatcherServlet.java line 719
    in org.springframework.web.servlet.DispatcherServlet doService()
36. FrameworkServlet.java line 669
    in org.springframework.web.servlet.FrameworkServlet processRequest()
37. FrameworkServlet.java line 574
    in org.springframework.web.servlet.FrameworkServlet doGet()
38. HttpServlet.java line 707
    in javax.servlet.http.HttpServlet service()
39. HttpServlet.java line 820
    in javax.servlet.http.HttpServlet service()
40. ServletHolder.java line 511
    in org.mortbay.jetty.servlet.ServletHolder handle()
41. ServletHandler.java line 1221
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
42. UserAgentFilter.java line 78
    in org.mortbay.servlet.UserAgentFilter doFilter()
43. GzipFilter.java line 131
    in org.mortbay.servlet.GzipFilter doFilter()
44. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
45. JAMonServletFilter.java line 48
    in com.jamonapi.http.JAMonServletFilter doFilter()
46. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
47. JavaMelodyFacade.java line 109
    in com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter doFilter()
48. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
49. FilterChainProxy.java line 311
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
50. FilterSecurityInterceptor.java line 116
    in org.springframework.security.web.access.intercept.FilterSecurityInterceptor invoke()
51. FilterSecurityInterceptor.java line 83
    in org.springframework.security.web.access.intercept.FilterSecurityInterceptor doFilter()
52. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
53. ExceptionTranslationFilter.java line 113
    in org.springframework.security.web.access.ExceptionTranslationFilter doFilter()
54. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
55. SessionManagementFilter.java line 101
    in org.springframework.security.web.session.SessionManagementFilter doFilter()
56. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
57. AnonymousAuthenticationFilter.java line 113
    in org.springframework.security.web.authentication.AnonymousAuthenticationFilter doFilter()
58. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
59. RememberMeAuthenticationFilter.java line 146
    in org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter doFilter()
60. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
61. SecurityContextHolderAwareRequestFilter.java line 54
    in org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter doFilter()
62. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
63. RequestCacheAwareFilter.java line 45
    in org.springframework.security.web.savedrequest.RequestCacheAwareFilter doFilter()
64. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
65. AbstractAuthenticationProcessingFilter.java line 182
    in org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter doFilter()
66. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
67. LogoutFilter.java line 105
    in org.springframework.security.web.authentication.logout.LogoutFilter doFilter()
68. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
69. SecurityContextPersistenceFilter.java line 87
    in org.springframework.security.web.context.SecurityContextPersistenceFilter doFilter()
70. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
71. ConcurrentSessionFilter.java line 125
    in org.springframework.security.web.session.ConcurrentSessionFilter doFilter()
72. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
73. FilterChainProxy.java line 173
    in org.springframework.security.web.FilterChainProxy doFilter()
74. DelegatingFilterProxy.java line 237
    in org.springframework.web.filter.DelegatingFilterProxy invokeDelegate()
75. DelegatingFilterProxy.java line 167
    in org.springframework.web.filter.DelegatingFilterProxy doFilter()
76. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
77. CharacterEncodingFilter.java line 88
    in org.springframework.web.filter.CharacterEncodingFilter doFilterInternal()
78. OncePerRequestFilter.java line 76
    in org.springframework.web.filter.OncePerRequestFilter doFilter()
79. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
80. ServletHandler.java line 399
    in org.mortbay.jetty.servlet.ServletHandler handle()
81. SecurityHandler.java line 216
    in org.mortbay.jetty.security.SecurityHandler handle()
82. SessionHandler.java line 182
    in org.mortbay.jetty.servlet.SessionHandler handle()
83. SecurityHandler.java line 216
    in org.mortbay.jetty.security.SecurityHandler handle()
84. ContextHandler.java line 766
    in org.mortbay.jetty.handler.ContextHandler handle()
85. WebAppContext.java line 450
    in org.mortbay.jetty.webapp.WebAppContext handle()
86. HandlerWrapper.java line 152
    in org.mortbay.jetty.handler.HandlerWrapper handle()
87. StatisticsHandler.java line 53
    in org.mortbay.jetty.handler.StatisticsHandler handle()
88. HandlerWrapper.java line 152
    in org.mortbay.jetty.handler.HandlerWrapper handle()
89. Server.java line 326
    in org.mortbay.jetty.Server handle()
90. HttpConnection.java line 542
    in org.mortbay.jetty.HttpConnection handleRequest()
91. HttpConnection.java line 928
    in org.mortbay.jetty.HttpConnection$RequestHandler headerComplete()
92. HttpParser.java line 549
    in org.mortbay.jetty.HttpParser parseNext()
93. HttpParser.java line 212
    in org.mortbay.jetty.HttpParser parseAvailable()
94. HttpConnection.java line 404
    in org.mortbay.jetty.HttpConnection handle()
95. SelectChannelEndPoint.java line 410
    in org.mortbay.io.nio.SelectChannelEndPoint run()
96. QueuedThreadPool.java line 582
    in org.mortbay.thread.QueuedThreadPool$PoolThread run()

any response will greatly appricated,

-mugi-

[#2]

It sounds like there's a problem connecting to the embedded db. Do you have the embedded postgresql database set up?

Does the password in /var/lib/cloudera-scm-server-db/data/generated_password.txt work for the cloudera-scm user? (psql -h localhost -U cloudera-scm -p 7432 )

Is your CM server still configured to use that database? (/etc/cloudera-scm-server/db.properties)

Does this file exist? /etc/cloudera-scm-server/db.mgmt.properties

[#3]

Hi,

we still using postgresql CM DB and already check to etc/cloudera-scm-server/db.mgmt.properties all connection ok. All Cloudera manager management services running well and never any trouble, command "psql -h localhost -U cloudera-scm -p 7432" executed with no error it mean with we can connect using cloudera-scm to postgresql through psql.

regards,

-mugi-

[#4]

That's pretty surprising, since the error message clearly said there was a problem logging in to postgresql as cloudera-scm, and CM will always use the password in /var/lib/cloudera-scm-server-db/data/generated_password.txt to connect to this account.

Just to confirm, you used the same password in /var/lib/cloudera-scm-server-db/data/generated_password.txt to log in, right?

Also, the format of that file should look like:

$PASSWORD

The password above was generated by $0 (part of the cloudera-manager-server-db package)
and is the password for the user 'cloudera-scm' for the database in the current directory.

Generated at $NOW.


If it was modified, like if something was added to the top of the file, that could cause an issue. I admit this is a long shot.

[#5]

yes,

and the file format is same like you type here. Btw, i still curious with this error on our production cluster cause on our development cluster it's never happen whereas the CDH version of both cluster are same.

regards,

-mugi-

[#6]

Sadly I'm out of theories as to why it isn't working as expected = /

It's worth noting that the embedded db is not recommended for production. In addition to the normal reasons for not using it (performance, manageability, etc), moving off of the embedded db will definitely make this error go away, as it wouldn't even invoke that code path.

You could also try renaming /etc/cloudera-scm-server/db.mgmt.properties so that CM no longer sees it, and restarting CM. This will probably disable the features around automatic database creation (ie you have to create the user and database manually, but CM will still create the tables for you), but will also probably avoid the bug you're seeing.

[#7]

I must confirm to our hadoop admin which method that they us when installing cloudera manager. but our question what are the differences about the embedded database and the other ? is it just only separate machine or it can be install on same machine with enough capacity to cater the load.

regards,

-mugi-

[#8 · Accepted solution]

The database can live on the same machine as CM. Having it separate generally makes it easier to tune and manage, which can be important in production.

As your cluster grows, it is helpful to split up the databases needed by various roles / services to different machines.

The database guide has relevant reading. If you click on the links to the individual database guides at the bottom (mysql, oracle, external postgres) you'll see some additional guidelines.
http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_ig_installing_config...

Thanks,
Darren

[#9]

Hi Darren,

thank's before for quick response. is there any guidance for sizing CM server and DB hardware spesification? we hava a plan to add more nodes in our production cluster.

regards,

-mugi-

[#10]

Hi Mugi,

The docs I linked offer some guidance for things like max connections, which can help determine the sizing of your DB hardware.

Usually the DB load from CM and monitoring is not extreme, but for 20+ node clusters we recommend splitting all monitoring roles and databases to be on a separate host than CM server to spread the load. How many can be shared on a host depends on cluster size.

I'm frankly not an expert in this area, but others may be able to chime in. You can also of course get official support for your cluster and get reliable access to this kind of expertise (</shameless plug>).

Thanks,
Darren