Cloudera Not Loading Up

[#1]

Hi,

After login into Cloudera, can't able to browse any section. Below is the stack trace of error.

Kindly help.

A server error has occurred. Send the following information to Cloudera.

Path: http://*******:7180/cmf/services/3/config2/metadata.json

Version: Cloudera Express 5.5.3 (#1 built by jenkins on 20160216-1045 git: d7746acd0dc9054eeb350b73a781e38124736d9f)

javax.persistence.EntityNotFoundException:Unable to find com.cloudera.cmf.model.DbConfig with id 289
at Ejb3Configuration.java line 157
in org.hibernate.ejb.Ejb3Configuration$Ejb3EntityNotFoundDelegate handleEntityNotFound()

Stack Trace:

1. Ejb3Configuration.java line 157
   in org.hibernate.ejb.Ejb3Configuration$Ejb3EntityNotFoundDelegate handleEntityNotFound()
2. DefaultLoadEventListener.java line 212
   in org.hibernate.event.internal.DefaultLoadEventListener load()
3. DefaultLoadEventListener.java line 262
   in org.hibernate.event.internal.DefaultLoadEventListener proxyOrLoad()
4. DefaultLoadEventListener.java line 150
   in org.hibernate.event.internal.DefaultLoadEventListener onLoad()
5. SessionImpl.java line 1092
   in org.hibernate.internal.SessionImpl fireLoad()
6. SessionImpl.java line 1019
   in org.hibernate.internal.SessionImpl internalLoad()
7. EntityType.java line 672
   in org.hibernate.type.EntityType resolveIdentifier()
8. ManyToOneType.java line 280
   in org.hibernate.type.ManyToOneType assemble()
9. PersistentSet.java line 141
   in org.hibernate.collection.internal.PersistentSet initializeFromCache()
10. CollectionCacheEntry.java line 57
    in org.hibernate.cache.spi.entry.CollectionCacheEntry assemble()
11. DefaultInitializeCollectionEventListener.java line 148
    in org.hibernate.event.internal.DefaultInitializeCollectionEventListener initializeCollectionFromCache()
12. DefaultInitializeCollectionEventListener.java line 69
    in org.hibernate.event.internal.DefaultInitializeCollectionEventListener onInitializeCollection()
13. SessionImpl.java line 1849
    in org.hibernate.internal.SessionImpl initializeCollection()
14. AbstractPersistentCollection.java line 549
    in org.hibernate.collection.internal.AbstractPersistentCollection$4 doWork()
15. AbstractPersistentCollection.java line 234
    in org.hibernate.collection.internal.AbstractPersistentCollection withTemporarySessionIfNeeded()
16. AbstractPersistentCollection.java line 545
    in org.hibernate.collection.internal.AbstractPersistentCollection initialize()
17. AbstractPersistentCollection.java line 124
    in org.hibernate.collection.internal.AbstractPersistentCollection read()
18. PersistentSet.java line 180
    in org.hibernate.collection.internal.PersistentSet iterator()
19. MutationBustingSet.java line 64
    in com.cloudera.cmf.model.MutationBustingSet iterator()
20. DbService.java line 607
    in com.cloudera.cmf.model.DbService prepareCachedMaskedConfigs()
21. DbService.java line 695
    in com.cloudera.cmf.model.DbService getServiceConfig()
22. NotificationSuppressionConfig.java line 432
    in com.cloudera.cmf.service.config.NotificationSuppressionConfig create()
23. NotificationSuppressionConfig.java line 458
    in com.cloudera.cmf.service.config.NotificationSuppressionConfig create()
24. ValidationMessage.java line 47
    in com.cloudera.server.web.cmf.config.ValidationMessage <init>()
25. GroupableValidationMessage.java line 34
    in com.cloudera.server.web.cmf.config.GroupableValidationMessage <init>()
26. GenericConfigResponse.java line 295
    in com.cloudera.server.web.cmf.config.GenericConfigResponse$Builder addProperties()
27. GenericConfigHelper.java line 313
    in com.cloudera.server.web.cmf.config.components.GenericConfigHelper addConfigForServiceCascaded()
28. GenericConfigHelper.java line 275
    in com.cloudera.server.web.cmf.config.components.GenericConfigHelper getConfigForService()
29. GenericConfigController.java line 114
    in com.cloudera.server.web.cmf.GenericConfigController serviceConfigPageMetadata()
30. line -1
    in sun.reflect.GeneratedMethodAccessor2402 invoke()
31. DelegatingMethodAccessorImpl.java line 43
    in sun.reflect.DelegatingMethodAccessorImpl invoke()
32. Method.java line 606
    in java.lang.reflect.Method invoke()
33. HandlerMethodInvoker.java line 176
    in org.springframework.web.bind.annotation.support.HandlerMethodInvoker invokeHandlerMethod()
34. AnnotationMethodHandlerAdapter.java line 436
    in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter invokeHandlerMethod()
35. AnnotationMethodHandlerAdapter.java line 424
    in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter handle()
36. DispatcherServlet.java line 790
    in org.springframework.web.servlet.DispatcherServlet doDispatch()
37. DispatcherServlet.java line 719
    in org.springframework.web.servlet.DispatcherServlet doService()
38. FrameworkServlet.java line 669
    in org.springframework.web.servlet.FrameworkServlet processRequest()
39. FrameworkServlet.java line 574
    in org.springframework.web.servlet.FrameworkServlet doGet()
40. HttpServlet.java line 707
    in javax.servlet.http.HttpServlet service()
41. HttpServlet.java line 820
    in javax.servlet.http.HttpServlet service()
42. ServletHolder.java line 511
    in org.mortbay.jetty.servlet.ServletHolder handle()
43. ServletHandler.java line 1221
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
44. UserAgentFilter.java line 78
    in org.mortbay.servlet.UserAgentFilter doFilter()
45. GzipFilter.java line 131
    in org.mortbay.servlet.GzipFilter doFilter()
46. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
47. JAMonServletFilter.java line 48
    in com.jamonapi.http.JAMonServletFilter doFilter()
48. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
49. JavaMelodyFacade.java line 109
    in com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter doFilter()
50. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
51. FilterChainProxy.java line 311
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
52. FilterSecurityInterceptor.java line 116
    in org.springframework.security.web.access.intercept.FilterSecurityInterceptor invoke()
53. FilterSecurityInterceptor.java line 83
    in org.springframework.security.web.access.intercept.FilterSecurityInterceptor doFilter()
54. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
55. ExceptionTranslationFilter.java line 113
    in org.springframework.security.web.access.ExceptionTranslationFilter doFilter()
56. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
57. SessionManagementFilter.java line 101
    in org.springframework.security.web.session.SessionManagementFilter doFilter()
58. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
59. AnonymousAuthenticationFilter.java line 113
    in org.springframework.security.web.authentication.AnonymousAuthenticationFilter doFilter()
60. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
61. RememberMeAuthenticationFilter.java line 146
    in org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter doFilter()
62. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
63. SecurityContextHolderAwareRequestFilter.java line 54
    in org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter doFilter()
64. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
65. RequestCacheAwareFilter.java line 45
    in org.springframework.security.web.savedrequest.RequestCacheAwareFilter doFilter()
66. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
67. AbstractAuthenticationProcessingFilter.java line 182
    in org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter doFilter()
68. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
69. LogoutFilter.java line 105
    in org.springframework.security.web.authentication.logout.LogoutFilter doFilter()
70. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
71. SecurityContextPersistenceFilter.java line 87
    in org.springframework.security.web.context.SecurityContextPersistenceFilter doFilter()
72. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
73. ConcurrentSessionFilter.java line 125
    in org.springframework.security.web.session.ConcurrentSessionFilter doFilter()
74. FilterChainProxy.java line 323
    in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter()
75. FilterChainProxy.java line 173
    in org.springframework.security.web.FilterChainProxy doFilter()
76. DelegatingFilterProxy.java line 237
    in org.springframework.web.filter.DelegatingFilterProxy invokeDelegate()
77. DelegatingFilterProxy.java line 167
    in org.springframework.web.filter.DelegatingFilterProxy doFilter()
78. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
79. CharacterEncodingFilter.java line 88
    in org.springframework.web.filter.CharacterEncodingFilter doFilterInternal()
80. OncePerRequestFilter.java line 76
    in org.springframework.web.filter.OncePerRequestFilter doFilter()
81. ServletHandler.java line 1212
    in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter()
82. ServletHandler.java line 399
    in org.mortbay.jetty.servlet.ServletHandler handle()
83. SecurityHandler.java line 216
    in org.mortbay.jetty.security.SecurityHandler handle()
84. SessionHandler.java line 182
    in org.mortbay.jetty.servlet.SessionHandler handle()
85. SecurityHandler.java line 216
    in org.mortbay.jetty.security.SecurityHandler handle()
86. ContextHandler.java line 767
    in org.mortbay.jetty.handler.ContextHandler handle()
87. WebAppContext.java line 450
    in org.mortbay.jetty.webapp.WebAppContext handle()
88. HandlerWrapper.java line 152
    in org.mortbay.jetty.handler.HandlerWrapper handle()
89. StatisticsHandler.java line 53
    in org.mortbay.jetty.handler.StatisticsHandler handle()
90. HandlerWrapper.java line 152
    in org.mortbay.jetty.handler.HandlerWrapper handle()
91. Server.java line 326
    in org.mortbay.jetty.Server handle()
92. HttpConnection.java line 542
    in org.mortbay.jetty.HttpConnection handleRequest()
93. HttpConnection.java line 928
    in org.mortbay.jetty.HttpConnection$RequestHandler headerComplete()
94. HttpParser.java line 549
    in org.mortbay.jetty.HttpParser parseNext()
95. HttpParser.java line 212
    in org.mortbay.jetty.HttpParser parseAvailable()
96. HttpConnection.java line 404
    in org.mortbay.jetty.HttpConnection handle()
97. SelectChannelEndPoint.java line 410
    in org.mortbay.io.nio.SelectChannelEndPoint run()
98. QueuedThreadPool.java line 582
    in org.mortbay.thread.QueuedThreadPool$PoolThread run()

[#2]

Hello Mayank,

Was this working before? Can you please check on your proxy settings?

[#3]

Hi,

Thanks for the prompt response.

Yes, it was working perfectly fine before. I request you to kindly elaborate over Proxy settings.

PS: I am able to ssh all the nodes from the Master/Namenode. HDFS and other services are working fine too.

Regards and Thanks,

Mayank

[#4 · Accepted solution]

The stacktrace indicates that there is an inconsistency with the Hibernate cache. Restarting CM server should fix the issue.

Did you take any unconventional action prior to this issue, e.g. directly accessing the database?