Member since
08-17-2017
54
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
13693 | 08-20-2017 11:20 AM |
08-20-2017
09:39 AM
@Geoffrey Shelton Okot That use dosnt exist in Ambari server node . Its there in rest of Cluster hosts . Here is the output. drwxrwx--- - ambari-qa hdfs 0 2017-08-18 04:21 /user/ambari-qa drwxr-xr-x - hcat hdfs 0 2017-08-18 04:18 /user/hcat drwxr-xr-x - hive hdfs 0 2017-08-18 04:19 /user/hive Error now . Failed to transition to undefined Server status: 500
Server Message: <small>
User: hdp is not allowed to impersonate admin
</small>
... View more
08-19-2017
03:11 PM
@Geoffrey Shelton Okot Here is description of of my cluster : One node is having the Ambari Server In Cluster i have 4 nodes . I have the entries for "nameserver" and the names to resolve . Yeah i have the correct entries in /etc/hosts . Regarding the Firewall : Here is the output service ip6tables status
ip6tables: Firewall is not running. service iptables status IPv4
iptables: Firewall is not running. When i run following command , this is the output . # hdfs dfs -ls /user
bash: hdfs: command not found On thing to to add during the cluster setup , i have made changes to some of folder under . I hope this wount make any impact . Please let me know if need some more info NameNode /opt/mount1/hdp/hadoop/hdfs/namenode,/opt/mount1/hdp/home/hadoop/hdfs/namenode,/opt/hadoop/hdfs/namenode,/opt/Tidal/hadoop/hdfs/namenode,/opt/mount1/hdp/hadoop/hdfs/namenode,/opt/mount2/hadoop/hdfs/namenode,/opt/mount1/hdp/usr/hadoop/hdfs/namenode,/var/hadoop/hdfs/namenode,/var/crash/hadoop/hdfs/namenode DataNode /opt/mount1/hdp/hadoop/hdfs/data,/opt/mount1/hdp/home/hadoop/hdfs/data,/opt/mount1/hdp/Tidal/hadoop/hdfs/data,/opt/mount1/hadoop/hdfs/data,/opt/mount2/hadoop/hdfs/data,/opt/mount1/hdp/usr/hadoop/hdfs/data,/var/hadoop/hdfs/data,/var/crash/hadoop/hdfs/data
... View more
08-18-2017
04:07 PM
After deleting the File view and recreating again . Clean restart now i can see the "Service checks completed." But its showing blank page . After looking at the log i see following error 18 Aug 2017 16:02:47,190 ERROR [ambari-client-thread-29] ContainerResponse:537 - Mapped exception to response: 500 (Internal Server Error)
org.apache.ambari.view.commons.exceptions.ServiceFormattedException
at org.apache.ambari.view.commons.hdfs.FileOperationService.listdir(FileOperationService.java:80)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1507)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.apache.ambari.server.security.authorization.AmbariAuthorizationFilter.doFilter(AmbariAuthorizationFilter.java:287)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.apache.ambari.server.security.authentication.AmbariDelegatingAuthenticationFilter.doFilter(AmbariDelegatingAuthenticationFilter.java:132)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.apache.ambari.server.security.authorization.AmbariUserAuthorizationFilter.doFilter(AmbariUserAuthorizationFilter.java:91)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:
... View more
08-18-2017
03:38 PM
Based on the article . I added following properties and restated the necessary components . hadoop.proxyuser.hdp.groups=users
hadoop.proxyuser.hdp.hosts=ambari-server.hostname
Now I see the following error , which close to same as previous
18 Aug 2017 15:31:55,734 ERROR [ambari-client-thread-24] ViewRegistry:930 - Could not find the cluster identified by 2. 18 Aug 2017 15:31:55,736 ERROR [ambari-client-thread-24] ContainerResponse:419 - The RuntimeException could not be mapped to a response, re-throwing to the HTTP container org.apache.ambari.server.view.IllegalClusterException: Failed to get cluster information associated with this view instance at org.apache.ambari.server.view.ViewRegistry.getCluster(ViewRegistry.java:931) at org.apache.ambari.server.view.ViewContextImpl.getCluster(ViewContextImpl.java:370) at org.apache.ambari.server.view.ViewContextImpl.getPropertyValues(ViewContextImpl.java:437) at org.apache.ambari.server.view.ViewContextImpl.getProperties(ViewContextImpl.java:171) at org.apache.ambari.view.commons.hdfs.ViewPropertyHelper.getViewConfigs(ViewPropertyHelper.java:36) at org.apache.ambari.view.filebrowser.FileBrowserService.getViewConfigs(FileBrowserService.java:52) at org.apache.ambari.view.filebrowser.FileBrowserService.help(FileBrowserService.java:80) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.dispatch(SubLocatorRule.java:190) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.invokeSubLocator(SubLocatorRule.java:183) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:110) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)
Caused by: org.apache.ambari.server.ClusterNotFoundException: Cluster not found, clusterId=2 at org.apache.ambari.server.state.cluster.ClustersImpl.getCluster(ClustersImpl.java:290) at org.apache.ambari.server.view.ViewRegistry.getCluster(ViewRegistry.java:928) ... 102 more
@Geoffrey Shelton Okot Did the restart for all components as well .
... View more
08-18-2017
11:10 AM
At UI this is the error message Service checks completed.
HDFS test Issues detected Service 'hdfs' check failed:Server Error
... View more
08-18-2017
11:09 AM
Still same error on associated with this view instance 18 Aug 2017 11:08:08,969 ERROR [ambari-client-thread-26] ViewRegistry:930 - Could not find the cluster identified by 2. 18 Aug 2017 11:08:08,970 ERROR [ambari-client-thread-26] ContainerResponse:419 - The RuntimeException could not be mapped to a response, re-throwing to the HTTP container org.apache.ambari.server.view.IllegalClusterException: Failed to get cluster information associated with this view instance at org.apache.ambari.server.view.ViewRegistry.getCluster(ViewRegistry.java:931) at org.apache.ambari.server.view.ViewContextImpl.getCluster(ViewContextImpl.java:370) at org.apache.ambari.server.view.ViewContextImpl.getPropertyValues(ViewContextImpl.java:437) at org.apache.ambari.server.view.ViewContextImpl.getProperties(ViewContextImpl.java:171) at org.apache.ambari.view.commons.hdfs.ViewPropertyHelper.getViewConfigs(ViewPropertyHelper.java:36) at org.apache.ambari.view.filebrowser.FileBrowserService.getViewConfigs(FileBrowserService.java:52) at org.apache.ambari.view.filebrowser.FileBrowserService.help(FileBrowserService.java:80) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.dispatch(SubLocatorRule.java:190) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.invokeSubLocator(SubLocatorRule.java:183) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:110) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) Caused by: org.apache.ambari.server.ClusterNotFoundException: Cluster not found, clusterId=2 at org.apache.ambari.server.state.cluster.ClustersImpl.getCluster(ClustersImpl.java:290) at org.apache.ambari.server.view.ViewRegistry.getCluster(ViewRegistry.java:928) ... 102 more 18 Aug 2017 11:08:08,972 WARN [ambari-client-thread-26] ServletHandler:561 - Error Processing URI: /api/v1/views/FILES/versions/1.0.0/instances/AUTO_FILES_INSTANCE/resources/files/help/hdfsStatus - (org.apache.ambari.server.view.IllegalClusterException) Failed to get cluster information associated with this view instance
... View more
08-18-2017
11:04 AM
No I didn't .
... View more
08-18-2017
10:37 AM
Still same . Here is the error 18 Aug 2017 10:34:29,880 WARN [ambari-client-thread-29] ServletHandler:561 - Error Processing URI: /api/v1/views/FILES/versions/1.0.0/instances/AUTO_FILES_INSTANCE/resources/files/user/home - (org.apache.ambari.server.view.IllegalClusterException) Failed to get cluster information associated with this view instance 18 Aug 2017 10:34:30,219 ERROR [ambari-client-thread-25] ViewRegistry:930 - Could not find the cluster identified by 2. 18 Aug 2017 10:34:30,221 ERROR [ambari-client-thread-25] ContainerResponse:419 - The RuntimeException could not be mapped to a response, re-throwing to the HTTP container org.apache.ambari.server.view.IllegalClusterException: Failed to get cluster information associated with this view instance at org.apache.ambari.server.view.ViewRegistry.getCluster(ViewRegistry.java:931) at org.apache.ambari.server.view.ViewContextImpl.getCluster(ViewContextImpl.java:370) at org.apache.ambari.server.view.ViewContextImpl.getPropertyValues(ViewContextImpl.java:437) at org.apache.ambari.server.view.ViewContextImpl.getProperties(ViewContextImpl.java:171) at org.apache.ambari.view.commons.hdfs.ViewPropertyHelper.getViewConfigs(ViewPropertyHelper.java:36) at org.apache.ambari.view.filebrowser.FileBrowserService.getViewConfigs(FileBrowserService.java:52) at org.apache.ambari.view.filebrowser.FileBrowserService.help(FileBrowserService.java:80) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) Caused by: org.apache.ambari.server.ClusterNotFoundException: Cluster not found, clusterId=2 at org.apache.ambari.server.state.cluster.ClustersImpl.getCluster(ClustersImpl.java:290) at org.apache.ambari.server.view.ViewRegistry.getCluster(ViewRegistry.java:928) ... 102 more 18 Aug 2017 10:34:30,231 WARN [ambari-client-thread-25] ServletHandler:561 - Error Processing URI: /api/v1/views/FILES/versions/1.0.0/instances/AUTO_FILES_INSTANCE/resources/files/help/hdfsStatus - (org.apache.ambari.server.view.IllegalClusterException) Failed to get cluster information associated with this view instance
... View more
08-18-2017
09:58 AM
One thing to add on , the node where my Ambari sever is running is not a part of cluster . Will that lead this issue ?
... View more
08-18-2017
09:57 AM
One thing to add on , the node where my Ambari sever is running is not a part of cluster . Will that lead this issue ?
... View more