Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Ambari metrics collector is keep on restarting due to given error

Highlighted

Ambari metrics collector is keep on restarting due to given error

Guru

Team,

I am not abel to find out anything valuable to fix this issue. Ambari_metrics_collector is restarting again and again and I see following error in my logs. So can anyone please help me to fix it.

2016-09-22 14:01:23,932 WARN org.apache.hadoop.yarn.webapp.GenericExceptionHandler: INTERNAL_SERVER_ERROR

javax.ws.rs.WebApplicationException: org.apache.phoenix.exception.PhoenixIOException

at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TimelineWebServices.getTimelineMetrics(TimelineWebServices.java:377)

at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:606)

at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)

at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)

at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)

at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)

at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)

at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)

at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)

at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)

at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)

at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)

at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)

at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)

at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)

at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)

at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:895)

at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:843)

at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:804)

at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)

at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)

at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:

Caused by: org.apache.phoenix.exception.PhoenixIOException

at org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:111)

at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:808)

at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:714)

at org.apache.phoenix.iterate.ConcatResultIterator.getIterators(ConcatResultIterator.java:50)

at org.apache.phoenix.iterate.ConcatResultIterator.currentIterator(ConcatResultIterator.java:97)

at org.apache.phoenix.iterate.ConcatResultIterator.next(ConcatResultIterator.java:117)

at org.apache.phoenix.iterate.DelegateResultIterator.next(DelegateResultIterator.java:44)

at org.apache.phoenix.iterate.LimitingResultIterator.next(LimitingResultIterator.java:47)

at org.apache.phoenix.jdbc.PhoenixResultSet.next(PhoenixResultSet.java:778)

at org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.PhoenixHBaseAccessor.getMetricRecords(PhoenixHBaseAccessor.java:777)

at org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.getTimelineMetrics(HBaseTimelineMetricStore.java:228)

at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TimelineWebServices.getTimelineMetrics(TimelineWebServices.java:359)

... 48 more

Caused by: java.lang.InterruptedException

at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:400)

at java.util.concurrent.FutureTask.get(FutureTask.java:199)

at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:766)

... 58 more

1 REPLY 1
Highlighted

Re: Ambari metrics collector is keep on restarting due to given error

Don't have an account?
Coming from Hortonworks? Activate your account here