About Kamalindia

Kamalindia · ‎05-08-2019

I am getting service monitor alerts from long time but these YARN specific alerts come to me form last week. some of the information which I am getting.... org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1555641507362_184814,name=INSERT OVERWRITE TABL...Test(Stage-1),user=hive,queue=root.van,state=FINISHED,trackingUrl=myhost:8088/proxy/application_1555641507362_184814/,appMasterHost=XYZ,startTime=1557309811366,finishTime=1557310013621,finalStatus=SUCCEEDED,memorySeconds=13123252,vcoreSeconds=2985,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=<memory:0\, vCores:0> 2019-05-08 05:06:59,921 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager: Max number of completed apps kept in state store met: maxCompletedAppsInStateStore = 10000, removing app application_1555641507362_174834 from state store. 2019-05-08 05:06:59,921 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager: Application should be expired, max number of completed apps kept in memory met: maxCompletedAppsInMemory = 10000, removing app application_1555641507362_174834 from memory: 2019-05-08 05:06:59,921 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing info for app: application_1555641507362_174834 2019-05-08 05:07:00,047 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e64_1555641507362_184829_01_000007 Container Transitioned from RUNNING to COMPLETED 2019-05-08 05:07:00,047 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt: Completed container: container_e64_1555641507362_184829_01_000007 in state: COMPLETED event:FINISHED

Kamalindia · ‎05-07-2019

Hello Sid, After going through the active Resource managers log I didn't find anything.Just the Info logs appeared , no warning or error logs there. what more need to check now.

Kamalindia · ‎05-05-2019

Hello, from past weeks server is throwing too many of alerts related to YARN node managers health. The health test result for YARN_NODE_MANAGERS_HEALTHY has become bad: Healthy NodeManager: 0. Concerning NodeManager: 0. Total NodeManager: 33. Percent healthy: 0.00%. Percent healthy or concerning: 0.00%. Critical threshold: 90.00%. After going through hadoop-YARN logs directory receiving below logs... WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn IP=*.*.*.* OPERATION=refreshNodes TARGET=AdminService RESULT=FAILURE DESCRIPTION=ResourceManager is not active. Can not refresh nodes. PERMISSIONS= 2019-05-02 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yarn/SERVER@HADOOP.COM (auth:KERBEROS) cause:org.apache.hadoop.ipc.StandbyException: ResourceManager rm137 is not Active! Check the below class https://github.com/hopshadoop/hops/blob/master/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/AdminService.java if (!isRMActive()) { RMAuditLogger.logFailure(user, operation, "", "AdminService", "ResourceManager is not active. Can not " + msg); throwStandbyException(); } } private void throwStandbyException() throws StandbyException { throw new StandbyException("ResourceManager " + rmId + " is not Active!"); } Can somebody help how the above error is integrating with this.

Kamalindia · ‎04-25-2019

i.e. If i receive the alert with Activity Monitor. Pause Duration Bad Average time spent paused was 2 minute(s), 54 second(s) (290.37%) per minute over the previous 5 minute(s). Critical threshold: 60.00%. There are various charts like disk latency,Disk throughput,networkthroughput. Garbage collection time. How I can understand due to which this problem occurs in system. Will any of the specific charts help me there.

Kamalindia · ‎04-25-2019

i.e. Hive Metastore Canary Duration.

Kamalindia · ‎04-25-2019

Hello manuroman, How i can map this information to Charts. i..e. Hive canary chart. How i can map if the charts are associated with an issue. Any detailed information related to charts is required by me. How to corelate an issue with charts.

Kamalindia · ‎04-16-2019

i was just requiring to change the editor to load impala on load. I have done that in the interpreter section by moving impala before hive settings. It then load impala editor by default.

Kamalindia · ‎04-15-2019

I need to change the property of default_sql_interpreter to Impala in place of hive so by default Impala query editor get loaded. I check hue.ini but didn't find that. Will that be available in hue database configuration.

Kamalindia · ‎04-10-2019

Can someone help regarding cloudera charts. I didn't find any good explanation regarding charts available in cloudera manager. How i can correlate those errors with charts. I.e. cpu , io related charts.

Online	Offline
Last Visited	‎10-11-2022 10:52 PM

Member Since	‎09-03-2018 02:07 AM
Last Visited	‎10-11-2022 10:52 PM
Posts	13
Kudos received	2

Cloudera Community

Cloudera Community

Re: Need to change the default_sql_interpreter to ...

Re: YARN node manager health alerts issue

Re: YARN node manager health alerts issue

YARN node manager health alerts issue

Re: Understanding cloudera charts

Re: Understanding cloudera charts

Re: Understanding cloudera charts

Re: Need to change the default_sql_interpreter to ...

Need to change the default_sql_interpreter to Impa...

Understanding cloudera charts