Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
manu6otp
manu6otp
Explorer

Zeppelin Server Status alert

by Explorer manu6otp in Support Questions
‎04-16-2020 06:27 AM
‎04-16-2020 06:27 AM
From the logs we can see zeppelin connection refused error.   ERROR [2020-04-15 22:57:53,834] ({pool-2-thread-12} RemoteScheduler.java[getStatus]:256) - Can't get status information org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused) ... View more
Labels:

Re: Transient Alerts. Namenode HA Health Status. S...

by Super Mentor jsensharma Super Mentor in Support Questions
‎06-13-2019 12:45 AM
‎06-13-2019 12:45 AM
@Manoj Menon Did you find any such indication with your NameNode ? Like Long GC pause or memory reaching to its max limit (or 95%+ sometimes) Any indication of Long GC pause or System Load on NameNode hosts ? During the time of alert trigger: # top # free -m # less /var/log/hadoop/hdfs/gc.log-* # grep  -i 'JvmPauseMonitor'  /var/log/hadoop/hdfs/hadoop-hdfs-namenode-*.log | grep -i WARN ... View more

How will check the previous date alerts like NN He...

by Explorer manu6otp in Support Questions
‎05-13-2019 10:48 AM
‎05-13-2019 10:48 AM
How will check the previous date alerts like NN Heap usage,Host agent disk alerts etc. we need to deploy some script. ... View more
Labels:

Phoenix Queries are getting operation timed out

by Explorer manu6otp in Support Questions
‎04-25-2019 06:00 AM
‎04-25-2019 06:00 AM
Queries are getting operation timed out because scan is happening on Index table (which don’t have K0 column) K0 column is not part of MESSAGE_ARCHIVE_2_IDX_DEVICEID_PROCESSED_TIMESTAMP table but scan is happening on index table causing the operation timed out. ... View more
Labels:

Re: Yarn Queue Manager is not opening

by Super Mentor jsensharma Super Mentor in Support Questions
‎04-03-2018 03:02 AM
‎04-03-2018 03:02 AM
@Manoj Menon If this answers your query then please mark this HCC thread as answered by clicking on "Accept" link on the correct answer, That way it will help other HCC users to quickly find the answers. ... View more

Master Machine hostname got changed and the port i...

by Explorer manu6otp in Support Questions
‎03-01-2018 07:07 AM
‎03-01-2018 07:07 AM
After the RM, Hbase HA configurations & cluster Restart the jobs were not starting in the master machine and entry automatically went wrong in the /etc/hosts and after some time I ran the jobs in the HA node and started working after moving the master services to HA. Now port also not listening to the IP address in the master.capture.png Please help why this issue is happened and how to solve. ... View more
Labels:

Re: How to do control shutdown and startup for a M...

by Explorer manu6otp in Support Questions
‎03-01-2018 06:57 AM
‎03-01-2018 06:57 AM
Thanks for your comment.But after the activity ,HA configurations and cluster Restart the jobs were not starting in the master machine and entry automatically went wrong in the /etc/hosts and after some time i ran the jobs in the HA node after moving the master services to HA . now port also not listening to the IP address in the master. ... View more

Re: Phoenix query server in Hbase is getting stopp...

by Explorer manu6otp in Support Questions
‎02-27-2018 02:43 PM
1 Kudo
‎02-27-2018 02:43 PM
1 Kudo
I solved this issue by enable some tables from the hbase like system catalog,sequence,function & stats ... View more

Re: client services not able to restart successful...

by Guru bandarusridhar1 in Support Questions
‎02-22-2018 09:39 PM
‎02-22-2018 09:39 PM
@Manoj Menon Seems like clients are not installed correctly. Please remove and install them else try to reinstall them. ... View more

Re: Hbase cluster going down

by Contributor sanketplus in Support Questions
‎01-22-2018 10:36 AM
‎01-22-2018 10:36 AM
check hbase gc logs. if there is a GC pause that correlates with these log lines then you got your problem. While master/RS is in GC, it fails to send heatbeat to zookeeper and the zookeeper node expires. In that case you can increase zookeeper timeout and increase ticktime in zookeeper config. this is not directly related but do checkout: https://superuser.blog/hbase-dead-regionserver/ ... View more

Differentiate Hbase and Yarn memory

by Explorer manu6otp in Support Questions
‎01-06-2018 03:03 PM
‎01-06-2018 03:03 PM
In Hortonworks how will separate jobs, memory for HBase and yarn?How we will differentiate both operations from an admin point of view. ... View more
Labels:

Re: Hadoop cluster planning

by Super Mentor jsensharma Super Mentor in Support Questions
‎01-06-2018 11:37 PM
2 Kudos
‎01-06-2018 11:37 PM
2 Kudos
@Manoj Menon Every environment runs different kind of job and has different hardware. The kind of job, how many hadoop components are you running, which kind of HDP components are involved in the HDP cluster, behaviour of jobs, frequency of job execution etc are completely different hence the values for RAM and storage differes. However if you want a generic guidelines for RAM/Storage then you can refer to the following docs: 1. Determining HDP Memory Configuration Settings https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determine-hdp-memory-config.html 2. Configuring NameNode Heap Size: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/configuring-namenode-heap-size.html 3. Hardware Planning on Slave & Master Nodes: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/hardware-for-slave.1.html https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/hardware-selection-master-nodes.1.html ... View more

Re: Ambari server & Ambari agent Configuration

by Super Mentor jsensharma Super Mentor in Support Questions
‎01-05-2018 02:17 PM
‎01-05-2018 02:17 PM
@Manoj Menon Ambari Server and agent will communicate normally even when the NameNode fail over happens. Ambari Server and Agent communication happes using the Secure port 8440 and 8441. Ambari Server and Agent communication is not dependent on the NameNode status/failover. . Please see: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-administration/content/default_network_port_numbers_-_ambari.html. ... View more

hbase region getting stopped

by Explorer manu6otp in Support Questions
‎10-20-2017 01:46 PM
‎10-20-2017 01:46 PM
Hmaster:- 2017-10-19 04:19:45,616 ERROR [PriorityRpcServer.handler=8,queue=0,port=16000] master.MasterRpcServices: Region server cbc-slv1.vodafone.flytxt.com,16020,1505158335244 reported a fatal error: 2017-10-19 04:19:46,571 ERROR [PriorityRpcServer.handler=19,queue=1,port=16000] master.MasterRpcServices: Region server cbc-slv4.vodafone.flytxt.com,16020,1505158341501 reported a fatal error: HRegion :- cbc-slv1 4:18:19,755 INFO [B.defaultRpcServer.handler=9,queue=3,port=16020] shortcircuit.ShortCircuitCache: ShortCircuitCache(0x30040ff9): could not load 1218930687_BP-1248144674-10.88.8.135-1467124509456 due to InvalidToken exception. org.apache.hadoop.security.token.SecretManager$InvalidToken: access control error while attempting to set up short-circuit access to /hbase/data/default/SUBSCRIBER/6285afac5334bd9afd3527c7f43f9d30/T/050298e63ea648dd93093e04343a8e75Block token with block_token_identifier (expiryDate=1508362433325, keyId=1595020424, userId=hbase, blockPoolId=BP-1248144674-10.88.8.135-1467124509456, blockId=1218930687, access modes=[READ]) is expired. at org.apache.hadoop.hdfs.BlockReaderFactory.requestFileDescriptors(BlockReaderFactory.java:591)at org.apache.hadoop.hdfs.BlockReaderFactory.requestFileDescriptors(BlockReaderFactory.java:591) at org.apache.hadoop.hdfs.BlockReaderFactory.createShortCircuitReplicaInfo(BlockReaderFactory.java:490)at org.apache.hadoop.hdfs.BlockReaderFactory.createShortCircuitReplicaInfo(BlockReaderFactory.java:490) at org.apache.hadoop.hdfs.shortcircuit.ShortCircuitCache.create(ShortCircuitCache.java:782) at org.apache.hadoop.hdfs.shortcircuit.ShortCircuitCache.fetchOrCreate(ShortCircuitCache.java:716) 2017-10-19 04:19:43,803 INFO [Thread-7] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@420249a9 2017-10-19 04:19:43,803 INFO [Thread-7] regionserver.HRegionServer: STOPPED: Shutdown hook 2017-10-19 04:19:43,803 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2017-10-19 04:19:43,806 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] regionserver.HRegionServer: Stopping infoServer 2017-10-19 04:19:43,814 INFO [SplitLogWorker-cbc-slv1:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2017-10-19 04:19:43,814 INFO [SplitLogWorker-cbc-slv1:16020] regionserver.SplitLogWorker: SplitLogWorker cbc-slv1.vodafone.flytxt.com,16020,1505158335244 exiting 2017-10-19 04:19:43,819 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] mortbay.log: Stopped SelectChannelConnector@0.0.0.0:16030 2017-10-19 04:19:43,920 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] regionserver.HeapMemoryManager: Stoping HeapMemoryTuner chore. 2017-10-19 04:19:43,920 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager graceful ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎07-10-2020 06:30 AM
Public Statistics
Date Registered ‎10-19-2017 02:45 PM
Last Visited ‎07-10-2020 06:30 AM
Total Messages Posted 21
Total Kudos Received 4