About madhura2688

madhura2688 · ‎07-29-2019

@Jay Kumar SenSharma @Geoffrey Shelton Okot Can you please help?

madhura2688 · ‎07-29-2019

Hi, I want to rebalance cluster, but I am not sure how this threshold value is calculated? What threshold I should keep to finish it quickly? I am not looking for a good balance right now. But one of our datanode is now over 80% used and we do want to reduce it to atleast 60% or 70% Can you please tell me what threshold we should keep and how I can monitor HDFS balancing is finished or not in ambari?

madhura2688 · ‎07-26-2019

How to calculate number of total containers in cluster? Does it depend on Memory? or VCores ? How can I get the exact number of containers which are available in my cluster.?

madhura2688 · ‎05-14-2019

Hi @Geoffrey Shelton Okot, Thank you for your response. Yes, we currently have that ibdata file on a disk- which we believe we can increase the size of the of the same disk. if we change the size of the same disk then do we need to update the location anywhere? As we are not changing location of the ibdata file. is that correct? Please suggest.

madhura2688 · ‎05-14-2019

@Jay Kumar SenSharma - Can you please suggest based upon the requested information?

madhura2688 · ‎05-13-2019

@Jay Kumar SenSharma ... Can you please suggest based upon the requested information?

madhura2688 · ‎05-12-2019

@Jay Kumar SenSharma Thank you for your response. Here is the requested output : +--------------------+---------------+ | DB Name | DB Size in MB | +--------------------+---------------+ | ambaridb | 651.8 | | hivedb | 30274.0 | | information_schema | 0.1 | | mysql | 0.6 | | ooziedb | 7041.9 | | performance_schema | 0.0 | | rangerdb | 29.4 | +--------------------+---------------+ I have few followup questions: 1. If we delete the data from the table will ibdata1 file size will shrink? 2. Can we increase the disk size for that mount point where the ibdata1 file resides? what steps we will need to take? appreciate your help in this!

madhura2688 · ‎05-12-2019

Hi , We are using mysql for our cluster database. Currently we are seeing size of -rw-rw----. 1 mysql mysql 37G May 1 18:55 ibdata1 This database has - ambaridb/rangerdb/hivedb etc. is increasing day by day. and we don't enough space on the disk.. Is there any easy way where we can reduce the size of this mysql db? Or is there a way if we can move this to some other disk? or increase the size of this mount point? Please need suggestion

madhura2688 · ‎04-26-2019

@Geoffrey Shelton Okot Thank you. I think Decommissioning is a best way to do this. Do I need to turn on maintainance mode while I do decommissioning datanode? Also Do I need to stop the services like - NodeManager, Ambari metrics for that datanode after decommissioning?

madhura2688 · ‎04-25-2019

@Geoffrey Shelton Okot Thank you for your response. Instead of Decommissioning the node Can I stop it? What is the difference? Whats the best way to stop it or Decommission?

Online	Offline
Last Visited	‎12-10-2019 10:41 AM

Member Since	‎10-04-2018 04:56 PM
Last Visited	‎12-10-2019 10:41 AM
Posts	39

Cloudera Community

Re: What threshold we should keep to Rebalancing H...

What threshold we should keep to Rebalancing HDFS ...

How to calculate number of total containers?

Re: Cluster Mysql metadata Database size is increa...

Re: Cluster Mysql metadata Database size is increa...

Re: Cluster Mysql metadata Database size is increa...

Re: Cluster Mysql metadata Database size is increa...

Cluster Mysql metadata Database size is increasing...

Re: Need suggestion to stop or Decommission Datano...

Re: Need suggestion to stop or Decommission Datano...