About mike_bronson7

Shelton · ‎08-21-2021

@mike_bronson7 Can you share your capacity scheduler , total memory and vcores configs ?

Shelton · ‎07-18-2021

@mike_bronson7 Are you using the default capacity schedule settings? No queues/leafs created? Is what you shared the current seeting?

PrathapKumar · ‎07-02-2021

Disk balancer is not available in the HDP 2.X and it is available from the HDP 3.X As a workaround for this, we can decommission the data node where we are observing the disk are not balanced equally, clean up the data node, recommission the node again, and run the HDFS balancer again. Thanks, Prathap Kumar.

Shelton · ‎06-30-2021

@mike_bronson7 Here you go how to determine YARN and MapReduce Memory Configuration Settings Happy hadooping

mike_bronson7 · ‎03-21-2021

about the API Ambari command cli , can you show me the full syntax that replace the disable to enable

ask_bill_brooks · ‎02-16-2021

@mike_bronson7 I think you will be able to find a helpful, previously-posted answer to a question very similar to yours in this thread: Hortonworks Repositories can't be accessed Hope this helps.

Kezia · ‎02-11-2021

Since you are using Ambari, you can you can try to use Rebalance HDFS action, or directly the Hadoop Balancer tool.

Defendant · ‎02-08-2021

Out of all the options available to deal with this situation, I think resetting your network configurations is the best. Resetting your network configurations is one of the maintenance procedures that help refresh or repair your network connectivity. In this way, it could eliminate latency and will return your network status like when you started using the Internet. To resolve your concern, we suggest that you reset your TCP/IP or Internet Protocol to its default settings. It's like using the services of Mortgage Advisor London when looking to buy a house, in the sense that it is the best choice you can make.

kingpin · ‎01-28-2021

@mike_bronson7 Adding to @GangWar :- To your question - dose this action could also affected the data itself on the data-nodes machines ? No it doesnt affect data on datanode directly. This is metadata operation on namenode which when need to be run when NameNode fails to progress through the edits or fsimage then the NameNode may need to be started with -recover option. Since the metadata has reference to the blocks on datanode, hence this is a critical operation and may incur data loss.

MyNamesNotRick · ‎01-26-2021

@mike_bronson7 It seems to me like this is a symptom of having the default replication set to 3. This is for redundancy and processing capability within HDFS. It is recommended to have minimum 3 data nodes in the cluster to accommodate 3 healthy replicas of a block (as we have a default replication of 3). HDFS will not write replicas of the same blocks to the same data node. In your scenario there will be under replicated blocks and 1 healthy replica will be placed on the available data node. You may run setrep [1] to change the replication factor. If you provide a path to a directory then the command recursively changes the replication factor of all files under the directory tree rooted at path. hdfs dfs -setrep -w 1 /user/hadoop/dir1 [1] https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/FileSystemShell.html#setrep

Online	Offline
Last Visited	‎08-27-2024 09:17 AM

Member Since	‎08-08-2017 09:40 AM
Last Visited	‎08-27-2024 09:17 AM
Posts	1,652
Kudos received	29

Cloudera Community

Re: how to find number of CPU core on datanode ma...

Re: postgresql + ambari server failed to open port...

Re: how to stop the thrift servers by REST API

Re: namenode is in safe mode

Re: Directory /grid/sdg/hadoop/hdfs/data became un...

Re: HDP cluster + resource manager logs with warni...

Re: yarn + resource manager failed to start on HDP...

Re: HDFS disk balance for HDP 2.6.4 and HDP 2.6.5

Re: YARN resource manager + what is the count of n...

Re: Ambari API + how to change the CPU Scheduling ...

Re: download ambari tar ball

Re: hadoop + how to rebalnce the hdfs

Re: how to add broker id manually to zookeeper cli

Re: namenode + hadoop namenode -recover

Re: how to identify the problem about under replic...