Member since
12-20-2022
27
Posts
7
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
208 | 02-08-2024 04:02 AM | |
656 | 01-19-2024 01:55 AM |
04-23-2024
06:18 AM
Hi @DanhH , Please accept this as a solution if it helped.
... View more
04-23-2024
06:18 AM
Hi @HadoopCommunity , If my solution. helped you Please accept it as a solution
... View more
04-22-2024
11:27 AM
Hi @yagoaparecidoti , You dont have to run the balancer. The blocks will recognize the racks and it will be done automatically.
... View more
04-22-2024
11:24 AM
Hi @JiHoone I think all your jobs that is running is allocated only the AM resources. Do one thing first set the "Configured Max AM limit" to 20%. Then set the Minimum user limit percent to 25% and run your jobs. Set user limit factor as 0.5.
... View more
04-22-2024
11:17 AM
Hi @ryu , yes you can search the details in the RM logs with the application Id. You will get the details of the resources asked by the application and resources provided by the RM
... View more
04-22-2024
11:10 AM
@ryu Please accept this as solution if your issue is resolved by the suggestion
... View more
04-22-2024
05:51 AM
@ryu 1.Check the queue that job is running in. See if that is allocated enough resources. 2.See if the queue is pending containers is showing or not. 3.If all these things are fine then start checking the locality if the job is running in node local or rack local. 4. Then go to node manager level and debug for local unix level slowness
... View more
04-21-2024
10:04 PM
@yagoaparecidoti If my suggestion helped Please accept it as a solution
... View more
04-21-2024
10:02 PM
As a rule of thumb assign 80% of the node resources to YARN. Please go through this to modify the config according to your need. https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Queue_Properties
... View more