Member since
09-12-2016
39
Posts
5
Kudos Received
0
Solutions
10-05-2017
02:54 AM
@bkosaraju I think my issue not relevant with your link I am running Spark 1.6.3 on HDP 2.6
... View more
09-22-2017
06:13 PM
1 Kudo
@Hoang Le Capacity Scheduler’s leaf queues can also use the user-limit-factor property to control user resource allocations. This property denotes the fraction of queue capacity that any single user can consume up to a maximum value, regardless of whether or not there are idle resources in the cluster. Property: yarn.scheduler.capacity.root.support.user-limit-factor Value: 1 The default value of "1" means that any single user in the queue can at maximum only occupy the queue’s configured capacity. This prevents users in a single queue from monopolizing resources across all queues in a cluster. Setting the value to "2" would restrict the queue's users to twice the queue’s configured capacity. Setting it to a value of 0.5 would restrict any user from using resources beyond half of the queue capacity. These settings can also be dynamically changed at run-time using yarn rmadmin - refreshQueues . Please change user limit factor and try.
... View more
05-22-2018
09:18 AM
must be in "ms", so try 800000.
... View more
08-03-2017
03:30 AM
yes, that is my understanding.
... View more
12-02-2017
05:40 PM
@Deepak Sharma in the command "/usr/hdp/current/zookeeper-client/bin/zookeeper-client -server <ZK1>:2181,<ZK2>:2181" <ZK1>:2181,<ZK2>:2181 ---- I dint understand. Could you explain it.
... View more
01-09-2017
06:10 AM
@Hoang Le No, Ambari UI will set it for future files that you will create. It will not run setrep command for you. That you will have to run from shell as described above.
... View more
12-21-2016
06:56 AM
@Hoang Le this is to Get the maximum am resource percent per queue configured capacity.
yarn.nodemanager.resource.memory-mb is the memory that a nodemanger announce to RM.
... View more
11-13-2017
10:18 PM
@Hoang Le, did you ever get this resolved? I am interesting in to know how to fix this issue too?
... View more
11-30-2016
06:48 PM
3 Kudos
@Hoang Le The max application master resource is calculated using the value "yarn.scheduler.capacity.maximum-am-resource-percent" which is set in capacity-scheduler.xml. The default value is 0.1 which means 10% of the cluster resources. More info can be found in http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_yarn_resource_mgt/content/setting_application_limits.html
... View more
10-31-2016
05:38 AM
@Hoang Le If you have 5 nodes, you can use 2 nodes as Masternodes and 3 as Workernodes (slave nodes).
... View more