Hi All, I am using plain vanilla hadoop version 2.7.7. I have configured capacity scheduler order policy as "fair" in capacity-scheduler.xml but it is not reflecting in resource manager. Kindly help me in this. capacity-scheduler.xml: <configuration> <property> <name>yarn.scheduler.capacity.maximum-am-resource-percent</name> <value>0.2</value> </property> <property> <name>yarn.scheduler.capacity.maximum-applications</name> <value>10000</value> </property> <property> <name>yarn.scheduler.capacity.node-locality-delay</name> <value>40</value> </property> <property> <name>yarn.scheduler.capacity.queue-mappings-override.enable</name> <value>false</value> </property> <property> <name>yarn.scheduler.capacity.resource-calculator</name> <value>org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator</value> </property> <property> <name>yarn.scheduler.capacity.root.accessible-node-labels</name> <value>*</value> </property> <property> <name>yarn.scheduler.capacity.root.acl_administer_queue</name> <value>*</value> </property> <property> <name>yarn.scheduler.capacity.root.capacity</name> <value>100</value> </property> <property> <name>yarn.scheduler.capacity.root.default.acl_submit_applications</name> <value>*</value> </property> <property> <name>yarn.scheduler.capacity.root.default.capacity</name> <value>100</value> </property> <property> <name>yarn.scheduler.capacity.root.default.maximum-capacity</name> <value>100</value> </property> <property> <name>yarn.scheduler.capacity.root.default.ordering-policy</name> <value>fair</value> </property> <property> <name>yarn.scheduler.capacity.root.default.ordering-policy.fair.enable-size-based-weight</name> <value>false</value> </property> <property> <name>yarn.scheduler.capacity.root.default.priority</name> <value>0</value> </property> <property> <name>yarn.scheduler.capacity.root.default.state</name> <value>RUNNING</value> </property> <property> <name>yarn.scheduler.capacity.root.default.user-limit-factor</name> <value>1</value> </property> <property> <name>yarn.scheduler.capacity.root.priority</name> <value>0</value> </property> <property> <name>yarn.scheduler.capacity.root.queues</name> <value>default</value> </property> </configuration> @jsensharma @MattWho @nsabharwal @aervits @Shelton Need you expertise here. Pls advise Regards, Vignesh ... View more

Hi, I have downloaded and installed Ambari 2.6.2.2. Now I want to download and install Ambari 2.7.5 but it was asking for username and password. Is 2.7.5 not free as 2.6.2.2? Do I need to buy license to download? Pls advise. Thanks.   Regards, Vignesh ... View more

Hi Team, I have changed scheduling policy to "fair" for capacity scheduler in capacity-scheduler.xml but it is not reflecting in resource manager UI. I am not using any distribution and using simple plain vanilla hadoop version 2.7.3. Kindly help to resolve.   capacity-scheduler.xml:   <configuration> <property> <name>yarn.scheduler.capacity.maximum-am-resource-percent</name> <value>0.2</value> </property> <property> <name>yarn.scheduler.capacity.maximum-applications</name> <value>10000</value> </property> <property> <name>yarn.scheduler.capacity.node-locality-delay</name> <value>40</value> </property> <property> <name>yarn.scheduler.capacity.queue-mappings-override.enable</name> <value>false</value> </property> <property> <name>yarn.scheduler.capacity.resource-calculator</name> <value>org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator</value> </property> <property> <name>yarn.scheduler.capacity.root.accessible-node-labels</name> <value>*</value> </property> <property> <name>yarn.scheduler.capacity.root.acl_administer_queue</name> <value>*</value> </property> <property> <name>yarn.scheduler.capacity.root.capacity</name> <value>100</value> </property> <property> <name>yarn.scheduler.capacity.root.default.acl_submit_applications</name> <value>*</value> </property> <property> <name>yarn.scheduler.capacity.root.default.capacity</name> <value>100</value> </property> <property> <name>yarn.scheduler.capacity.root.default.maximum-capacity</name> <value>100</value> </property> <property> <name>yarn.scheduler.capacity.root.default.ordering-policy</name> <value>fair</value> </property> <property> <name>yarn.scheduler.capacity.root.default.ordering-policy.fair.enable-size-based-weight</name> <value>false</value> </property> <property> <name>yarn.scheduler.capacity.root.default.priority</name> <value>0</value> </property> <property> <name>yarn.scheduler.capacity.root.default.state</name> <value>RUNNING</value> </property> <property> <name>yarn.scheduler.capacity.root.default.user-limit-factor</name> <value>1</value> </property> <property> <name>yarn.scheduler.capacity.root.priority</name> <value>0</value> </property> <property> <name>yarn.scheduler.capacity.root.queues</name> <value>default</value> </property> </configuration>   Resource Manager UI:   ... View more

Can somebody please help me how to kill impala query using CM API? Thanks ... View more

I have a file in HDFS which contains username and password. I have to do encryption and decryption on that file. Can somebody please help me in this requirement? Please suggest some other approach than moving that file into encrypted zone. Thanks ... View more