Member since
09-29-2015
58
Posts
34
Kudos Received
8
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
970 | 09-29-2016 01:39 PM | |
2172 | 06-21-2016 03:10 PM | |
6625 | 05-16-2016 07:12 PM | |
8688 | 04-08-2016 02:06 PM | |
1159 | 04-08-2016 01:56 PM |
01-12-2017
04:43 AM
Thanks @Terry Stebbens and @Ian Roberts, I have changed to yarn.scheduler.capacity.maximum-am-resource-percent=0.4 and its working fine.
... View more
01-12-2017
02:40 PM
yarn-client is not supported as per new guidelines, only yarn-cluster mode is supported within livy interpreter from Zeppelin
... View more
10-31-2018
11:53 AM
Hi all, I have a similar issue, all 3 node managers in my cluster are marked as bad with local dirs bad alerts and I can assure I have plenty of space on the YARN disk. (just 35% of the disk is used). Does anyone know of this alert other than YARN reaching its disk threshold value?? Thanks, Priyanshu
... View more
06-29-2016
11:46 AM
@nejm hadjmbarek, in the information you provided, it seems your oozie max concurrency has been reached for the coordinator. You therefore have a number of applications waiting AM resources. Check you max AM resource percentage in capacity scheduler and consider raising it to either .5 or .6 which states that of the total resources, RM can assign our 50 or 60 percent to AM containers.
... View more
06-21-2016
03:14 PM
what this widget is showing is from this configuration "Memory Node " which you have set as 7 gb. That is the only usable memory which can be allocated to Yarn containers in total. You can increase up to 11 gb. Hope I got your question correctly.
... View more
02-23-2016
03:13 PM
1 Kudo
The release of HDP 2.3.4 offers a newer version of the ATS which is version 1.5. Part of configuring this new ATS version includes providing the following property if Tez is used: <property>
<name>yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes</name>
<value>org.apache.tez.dag.history.logging.ats.TimelineCachePluginImpl</value>
<description>Plugins that can translate a timeline entity read request into a list of timeline cache ids, separated by commas. </description> </property> If this property is included but the tez-client is not present, a message will be seen in the ATS log stating ClassNotFound and the ATS server will fail shortly after issuing a startup. The full documentation for configuring ATS 1.5 is located here: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_yarn_resource_mgt/content/ch08s02.html A documentation bug has been filed as the only reference to this in the configuration section is this: "The Tez cache plugin class must be in the timeline server’s classpath."
... View more
Labels:
12-14-2017
06:29 AM
+1.. I am also in similar need...
... View more