08-04-2015 08:18 AM
I'm doing a check list performance on my client's cluster and I'm following this link:
However, the sectioni Improving Performance in Shuffle Handler and IFile Reader tells:
Once that I have CM UI to administer the cluster, I'm not able to find these options on input box search on the top bar navigation.
I'm wondering whether these options is still valid.
Should I configure it in *-site.xml conf files?
08-04-2015 06:37 PM
Yes the setting is still valid for YARN in the current release.
Since it is not something that is normally is set we do not have it in the CM UI. You can set it using the following steps:
Example of the property:
<property> <name>mapreduce.shuffle.readahead.bytes</name> <value>12345678</value> </property>