@suresh krish if you look at white list param,this param(tez.shuffle-vertex-manager.min-src-fraction) is not in white list so the following piece of code(HiveConf.java) throws cannot modify exception. public void verifyAndSet(String name, String value) throws IllegalArgumentException {
if (modWhiteListPattern != null) {
Matcher wlMatcher = modWhiteListPattern.matcher(name);
if (!wlMatcher.matches()) {
throw new IllegalArgumentException("Cannot modify " + name + " at runtime. "+ "It is not in list of params that are allowed to be modified at runtime");
}
}
if (restrictList.contains(name)) {
throw new IllegalArgumentException("Cannot modify " + name + " at runtime. It is in the list"+ "of parameters that can't be modified at runtime");
}
isSparkConfigUpdated = isSparkRelatedConfig(name);
set(name, value);
}
... View more
