I have a yarn cluster with small nodes running on ec2. I resized the ec2 instance to have much more cores and memory. I then would like the ResourceManager to recognize the resized node. I have tried different things (decommision/recommission the node, deleting the node then add the role back etc.) but the node is still showing the previous vcore and memory for this node, even though in cloudera manager view the monitor shows the updated cores and memory. I'm new to YARN but how to force YARN to recognize the new instance type?
The NM loads its configuration on startup and then reregisters with the RM. So the only thing that should be needed is update the configuration in CM for the node(s) and restart the NM service on the nodes. I have done that numerous times and it always works.
I have only changed the disk size within amazon and I had to do a resize2fs in order to be recognised in the OS.
After I had all the disk visible for the OS, it was automaticly recognized in Cloudera after I started the instances.