spark2 service was not installed on the new node, and the nodemanager startup was expecting the following jar /usr/hdp/2.5.3.0-37/spark2/aux/spark-2.0.0.2.5.3.0-37-yarn-shuffle.jar, which was not there.

I re-installed spark2 service, and the issue is fixed.