That's because of the cache.   These posts might be helpful.   1) How the caches work with YARN : https://hortonworks.com/blog/resource-localization-in-yarn-deep-dive/   2) How to solve the situation :  https://community.hortonworks.com/content/supportkb/222436/errororgapachehadoopmapreducetaskreduceshuffleshuf.html ... View more