10-04-2017 03:58 AM - edited 10-04-2017 04:04 AM
I'm trying to run an app, that makes hive 'INSERT overwrite table' every hour, in yarn. Unfortunately, I get this error:
java.lang.Exception: Container is not yet running. Current state is LOCALIZING.
The data I'm trying to process, is about 12gb and this happened after we upgraded to CDH 5.3.3-1
The interesting thing is that sometime it finished successfully, but in most cases it fails.
Node Manager seems to be unable to localize the data on time, so the containers do not go. Please help if someone knows what the problem is. Thanks.
14 Data nodes (7 nodes x 32 cores/127gb and 7 nodes x 40 cores/127 gb)