Hi,   could you please look into the spark History server logs and check for any errors? also grep for the application id in the Application History, that will show the status of the application whether it is inprogress or completed?   Thanks AKR ... View more

Hi,   This is very difficult to identify the active files now which are in progress state.  Please look for the RUNNING jobs from RM WebUI and remove all the other in progress files that are not listed in RUNNING state.    To check for the RUNNING Jobs from RM WeBUI please follow this steps   1. Login into Cloudera Manager. 2. Choose Yarn as Service 3. Click WEBUI 4. Choose Resource Manager WEBUI 5. A New Screen will be displayed showing list of all applications. 6. On the Left Hand side you can see links displayed there under applications link. Click the "Running" link displayed under Applications link 7. This "Running" link will all show the in-progress jobs that are active,. 8. Please look for the RUNNING jobs from RM WebUI and remove all the other in progress jobs that are not listed in RUNNING state. ... View more

Hi, Could you tell what is the error you are facing that will help us to solve the issue?   Thanks AKR ... View more

Hi, Please check in Logs whether any java.net.BindException: Address already in use is arrived, If it is seen  It clearly resembles that port is already in use,  (i.e) something is trying to connect to the port and is blocking which we are not sure. Possible causes Maybe  1. Some "port scanner" or something is blocking this port (or) Some other Service is running on the port like a port scanner. 2. The accumulator is still running on those ports from an earlier run 3. Several Services may be running on this port.   Please make sure what services (or) applications is running on this port and try to stop it.         ... View more

Hi Alex,   Did u checked in Oozie Configuration or in oozie logs like whether the Event logs are writing in some other path apart from the path that was configured in CM?   Thanks AKR ... View more

Hi Pal,   Can you grep for the particular application ID in the folder  /user/spark/applicationHistory to make sure whether the job has been successfully completed or still in .inprogress state?   Thanks AKR ... View more

Hi,   This Error will happen when "Spark executor-memory is too small for spark to start" . Please refer to the upstream jira for more details.   https://issues.apache.org/jira/browse/SPARK-12759   Thanks AKR ... View more

Hi,   Is the issue happens for only one particular job?    Thx AKR ... View more

Hi,   Could you please share the Entire console logs for further analysis?     Thanks Arun ... View more

Hi,   Did you tried changing the value of the property spark.rpc.askTimeout to higher value and try submitting the job again.   ... View more