We are running Spark Streaming job on cluster managed by CM 6. After the spark streaming job has been run for like 4-5 days, the Spark UI for that particular job does not open. It says, logs like this in my nohup driver output file.
servlet.ServletHandler: Error for /streaming/
java.lang.OutOfMemoryError: Java heap space
These logs are logged many times in a continuous series.
But my job keeps on running fine. Its just that I am not able to open up the UI by clicking the Application Master link when I open the job from YARN Running Applications UI.