New Contributor
Posts: 2
Registered: ‎02-23-2017

Live debugging of spark program in a cluster using a scala IDE

Hi, I just wanted to ask if it's possible to debug live in eclipse and trace the specific value of a specific executed code in the spark project while the jar is placed in a cluster provided that i have a breakpoint or not. I want to trace the spark program inside a cluster line per line using an IDE such as the Scala IDE to trace a possible exception during runtime. I don't just want to see the log of a specific jar that is running inside a cluster but I wish to see the current value of specific return values of a function or a variable during runtime or a line within a breakpoint of the IDE. it would make debugging in a dev cluster easier. Thank you.