Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Live debugging of spark program in a cluster using a scala IDE

Live debugging of spark program in a cluster using a scala IDE

New Contributor

Hi, I just wanted to ask if it's possible to debug live in eclipse and trace the specific value of a specific executed code in the spark project while the jar is placed in a cluster provided that i have a breakpoint or not. I want to trace the spark program inside a cluster line per line using an IDE such as the Scala IDE to trace a possible exception during runtime. I don't just want to see the log of a specific jar that is running inside a cluster but I wish to see the current value of specific return values of a function or a variable during runtime or a line within a breakpoint of the IDE. it would make debugging in a dev cluster easier. Thank you.