https://community.cloudera.com/t5/Support-Questions/Spark-java-lang-StackOverflowError/m-p/226958#M188818 <A rel="user" href="https://community.cloudera.com/users/30172/erkansirin78.html" nodeid="30172">@Erkan ŞİRİN</A><P>This is not a compile time option. Its runtime and should be set in the command line not in code by spark session options. If you are you running this code from eclipse you should add this as an argument to the java directly -Xss. Else if running using spark-submit command then add as I indicated before. With these settings at least it should take longer to error out since you will be making the memory area for stack bigger to fill. </P><P>HTH</P><P>*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.</P> Mon, 27 Aug 2018 20:31:32 GMT falbani 2018-08-27T20:31:32Z