https://community.cloudera.com/t5/Support-Questions/Spark-error-org-apache-spark-SparkException-Failed-to-get/m-p/230884#M192731 <P><A rel="user" href="https://community.cloudera.com/users/18482/hugofelix.html" nodeid="18482">@Hugo Felix</A></P><P>Thank you for sharing the tutorial. I was able to replicate the issue and I found the issue to be with incompatible jars.</P><P>I am using the following precise versions that I pass to spark-shell.</P><P><A href="https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-twitter_2.10/1.6.1.2.4.2.10-1">spark-streaming-twitter_2.10-1.6.1.2.4.2.10-1.jar </A></P><P><A href="https://mvnrepository.com/artifact/org.twitter4j/twitter4j-core/4.0.4">twitter4j-core-4.0.4.jar</A></P><P><A href="https://mvnrepository.com/artifact/org.twitter4j/twitter4j-stream/4.0.4">twitter4j-stream-4.0.4.jar</A></P><P>For test purpose, I had put them all under /tmp and here is how I initiated the spark shell:</P><PRE>Syntax: spark-shell --jars "/path/jar1,/path/jar2,/path/jar3" Example: spark-shell --jars "/tmp/spark-streaming-twitter_2.10-1.6.1.2.4.2.10-1.jar,/tmp/twitter4j-core-4.0.4.jar,/tmp/twitter4j-stream-4.0.4.jar"</PRE><P>Once I got the scala prompt in spark-shell, I typed out the code from the tutorial without specifying any value for "spark.cleaner.ttl".</P><P>Hope this helps.</P> Thu, 06 Jul 2017 03:24:43 GMT dineshc 2017-07-06T03:24:43Z