Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark is throwing random "file not found exception"

Spark is throwing random "file not found exception"

New Contributor

I am trying to save file on my local linux system , using file:/// option. Problem is very weird, it is showing random file not found exception for the path , which i am not even providing.

scala> news1.saveAsTextFile("file:///home/saripand/h") 19/01/30 05:39:24 WARN TaskSetManager: Lost task 0.0 in stage 16.0 (TID 46, sandbox-hdp.hortonworks.com, executor 2): java.io.FileNotFoundException: File file:/home/saripand/Weblogs/2013-09-19.log does not exist

here, i am not even mentioning the path "file:/home/saripand/Weblogs/2013-09-19.log" in my entire code, still it is happening. any suggestion would highly appreciated, i am stucked here.

Don't have an account?
Coming from Hortonworks? Activate your account here