Support Questions
Find answers, ask questions, and share your expertise

Why i am getting error while submitiing my sparkjob?

Why i am getting error while submitiing my sparkjob?

Hello,

I am using Nifi 1.3.0 with ExecuteSparkJob Processor and i am getting the following error in processor -- error.png and in the nifi-app.log -->

2017-07-14 21:53:44,231 INFO [stream error] c.t.nifi.v2.spark.ExecuteSparkJob ExecuteSparkJob[id=dd071c5c-c28e-3cc0-f9a5-ee5f965deaad] Diagnostics: File does not exist: hdfs://inno1.start.com:8020/user/root/.sparkStaging/application_1500027428726_0007/__spark_conf__8060965695322916343.zip

Here is the configuration of the processor sparkjob.png. Please help me with the solution.

2 REPLIES 2
Highlighted

Re: Why i am getting error while submitiing my sparkjob?

Explorer

Can you check the nifi-app.log this is in the <nifi-directory>/logs/nifi-app.log

Highlighted

Re: Why i am getting error while submitiing my sparkjob?

New Contributor

@Prakhar I'm facing the same issue now. Is this resolved?