Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Solved Go to solution

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Explorer

Sweet! Thanks! Gonna try this out when we get a chance! 

Highlighted

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Contributor
i'm using sbt, should i use spark-submit everytime we need to run a project? SBT run, is catering my needs for now, as im using it in local mode.

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Rising Star
Hi, the link is unavailabe now. Could you provide a new link?

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Master Collaborator

(Which link are you referring to?)

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Rising Star

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Master Collaborator

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Contributor

i'm running my spark job using sbt,i.e., "sbt run".

You think this can be a problem?

Or should we stick to the spark-submit all the time?

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Contributor

i'm running my spark job using sbt,i.e., "sbt run".

You think this can be a problem?

Or should we stick to the spark-submit all the time?