Reply
Explorer
Posts: 14
Registered: ‎04-03-2014

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Sweet! Thanks! Gonna try this out when we get a chance! 

Contributor
Posts: 52
Registered: ‎10-19-2016

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Hi, the link is unavailabe now. Could you provide a new link?
Cloudera Employee
Posts: 481
Registered: ‎08-11-2014

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

(Which link are you referring to?)

Contributor
Posts: 52
Registered: ‎10-19-2016

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Cloudera Employee
Posts: 481
Registered: ‎08-11-2014

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

Explorer
Posts: 13
Registered: ‎11-22-2016

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

i'm running my spark job using sbt,i.e., "sbt run".

You think this can be a problem?

Or should we stick to the spark-submit all the time?

Explorer
Posts: 13
Registered: ‎11-22-2016

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

i'm running my spark job using sbt,i.e., "sbt run".

You think this can be a problem?

Or should we stick to the spark-submit all the time?

Highlighted
Explorer
Posts: 13
Registered: ‎11-22-2016

Re: What dependencies to submit Spark jobs programmatically (not via spark-submit)?

i'm using sbt, should i use spark-submit everytime we need to run a project? SBT run, is catering my needs for now, as im using it in local mode.