Reply
Highlighted
Explorer
Posts: 8
Registered: ‎06-26-2018

Tutorial on Building Spark Development Environment

Hi all,

 

I've been combing through the Cloudera documentation and found some good tutorials on developing Spark jobs using Scala, however I can't seem to find a good tutorial geared towards my scenario.

 

I'm attempting to compile a "*.scala" file into a "*.jar" file using maven, however since I'm performing this on the edge node and there is no Internet access, I'm running into some challenges.  

 

Can anyone recommend either a good tutorial or how I should approach this?  I downloaded Eclipse and was about to start attempting to develope on my own (Windows) workstation, but I'd prefer not to get to far along if that's the wrong course of action.

 

Any advice/assistance is greatly appeciated.

 

Thanks,

 

Greg

Explorer
Posts: 15
Registered: ‎01-31-2019

Re: Tutorial on Building Spark Development Environment

Can you provide more details about what you are trying to do and the challenges you are having? I'm in a similar situation with a cluster that has no Internet access. Are you trying to set up a local Maven repository?
Announcements