02-15-2019 02:22 PM
I've been combing through the Cloudera documentation and found some good tutorials on developing Spark jobs using Scala, however I can't seem to find a good tutorial geared towards my scenario.
I'm attempting to compile a "*.scala" file into a "*.jar" file using maven, however since I'm performing this on the edge node and there is no Internet access, I'm running into some challenges.
Can anyone recommend either a good tutorial or how I should approach this? I downloaded Eclipse and was about to start attempting to develope on my own (Windows) workstation, but I'd prefer not to get to far along if that's the wrong course of action.
Any advice/assistance is greatly appeciated.
02-21-2019 11:10 AM
06-03-2019 10:13 AM - last edited on 06-05-2019 06:12 AM by cjervis
Sorry, I didn't notice you had responded to my question.... If you are still looking for information on this, I ended up compiling the programs using an IDE (have used both Eclipse and IntelliJ) and then copy over the pre-compiled JAR file to the associated Cloudera environment for execution using spark2-submit.
Let me know if you would like additional information.