10-25-2017 02:29 AM
I am trying to launch an spark job in scala from my local eclipse, and I want it to run in my "quickstart" cloudera image running in a virtualvox in my laptop.
For that I try to do something like this:
val sparkConf = new SparkConf().setAppName("Testing hive").setMaster("spark://quickstart.cloudera:7077")
val sc: SparkContext = new SparkContext(sparkConf)
But I can not connect to the cloudera spark:
java.io.IOException: Failed to connect to quickstart.cloudera/192.168.56.101:7077
The Ip address is correct, nothing is listening on that port, but I can not find the port that I need..., could anyone help me please?
Thank you very much,