Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

issue with spark-shell package dependency from cloudera vm

avatar
New Contributor

My host system win 10 and I am using cloudera quick vm for spark learning and my spark version is 1.6 which comes default with cloudera>Now when I try to start the spark shell with the below dependency , I am getting the below exception .Please advise .

 

 spark-shell --packages org.apache.spark:spark-streaming-twitter_2.10:1.6.0

 

 

ERRORS
        Server access error at url https://repo1.maven.org/maven2/org/apache/spark/spark-streaming-twitter_2.10/1.6.0/spark-streaming-t... (javax.net.ssl.SSLException: Received fatal alert: protocol_version)
        Server access error at url https://repo1.maven.org/maven2/org/apache/spark/spark-streaming-twitter_2.10/1.6.0/spark-streaming-t... (javax.net.ssl.SSLException: Received fatal alert: protocol_version)

:: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
Exception in thread "main" java.lang.RuntimeException: [unresolved dependency: org.apache.spark#spark-streaming-twitter_2.10;1.6.0: not found]
        at org.apache.spark.deploy.SparkSubmitUtils$.resolveMavenCoordinates(SparkSubmit.scala:1067)
        at org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSubmit.scala:287)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:154)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

 

5 REPLIES 5

avatar
Super Collaborator
Most probably, your system does not accept the certificates of repo1.maven..... You should check it and if needed to import certificates of the respective CA.

avatar
New Contributor
Can you help me with the steps to do that ..

avatar
Super Collaborator

avatar
New Contributor
It is not about a particular jar or website .I am not able to add any dependency jar with Spark-shell command

avatar
New Contributor

TLS version mismatch is the issue.

 

The below commands, fixed this issue for me, you can try this as well:

 

echo 'export JAVA_TOOL_OPTIONS="-Dhttps.protocols=TLSv1.2"' >> ~/.bashrc
source ~/.bashrc