Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

issue with spark-shell package dependency from cloudera vm

issue with spark-shell package dependency from cloudera vm

New Contributor

My host system win 10 and I am using cloudera quick vm for spark learning and my spark version is 1.6 which comes default with cloudera>Now when I try to start the spark shell with the below dependency , I am getting the below exception .Please advise .

 

 spark-shell --packages org.apache.spark:spark-streaming-twitter_2.10:1.6.0

 

 

ERRORS
        Server access error at url https://repo1.maven.org/maven2/org/apache/spark/spark-streaming-twitter_2.10/1.6.0/spark-streaming-t... (javax.net.ssl.SSLException: Received fatal alert: protocol_version)
        Server access error at url https://repo1.maven.org/maven2/org/apache/spark/spark-streaming-twitter_2.10/1.6.0/spark-streaming-t... (javax.net.ssl.SSLException: Received fatal alert: protocol_version)

:: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
Exception in thread "main" java.lang.RuntimeException: [unresolved dependency: org.apache.spark#spark-streaming-twitter_2.10;1.6.0: not found]
        at org.apache.spark.deploy.SparkSubmitUtils$.resolveMavenCoordinates(SparkSubmit.scala:1067)
        at org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSubmit.scala:287)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:154)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

 

5 REPLIES 5
Highlighted

Re: issue with spark-shell package dependency from cloudera vm

Expert Contributor
Most probably, your system does not accept the certificates of repo1.maven..... You should check it and if needed to import certificates of the respective CA.

Re: issue with spark-shell package dependency from cloudera vm

New Contributor
Can you help me with the steps to do that ..

Re: issue with spark-shell package dependency from cloudera vm

Expert Contributor

Re: issue with spark-shell package dependency from cloudera vm

New Contributor
It is not about a particular jar or website .I am not able to add any dependency jar with Spark-shell command

Re: issue with spark-shell package dependency from cloudera vm

New Contributor

TLS version mismatch is the issue.

 

The below commands, fixed this issue for me, you can try this as well:

 

echo 'export JAVA_TOOL_OPTIONS="-Dhttps.protocols=TLSv1.2"' >> ~/.bashrc
source ~/.bashrc