Reply
Highlighted
New Contributor
Posts: 3
Registered: ‎11-17-2016

Re: Where does spark-submit look for Jar files?

I posted an issue yesterday that relates to this -- the spark-submit classpath seems to conflict with commons-compress from a suppiled uber-jar.

 

I've tried the --conf, --jar, and the --packages flags with spark-submit with no resolution.  

 

Spark 2.x + Tika: java.lang.NoSuchMethodError: org.apache.commons.compress.archivers.ArchiveStreamF

 

Any help would be greatly appreciated!!!!

 

 

Announcements