Reply
New Contributor
Posts: 1
Registered: ‎11-26-2016

Spark: runtime exception: java.lang.RuntimeException: Stream '/jars/jcommon-' was not found.

I use Cloudera VM (running through VirtualBox on a Mac) for an online analytics course. The exercise involves running Scala on a given dataset. The given spark shell command does not load all the jar files.

 

spark-shell --jars lib/gs-core-1.2.jar,lib/gs-ui-1.2.jar,lib/jcommon-1.0.16.jar,lib/jfreechart-1.0.13.jar,lib/breeze_2.10-0.9.jar,lib/breeze-viz_2.10-0.9.jar,lib/pherd-1.0.jar

Part of the console output displays the following: Warning: Local jar /home/cloudera/lib/jcommon-1.0.16.jar does not exist, skipping.

 

Further on in the exercise, I run the following command.

metrosGraph.vertices.take(5)

The console throws an error. Here's the partial output

17/03/25 09:36:58 ERROR executor.Executor: Exception in task 0.0 in stage 0.0 (TID 0)
java.lang.RuntimeException: Stream '/jars/jcommon-' was not found.

Since this vm is a self-contained environment created by Cloudera, I have no idea how to 1) update this Java instance to include missing jar files, or 2) circumvent Cloudera's failure to include a proper install so that I can complete the exercise.

 

I appreciate your help in resolving this issue.

Announcements