I have a graph loaded as an edgelist (el) and a sequence of vertices (verts) loaded. I can get the ShortestPathss to run using "val sp = ShortestPaths.run(el,verts)" and I can get the length of the shortest path out of there (say 6, meaning 6 edges between the verts). I'd like to know what those edges are.   My question is there any way to list the edges along the shortest path? and not just the length of the path?   Thanks ... View more

I am following the MLLib Spark 1.1.1 Documentation for examples under Logistic Regression. I have looked at the API docs and have figured out how to manipulate the settings and run many SVMs and Logistic Regression models. I use the code from the example to evaluate my model:       val scoreAndLabels = test.map { point =>       val score = model.predict(point.features)      (score, point.label)     }       val metrics = new BinaryClassificationMetrics(scoreAndLabels)     val auROC = metrics.areaUnderROC()   This works great and I can tweak my models to see which one works the best. However I haven't figured out how to export the value scoreAndLabels to HDFS so I can see what I am predicting for the test set. I know this is probably simple scala, but as a newbie to scala, it is frustrating me greatly.    For similar examples, I have pushed RDDs out with rdd.saveAsTextFile("/data/mynewhdfsfile"). I learned the hard way to ensure the "data" directory existing in HDFS prior to executing. However, this method does not work for "scoreAndLabels". Any help is greatly appreciated ... View more