Member since
11-24-2014
5
Posts
0
Kudos Received
0
Solutions
01-12-2015
06:59 AM
I have a graph loaded as an edgelist (el) and a sequence of vertices (verts) loaded. I can get the ShortestPathss to run using "val sp = ShortestPaths.run(el,verts)" and I can get the length of the shortest path out of there (say 6, meaning 6 edges between the verts). I'd like to know what those edges are. My question is there any way to list the edges along the shortest path? and not just the length of the path? Thanks
... View more
12-16-2014
06:47 AM
Yes, that is pretty much it. Thank you for the quick reply, I will test it out as soon as my current model finishes up.
... View more
12-16-2014
06:39 AM
I am following the MLLib Spark 1.1.1 Documentation for examples under Logistic Regression. I have looked at the API docs and have figured out how to manipulate the settings and run many SVMs and Logistic Regression models. I use the code from the example to evaluate my model: val scoreAndLabels = test.map { point => val score = model.predict(point.features) (score, point.label) } val metrics = new BinaryClassificationMetrics(scoreAndLabels) val auROC = metrics.areaUnderROC() This works great and I can tweak my models to see which one works the best. However I haven't figured out how to export the value scoreAndLabels to HDFS so I can see what I am predicting for the test set. I know this is probably simple scala, but as a newbie to scala, it is frustrating me greatly. For similar examples, I have pushed RDDs out with rdd.saveAsTextFile("/data/mynewhdfsfile"). I learned the hard way to ensure the "data" directory existing in HDFS prior to executing. However, this method does not work for "scoreAndLabels". Any help is greatly appreciated
... View more
11-24-2014
11:02 AM
I have the same problem as well. Who do we contact to get access?
... View more