Created 02-14-2017 07:20 AM
How to process list of RDDs, foreach is sequential is there an alternative?
val param = RDD[(id, testNo, catId, value)] val key = param.map(f => (f.catId, f.testNo)).distinct.collect.toList.par key.foreach( key => { // kmeans processing // get standard deviation // computation // etc... etc.. })
Created 09-28-2017 08:08 AM
I use Futures and Await. Please see stackoverflow answer.
Created 09-28-2017 08:08 AM
I use Futures and Await. Please see stackoverflow answer.