What kind of algorithm can be written with spark

[#1]

Dear Sir,

This is Maojun Wang ,from China Meteorological Administration Public Meteorological Service Center. Now i am using sparkSQL to count some Statistics，But now I am very very

interested of how to implement some algorithm about Meteorological , like Interpolation algorithm,Kriging  Interpolation algorithm,Cressman Interpolation algorithm,IDW

Interpolation algorithm and so on.

I questions:

1 What kind of algorithm can be written with spark?

Yours faithfully

MaojunWang

[#2 · Accepted solution]

That's perhaps too broad to answer here. Generally, any algorithm that is data-parallel will do well on Spark (or indeed, on MapReduce). And ones that aren't data-parallel do not. I am not familiar with any of those algorithms, but that's the question to answer.