Hello, I want to calculate co-occurring terms with spark. Does anyone has Spark java Example for that? I found example in Scala but I don't have any experience with scala? Thank you, Donni ... View more

Hello everyone, I’m currently working on text analytics; we have a big data of scientific texts. I’m thinking about doing a real-time text analytics, my scenario is : the end user can search in a repository (e.g, Elasticsearch), then the result set will be analyzed by using Hadoop , Spark, or both to extract topics or concepts, or doing some classic clustering such as using K-means. Then the results will go back to the end user. Here I’m asking about architecture / pipeline to use. Do you have any suggestion? waiting for your help. Thank you ... View more