Reply
Imp
New Contributor
Posts: 1
Registered: ‎05-24-2017

Handling matrix operations where rows and columns are in millions (users X items)

I have just read the post:
@ClouderaEng blog:: working-with-apache-spark-or-how-i-learned-to-stop-worrying-and-love-the-shuffle
And, it is a very nice write-up. I had a similar problem, and was wondering about what solution does Ilya Ganelin would have taken or if Justin Kestelyn could help with the brief on the approach with Spark. Thanks in advance!

Posts: 642
Topics: 3
Kudos: 118
Solutions: 67
Registered: ‎08-16-2016

Re: Handling matrix operations where rows and columns are in millions (users X items)

please reshare the link as it is not working. Also provide more information on the post and what you are looking for.
Posts: 964
Kudos: 114
Solutions: 61
Registered: ‎04-06-2015

Re: Handling matrix operations where rows and columns are in millions (users X items)

I'll provide the link - 

 

Working with Apache Spark: Or, How I Learned to Stop Worrying and Love the Shuffle

 

Of course my first thought is that the article is two years old and things have changed quite a bit since then. @mbigelow is right though, some additional background on your needs would be helpful. 



Cy Jervis, Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum