question Re: Distributed Recommender not giving recommendations for all users in Archives of Support Questions (Read Only)

Distributed Recommender not giving recommendations for all users

Srini_D — Wed, 29 Oct 2014 14:32:39 GMT

Hi I ran Distributed Recommender using RecommendorJob class and provided movielens data as input. The data is having 943 users but the reocmmendations come out for only some where around 500+ users. Am i doing mistake any where, i provided the CSV file with item id, user id and preference value input.

Re: Distributed Recommender not giving recommendations for all users

srowen — Wed, 29 Oct 2014 16:17:21 GMT

By default the distributed implementations will prune infrequent items and low similarity to scale up. With a tiny data set, this can mean some items are removed entirely, or become un-recommendable. While you can change this behavior, it is not useful to run the Hadoop-based job on such a small data set.

Re: Distributed Recommender not giving recommendations for all users

Srini_D — Wed, 29 Oct 2014 17:15:47 GMT

Oh is it so.. But, How can we alter this behaviour to get recommendations for all users.?

Re: Distributed Recommender not giving recommendations for all users

Srini_D — Wed, 29 Oct 2014 18:31:08 GMT

The dataset is having 100k records, but they correspond to 943 users and 1682. It will create vectors from the data and performs the similarity measure using them. Yes, its minue considering how much the distributed programming can scale upto, but interested to know how to alter the behaviour.