Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is the ALS model markovian?

SOLVED Go to solution
Highlighted

Is the ALS model markovian?

New Contributor

I didn't know how else to term this, I know ALS isn't but was curious about its represenation on disk.

 

If I wanted to backup(ship) a computed model, is it sufficent to store(ship) all the files in the latest  successful generation only? 

 

Use case are :

1. sending computed models to small clusters that only serve.

2. We have long-running but not eternally persistent clusters, I'd like to be able to ship a model from one to another. Or store it and then load and be able to continue computing without necessarily having generations N-1. 

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Is the ALS model markovian?

Master Collaborator

Ha, you mean is it memoryless? Yes. You can just ship the whole generation directory around. To roll back generations, just delete newer ones and restart the serving layer. etc.

2 REPLIES 2

Re: Is the ALS model markovian?

Master Collaborator

Ha, you mean is it memoryless? Yes. You can just ship the whole generation directory around. To roll back generations, just delete newer ones and restart the serving layer. etc.

Re: Is the ALS model markovian?

New Contributor

Thanks, that actually makes sense as we have control over the model.generations.keep.