About JitinK

JitinK · ‎10-14-2015

Now thats what I thought..!! I can understand it build updates anyways but the fact fact it didnt learnt from new entries made me whirling and digging the code...!! So in this case can you update the api docs and flow chart as there may be other guys who might get confused like me..!!! Thanks is andvance and thanks for clearing my doubt..!! Also how can I contribute to its development..??!!

JitinK · ‎10-14-2015

I agree that it will make it computationally slow to add buildUpdates to be consumed by Speed Layer. Then what is the actual need of using "setUserVector" and "setItemvector" in Speed Layer or at actually at what point in time does it get invoked. If I understand correctly that , suppose we pass three new rating in 2 seconds, then Serving layer will hold only features updated from last rating, as updates from buildUpdates will be built on old features only and its prevoius updates will be over-wrriten. And since speed layer model dosen't have these updated features it cannot do learning on running user behavior. Its only till batch layer re-runs and batch model gets updated, we can do learning about user behaviour..?? Am I correct or is am I missing something..?? And if so then how can we learn about new user at earliest, or can we add these updates to another update builder for serving layer..??

JitinK · ‎10-14-2015

Hello Mr. Owen, Great Work With Oryx2..!! I am trying to understand the to algorithm / flow of Oryx2... From Class SpeedLayer, I understand that we have two kafka thread: 1) Which runs consume method 2) Which calls SpeedLayerUpdate which actually calling "buildupdates" from ALSSpeedModelManager. When I try to imitate this, I find that "buildUpdates" is generating updates based on X featuers Vector. Now if a new rating is given, buildUpdate generates features and this message is pushed to kafka topic. What I dont understand is how this new features get internalised by Speed model. If message is "only" read by Serving Layer then, Speed Layer wont have this new features for its future reference. So is the update from SpeedLayerUpdate is listened by cosume simlutaneously with Serving Layer or I am missing something where this "buildUpdates" is ineternalising its updates to ALSSpeedModel. Also suggested from flow diagram of Oryx2, the model updates are not read by Speed Layer. Please help my ignorance.

Online	Offline
Last Visited	‎10-15-2015 06:12 AM

Member Since	‎10-14-2015 01:14 AM
Last Visited	‎10-15-2015 06:12 AM
Posts	3

Cloudera Community

Re: How Speed Layer Internalizes Updates..!!

Re: How Speed Layer Internalizes Updates..!!

How Speed Layer Internalizes Updates..!!