Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

tuning hyperparameters with Oryx 1.0

Solved Go to solution

tuning hyperparameters with Oryx 1.0

Explorer

Hello all,

 

I want to ask the community some wisdom in tuning the als model parameters with Oryx 1.x.

The computation and serving layer are all in an isolated box for tuning purpose and will use local-computation.

Based on my current understanding of the system, I plan to carry out the task in following manner:

 

1. prepare a csv file

2. stop oryx, reset/wipe any current als model, start oryx

3. train als model (/ingest)

4. evaluate the model and post the result (a custom code)

5. modify oryx.conf parameter values, go back to step 2

 

The main difficulty i have is with step 2.

I'm not sure what happens if I were to keep calliing /ingest with the same data and a changed oryx.conf file, so I'm thinking I should stop oryx(both computation and serving) and reset the system to clean slate.

 

My questions are:

a. Is there an alternative to achieving tuning with Oryx 1.x

b. Do both oryx-computation and oryx-serving need to stop before wiping the contents of $instance.dir?

 

 

1 ACCEPTED SOLUTION

Accepted Solutions

Re: tuning hyperparameters with Oryx 1.0

Master Collaborator

Yes, it's very manual. This is not really something it helps you do well. (2.x will do this automatically)

 

Yes, stop the instances, delete the previous data, then restart. That should be fine.

3 REPLIES 3

Re: tuning hyperparameters with Oryx 1.0

Explorer

http://community.cloudera.com/t5/Data-Science-and-Machine/Question-on-ingest-service/m-p/19718#

suggests that at least oryx-computation server needs to be restarted?

Re: tuning hyperparameters with Oryx 1.0

Master Collaborator

Yes, it's very manual. This is not really something it helps you do well. (2.x will do this automatically)

 

Yes, stop the instances, delete the previous data, then restart. That should be fine.

Highlighted

Re: tuning hyperparameters with Oryx 1.0

Explorer

Thank you, Sean.

Don't have an account?
Coming from Hortonworks? Activate your account here