Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

cluster h2o hadoop yarn memory

Solved Go to solution

cluster h2o hadoop yarn memory

Super Collaborator

Hi: When I start the h2o hadoop cluster it reserver alot yarn memory as you can see on the ambari image.

are there any option like mapperXms that i can see if there are nothing running doesnt reserve memory??

hadoop jar /home/bigotes/h2o-3.8.1.3-hdp2.3/h2odriver.jar -nodes 5 -mapperXmx 30g -nthreads 8  -output h2oOutput

sin-titulo.png

1 ACCEPTED SOLUTION

Accepted Solutions

Re: cluster h2o hadoop yarn memory

Super Collaborator

Finally i start with this:

hadoop jar h2odriver_hdp2.1.jar water.hadoop.h2odriver -libjars ../h2o.jar -mapperXmx 1g -nodes 1 -output hdfsOutputDirName
3 REPLIES 3

Re: cluster h2o hadoop yarn memory

Mentor

There are total four questions on H2O on this site and none were accepted. You might be better off asking on the H2O forum, that said, here they are, thanks take a look at the suggestions, maybe they can help, https://community.hortonworks.com/search.html?f=&type=question&redirect=search%2Fsearch&sort=relevan...

Re: cluster h2o hadoop yarn memory

Super Guru

Re: cluster h2o hadoop yarn memory

Super Collaborator

Finally i start with this:

hadoop jar h2odriver_hdp2.1.jar water.hadoop.h2odriver -libjars ../h2o.jar -mapperXmx 1g -nodes 1 -output hdfsOutputDirName