Support Questions

Find answers, ask questions, and share your expertise

cluster h2o hadoop yarn memory

avatar
Master Collaborator

Hi: When I start the h2o hadoop cluster it reserver alot yarn memory as you can see on the ambari image.

are there any option like mapperXms that i can see if there are nothing running doesnt reserve memory??

hadoop jar /home/bigotes/h2o-3.8.1.3-hdp2.3/h2odriver.jar -nodes 5 -mapperXmx 30g -nthreads 8  -output h2oOutput

sin-titulo.png

1 ACCEPTED SOLUTION

avatar
Master Collaborator

Finally i start with this:

hadoop jar h2odriver_hdp2.1.jar water.hadoop.h2odriver -libjars ../h2o.jar -mapperXmx 1g -nodes 1 -output hdfsOutputDirName

View solution in original post

3 REPLIES 3

avatar
Master Mentor

There are total four questions on H2O on this site and none were accepted. You might be better off asking on the H2O forum, that said, here they are, thanks take a look at the suggestions, maybe they can help, https://community.hortonworks.com/search.html?f=&type=question&redirect=search%2Fsearch&sort=relevan...

avatar
Master Guru

avatar
Master Collaborator

Finally i start with this:

hadoop jar h2odriver_hdp2.1.jar water.hadoop.h2odriver -libjars ../h2o.jar -mapperXmx 1g -nodes 1 -output hdfsOutputDirName