Skip to main content
kalaicool261
kalaicool261
Bronze ⭐️⭐️⭐️
July 7, 2021
Solved

Getting OOM on submitting the hadoop job

I am trying to submit the job to the Hadoop cluster in the CDSW terminal. I see the job get killed before submitting. Can you please let me know how to increase memory for the terminal.

 

cdsw@fecbq09gv6giyrvl:~/h2o-3.32.1.3-cdh6.3$ hadoop jar h2odriver.jar -nodes 1 -mapperXmx 1g -extdriverif $CDSW_HOST_IP_ADDRESS -driverif $CDSW_IP_ADDRESS -driverport $CDSW_HOST_PORT_0 -disown
WARNING: Use "yarn jar" to launch YARN applicatioScreenshot 2021-07-07 at 9.56.16 PM.pngns.
Killed
cdsw@fecbq09gv6giyrvl:~/h2o-3.32.1.3-cdh6.3$

GangWar
GangWarAnswer
Platinum ⭐️⭐️
July 11, 2021

@kalaicool261 There is nothing like terminal memory. This seems a engine memory issue. 

You should launch the session (engine) with larger memory and CPU from the drop down menu on Session launch page and see if the helps. 

Screenshot 2021-07-11 at 5.56.26 PM.png

 

Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
View in thread

1 reply

GangWar
Platinum ⭐️⭐️
GangWarAnswer
Platinum ⭐️⭐️
July 11, 2021

@kalaicool261 There is nothing like terminal memory. This seems a engine memory issue. 

You should launch the session (engine) with larger memory and CPU from the drop down menu on Session launch page and see if the helps. 

Screenshot 2021-07-11 at 5.56.26 PM.png

 

Translate
Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
Terms & ConditionsAccessibility statement