Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Oozie Shell Action Error: Incompatible minimum and maximum heap sizes specified

Oozie Shell Action Error: Incompatible minimum and maximum heap sizes specified

New Contributor

I tried to create and run oozie workflow with shell action like this:

 

<action name="shell-test">
  <shell xmlns="uri:oozie:shell-action:0.1">
    <job-tracker>${jobTracker}</job-tracker>
    <name-node>${nameNode}</name-node>
    <exec>hdfs</exec>
    <argument>dfs</argument>
    <argument>-mkdir</argument>
    <argument>/tmp/test</argument>
  </shell>
  <ok to="end"/>
  <error to="kill"/>
</action>

 

 

But, always got the error: 
"Stdoutput Error occurred during initialization of VM
Stdoutput Incompatible minimum and maximum heap sizes specified"

The same workflow on CDH4.6.0 is working.

3 REPLIES 3

Re: Oozie Shell Action Error: Incompatible minimum and maximum heap sizes specified

Super Collaborator

Did you recently upgrade Cloudera Manager?  If so, have you deployed client configs since then?  This is usually caused by the change that CM made to the HADOOP_CLIENT_OPTS to include both min and max heap sizes.  If you look in /etc/hadoop/conf/hadoop-env.sh you should see the following (assuming you've deployed client configs correctly):

export HADOOP_CLIENT_OPTS="-Xms268435456 -Xmx268435456 $HADOOP_CLIENT_OPTS"

 

On a side note, you can use the oozie 'fs' action to manipulate files and directories: http://oozie.apache.org/docs/3.2.0-incubating/WorkflowFunctionalSpec.html#a3.2.4_Fs_HDFS_action

 

It is generally not recommended to use shell actions to run hadoop commands if it can be avoided by using native actions.

 

Highlighted

Re: Oozie Shell Action Error: Incompatible minimum and maximum heap sizes specified

New Contributor

Thank you, for your reply. Yes, I did recently upgrade CM, but I didn't deploy client configs correctly. The problem has been solved. Thank you, for your recommendations.

 

Re: Oozie Shell Action Error: Incompatible minimum and maximum heap sizes specified

Contributor

FYI, when specifying duplicate Java command line options, the last one wins. So it's better to append (not prepend) -Xmx and -Xms to $HADOOP_CLIENT_OPTS.