Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Oozie Shell action Output data exceeds its limit [2048]

Solved Go to solution

Oozie Shell action Output data exceeds its limit [2048]

New Contributor

I have shell script like below


ssh -q -v -i id_rsa -o "StrictHostKeyChecking no" user@remotemachine script > file

hdfs dfs -put -f file hdfspath


When I run this script in oozie shell action with "", file is copied from remote machine to my machine. Actually its more than 2kb file. But when i move it to hdfs using (hdfs dfs -put) command Its thrwing below error

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), Output data exceeds its limit [2048] org.apache.oozie.action.hadoop.LauncherException: Output data exceeds its limit [2048]

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Oozie Shell action Output data exceeds its limit [2048]

Expert Contributor

Hi Selva prabhu,

Would you increase the value for the below property and try again?

oozie-default.xml
<property>
<name>oozie.action.max.output.data</name>
<value>XXXX</value>
</property> 

Ambari:

1. Navigate to Ambari > Services > Oozie > Configs tab.
2. Expand the Custom oozie-site section.
3. Click the Add Property link.
4. For Key, enter the following: oozie.action.max.output.data 
5. For Value, enter the new number of bytes accordingly(Currently the results are exceeding 2048B, try doubling the value)
6. Save configuration.
7. Restart all required components.

Hope it helps. Thanks

3 REPLIES 3

Re: Oozie Shell action Output data exceeds its limit [2048]

Expert Contributor

Hi Selva prabhu,

Would you increase the value for the below property and try again?

oozie-default.xml
<property>
<name>oozie.action.max.output.data</name>
<value>XXXX</value>
</property> 

Ambari:

1. Navigate to Ambari > Services > Oozie > Configs tab.
2. Expand the Custom oozie-site section.
3. Click the Add Property link.
4. For Key, enter the following: oozie.action.max.output.data 
5. For Value, enter the new number of bytes accordingly(Currently the results are exceeding 2048B, try doubling the value)
6. Save configuration.
7. Restart all required components.

Hope it helps. Thanks

Re: Oozie Shell action Output data exceeds its limit [2048]

Expert Contributor

@Selva prabhu : If you found this answer is helpful, please take a moment to login and click the "accept" link on the answer.****

Re: Oozie Shell action Output data exceeds its limit [2048]

New Contributor