Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Oozie Shell action Output data exceeds its limit [2048]

avatar

I have shell script like below


ssh -q -v -i id_rsa -o "StrictHostKeyChecking no" user@remotemachine script > file

hdfs dfs -put -f file hdfspath


When I run this script in oozie shell action with "", file is copied from remote machine to my machine. Actually its more than 2kb file. But when i move it to hdfs using (hdfs dfs -put) command Its thrwing below error

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), Output data exceeds its limit [2048] org.apache.oozie.action.hadoop.LauncherException: Output data exceeds its limit [2048]

1 ACCEPTED SOLUTION

avatar
Expert Contributor

Hi Selva prabhu,

Would you increase the value for the below property and try again?

oozie-default.xml
<property>
<name>oozie.action.max.output.data</name>
<value>XXXX</value>
</property> 

Ambari:

1. Navigate to Ambari > Services > Oozie > Configs tab.
2. Expand the Custom oozie-site section.
3. Click the Add Property link.
4. For Key, enter the following: oozie.action.max.output.data 
5. For Value, enter the new number of bytes accordingly(Currently the results are exceeding 2048B, try doubling the value)
6. Save configuration.
7. Restart all required components.

Hope it helps. Thanks

View solution in original post

3 REPLIES 3

avatar
Expert Contributor

Hi Selva prabhu,

Would you increase the value for the below property and try again?

oozie-default.xml
<property>
<name>oozie.action.max.output.data</name>
<value>XXXX</value>
</property> 

Ambari:

1. Navigate to Ambari > Services > Oozie > Configs tab.
2. Expand the Custom oozie-site section.
3. Click the Add Property link.
4. For Key, enter the following: oozie.action.max.output.data 
5. For Value, enter the new number of bytes accordingly(Currently the results are exceeding 2048B, try doubling the value)
6. Save configuration.
7. Restart all required components.

Hope it helps. Thanks

avatar
Expert Contributor

@Selva prabhu : If you found this answer is helpful, please take a moment to login and click the "accept" link on the answer.****

avatar
New Contributor