question Re: Oozie Shell action Output data exceeds its limit [2048] in Archives of Support Questions (Read Only)

Oozie Shell action Output data exceeds its limit [2048]

selvaprabhu_k — Wed, 14 Nov 2018 02:32:52 GMT

I have shell script like below

ssh -q -v -i id_rsa -o "StrictHostKeyChecking no" user@remotemachine script > file

hdfs dfs -put -f file hdfspath

When I run this script in oozie shell action with "", file is copied from remote machine to my machine. Actually its more than 2kb file. But when i move it to hdfs using (hdfs dfs -put) command Its thrwing below error

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), Output data exceeds its limit [2048] org.apache.oozie.action.hadoop.LauncherException: Output data exceeds its limit [2048]

Re: Oozie Shell action Output data exceeds its limit [2048]

sampathkumar_ma — Mon, 26 Nov 2018 17:51:51 GMT

Hi Selva prabhu,

Would you increase the value for the below property and try again?

oozie-default.xml
<property>
<name>oozie.action.max.output.data</name>
<value>XXXX</value>
</property>

Ambari:

1. Navigate to Ambari > Services > Oozie > Configs tab.
2. Expand the Custom oozie-site section.
3. Click the Add Property link.
4. For Key, enter the following: oozie.action.max.output.data 
5. For Value, enter the new number of bytes accordingly(Currently the results are exceeding 2048B, try doubling the value)
6. Save configuration.
7. Restart all required components.

Hope it helps. Thanks

Re: Oozie Shell action Output data exceeds its limit [2048]

allan_ni — Tue, 27 Nov 2018 02:20:34 GMT

This may be help: https://stackoverflow.com/questions/37541048/oozie-output-data-exceeds-its-limit-2048

Re: Oozie Shell action Output data exceeds its limit [2048]

sampathkumar_ma — Tue, 27 Nov 2018 15:38:07 GMT

@Selva prabhu : If you found this answer is helpful, please take a moment to login and click the "accept" link on the answer.****