- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Oozie Shell action Output data exceeds its limit [2048]
- Labels:
-
Apache Hadoop
-
Apache Oozie
Created ‎11-13-2018 06:32 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have shell script like below
ssh -q -v -i id_rsa -o "StrictHostKeyChecking no" user@remotemachine script > file
hdfs dfs -put -f file hdfspath
When I run this script in oozie shell action with "", file is copied from remote machine to my machine. Actually its more than 2kb file. But when i move it to hdfs using (hdfs dfs -put) command Its thrwing below error
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), Output data exceeds its limit [2048] org.apache.oozie.action.hadoop.LauncherException: Output data exceeds its limit [2048]
Created ‎11-26-2018 09:51 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Selva prabhu,
Would you increase the value for the below property and try again?
oozie-default.xml <property> <name>oozie.action.max.output.data</name> <value>XXXX</value> </property>
Ambari:
1. Navigate to Ambari > Services > Oozie > Configs tab. 2. Expand the Custom oozie-site section. 3. Click the Add Property link. 4. For Key, enter the following: oozie.action.max.output.data 5. For Value, enter the new number of bytes accordingly(Currently the results are exceeding 2048B, try doubling the value) 6. Save configuration. 7. Restart all required components.
Hope it helps. Thanks
Created ‎11-26-2018 09:51 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Selva prabhu,
Would you increase the value for the below property and try again?
oozie-default.xml <property> <name>oozie.action.max.output.data</name> <value>XXXX</value> </property>
Ambari:
1. Navigate to Ambari > Services > Oozie > Configs tab. 2. Expand the Custom oozie-site section. 3. Click the Add Property link. 4. For Key, enter the following: oozie.action.max.output.data 5. For Value, enter the new number of bytes accordingly(Currently the results are exceeding 2048B, try doubling the value) 6. Save configuration. 7. Restart all required components.
Hope it helps. Thanks
Created ‎11-27-2018 07:38 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Selva prabhu : If you found this answer is helpful, please take a moment to login and click the "accept" link on the answer.****
Created ‎11-26-2018 06:20 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
