Reply
New Contributor
Posts: 2
Registered: ‎06-20-2014

I am trying to set the snappy compression for the MR2 jobs.

The documentation says to edit the mapred-site.xml file. I am using parcels and CDH5. I dont want to directly edit the mapred-site.xml file, I need to do that through the console, but it is very confusing trying to figure out where to exactly add the following settings in the GUI.

<property>
  <name>mapreduce.map.output.compress</name>  
  <value>true</value>
</property>
<property>
  <name>mapred.map.output.compress.codec</name>  
  <value>org.apache.hadoop.io.compress.SnappyCodec</value>
</property>
Highlighted
Cloudera Employee
Posts: 62
Registered: ‎07-29-2013

Re: I am trying to set the snappy compression for the MR2 jobs.

You likely need to use the configuration safety valve for mapred-site.xml
in your YARN service.
You can read more about safety valves at
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM4Ent/4.8.1/Cloudera-Manager-Managin...

The article is for CM4 but CM5 would be very similar.

Announcements