Reply
New Contributor
Posts: 1
Registered: ‎08-14-2017

Where can i find mapred.max.split.size configuration in Cloudera??

I wanted to change split size of file in Cloudera "mapred.max.split.size". I am unable to find these property. Should i install/add any else for these property?? Thanks in advance!!

 

 

Current Version: CHD 5.12

 

Ref: http://dailyhadoopsoup.blogspot.com/2014/02/mapreduce-inputs-and-splitting.html

Posts: 1,566
Kudos: 287
Solutions: 240
Registered: ‎07-31-2013

Re: Where can i find mapred.max.split.size configuration in Cloudera??

This property is a per job one and can be supplied as such (via code, via generic options -D, via client/gateway mapred-site.xml safety valve XML snippet).

The properties in Cloudera Manager mostly apply to services and may not exhaustively cover all advanced properties.

If you'd like to apply a value to this property across all jobs, you can specify it under the YARN -> Configuration -> "MapReduce Client Advanced Configuration Snippet (Safety Valve) for mapred-site.xml" in property tags.
Backline Customer Operations Engineer
Announcements