Support Questions

Find answers, ask questions, and share your expertise

Number of mapper

avatar
New Contributor

Hi,

Our  user is running a job and which is a hive query and  number of  mapper is always  6 and not changing even the data size change.  It is  a  insert query.   How do  I change number of mappers ?  Which parameter determine number of mappers?

2 REPLIES 2

avatar
New Contributor

Hi,

Our  user is running a job and which is a hive query and  number of  mapper is always  6 and not changing even the data size change. 192168101.win 100001.dev routerlogin.win

It is  a  insert query.   How do  I change number of mappers ?  Which parameter determine number of mappers?

 

 

Thank you.

avatar
Rising Star

hello Becky

You can either reduce "split max size" in order to gain more mappers 

 

SET mapreduce.input.fileinputformat.split.maxsize;



Or you can try :

Set mapreduce.job.maps=XX

 

for the second option, you may need to disable  map files

hive.merge.mapfiles=false

 

Let me know if any solution works for you 
Good luck