Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Number of mapper

avatar
New Contributor

Hi,

Our  user is running a job and which is a hive query and  number of  mapper is always  6 and not changing even the data size change.  It is  a  insert query.   How do  I change number of mappers ?  Which parameter determine number of mappers?

2 REPLIES 2

avatar
New Contributor

Hi,

Our  user is running a job and which is a hive query and  number of  mapper is always  6 and not changing even the data size change. 192168101.win 100001.dev routerlogin.win

It is  a  insert query.   How do  I change number of mappers ?  Which parameter determine number of mappers?

 

 

Thank you.

avatar
Rising Star

hello Becky

You can either reduce "split max size" in order to gain more mappers 

 

SET mapreduce.input.fileinputformat.split.maxsize;



Or you can try :

Set mapreduce.job.maps=XX

 

for the second option, you may need to disable  map files

hive.merge.mapfiles=false

 

Let me know if any solution works for you 
Good luck