i am setting this parameter to use 32 mappers but its still using one
hive> set map.reduce.tasks=32
> explain select sum(amnt) from lanetxn;
Plan not optimized by CBO.
Vertex dependency in root stage
Reducer 2 <- Map 1 (SIMPLE_EDGE)
@Sami Ahmad try hive> set mapred.map.tasks = 32;
still the same issue , its still using only one map task and 2 reduce tasks.
Maximum number of mappers will be bound by the number of splits calculated at split generation time.
These settings impact split calculation:
Splits are grouped at the Tez layer based on these settings:
If you want more mappers you can tune all these settings down. Note this will not guarantee lower latency, especially on small clusters.