In the Tez mode of
execution of Informatica Mappings on HDP 2.6 cluster, I observed that the
property “mapreduce.job.maps” and “mapreduce.job.reduces” present
in the Configuration of a job run on Hive in Tez mode fetches the wrong values
as compared to the one in Mapreduce mode. For a large set of data, In
MR mode the values are, mapreduce.job.maps: 3
mapreduce.job.reduces: 0 While
for Tez it is, mapreduce.job.maps: 2
mapreduce.job.reduces: 6 But the DAG Graphical view shows that there are 3 mappers. There is a discrepancy in the value of “mapreduce.job.reduces”
property in the Tez UI as well. We are unable to find an equivalent property in the Tez
configurations that is correctly populated with the number of mappers and
reducers.
... View more
