In the Tez mode of execution of Informatica Mappings on HDP 2.6 cluster, I observed that the property “mapreduce.job.maps” and “mapreduce.job.reduces” present in the Configuration of a job run on Hive in Tez mode fetches the wrong values as compared to the one in Mapreduce mode.
For a large set of data,
In MR mode the values are,
While for Tez it is,
But the DAG Graphical view shows that there are 3 mappers.
There is a discrepancy in the value of “mapreduce.job.reduces” property in the Tez UI as well.
We are unable to find an equivalent property in the Tez configurations that is correctly populated with the number of mappers and reducers.
The properties 'mapreduce.job.*' are only applicable to MR jobs. In Tez, the number of mappers and controlled by below parameters:
And, reducers are controlled in Hive with properties:
For more details, refer link.