Member since
03-04-2015
4
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2267 | 03-05-2015 11:14 AM |
03-05-2015
11:14 AM
I figured why the last reducer is taking so long - User error (its me!)... When I presplit the table based on target regions, I missed to include all the keys. This resulted in a table with last key being responsible for 80 times more data than other regions. This is what caused that reducer to spend so much amount of time. If he table is split evenly all reducers seem to be finishing close to each other.
... View more