Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Time taken for load dynamic partitions in HIVE

avatar

Hi Folks,

 

In hive map reduce job log, the statement  "Time taken for load dynamic partitions"  shows time taken by job for HDFS write. In one of my job its showing as Time taken for load dynamic partitions: 54191 , i am not sure whether this is shown in milliseconds or seconds.Cumulative time taken by this job is around 3 hrs ,for performance tuning i want to analyze from 3 hrs show much actual time is taken for HDFS write. 

1 REPLY 1

avatar
New Contributor

Did you get any clue about how we can reduce that time taken to load dynamic partitions? 

 

Is there any tunable which can help to reduce this time? Or is this time is expected time to write data to HDFS?