Support Questions
Find answers, ask questions, and share your expertise

Time taken for load dynamic partitions in HIVE

New Contributor

Hi Folks,

 

In hive map reduce job log, the statement  "Time taken for load dynamic partitions"  shows time taken by job for HDFS write. In one of my job its showing as Time taken for load dynamic partitions: 54191 , i am not sure whether this is shown in milliseconds or seconds.Cumulative time taken by this job is around 3 hrs ,for performance tuning i want to analyze from 3 hrs show much actual time is taken for HDFS write. 

1 REPLY 1

Re: Time taken for load dynamic partitions in HIVE

New Contributor

Did you get any clue about how we can reduce that time taken to load dynamic partitions? 

 

Is there any tunable which can help to reduce this time? Or is this time is expected time to write data to HDFS?