Support Questions

Find answers, ask questions, and share your expertise

Time taken for load dynamic partitions in HIVE

New Contributor

Hi Folks,

 

In hive map reduce job log, the statement  "Time taken for load dynamic partitions"  shows time taken by job for HDFS write. In one of my job its showing as Time taken for load dynamic partitions: 54191 , i am not sure whether this is shown in milliseconds or seconds.Cumulative time taken by this job is around 3 hrs ,for performance tuning i want to analyze from 3 hrs show much actual time is taken for HDFS write. 

1 REPLY 1

New Contributor

Did you get any clue about how we can reduce that time taken to load dynamic partitions? 

 

Is there any tunable which can help to reduce this time? Or is this time is expected time to write data to HDFS?

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.