Community Articles

Find and share helpful community-sourced technical articles.

SYMPTOM Concurrency issues hit during multi-threaded moveFile issued when processing queries such as "INSERT OVERWRITE TABLE ... SELECT .." The following pattern is displayed in stack trace:

Loading data to table testdb.test_table from hdfs://xyz/ra_hadoop/.hive-staging_hive_2017-01-31_14-09-52_561_8101886747064006778-4/-ext-10000 ERROR : Failed with exception java.util.ConcurrentModificationException org.apache.hadoop.hive.ql.metadata.HiveException: java.util.ConcurrentModificationException at org.apache.hadoop.hive.ql.metadata.Hive.moveFile( at org.apache.hadoop.hive.ql.metadata.Hive.replaceFiles( at org.apache.hadoop.hive.ql.metadata.Hive.loadTable( at org.apache.hadoop.hive.ql.exec.MoveTask.execute( at org.apache.hadoop.hive.ql.exec.Task.executeTask( at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential( at org.apache.hadoop.hive.ql.Driver.launchTask( at org.apache.hadoop.hive.ql.Driver.execute( at org.apache.hadoop.hive.ql.Driver.runInternal( at at


This issue occurs because of issue described in HIVE-15355.


  • Set the following property at the client side:


  • Re-run the hive query

Note: The fix for HIVE-15355 is expected to be included in the next major release of HDP.

0 Kudos
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.
Version history
Last update:
‎09-16-2022 01:39 AM
Updated by:
Top Kudoed Authors