Gold ⭐️

Hive MSCK repair

Issue:

Trying to run "msck repair table <tablename>" gives the below error

Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null

Resolution:

The above error occurs when hive.mv.files.thread=0, increasing the value of the parameter to 15 fixes the issue

This is a known bug

Gold ⭐️

Would you mind adding Apache Jira link?

Translate

Silver ⭐️⭐️

That bug link won't work unless one is a HW employee or contractor.

The real issues linked to this internal BUG are the following Apache issues:

Hope that helps!

Translate

Platinum ⭐️⭐️

Workaround if you have spark-sql: spark-sql -e "msck repair table <tablename>".

it works for me all the time.

hope this helps!

Translate

Silver ⭐️

Using the console this worked:

user@sandbox:~$ hive --hiveconf hive.msck.path.validation=ignore hive> use mydatabase; hive> msck repair table mytable;

Translate

Sign up