Support Questions
Find answers, ask questions, and share your expertise

In some orc tables in Hive we get duplicate partition "base" directory inside /table_name/partition_date=/base/

Contributor

Hi All,

Periodically, in some ORC tables in Hive we get duplicate partition "base" directory inside /table_name/partition_date=/base/ meaning: all contents of /table_name/partition_date=/base/* are in /table_name/partition_date=/base/base/*. After that partition become bad and from this bad partition we can’t do select count(*) or any other selects because of error occurring.

But when we dropping duplicate “base” directory problem goes away.

Why we got this duplicate folder in our buckets?

2 REPLIES 2

Expert Contributor

Could you give the exact table DDL and "ls -R" directory listing of the partition?

Contributor

This event occurs only if we are using NiFi Hive Streaming.

ls -R will later.