Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

In some orc tables in Hive we get duplicate partition "base" directory inside /table_name/partition_date=/base/

Contributor

Hi All,

Periodically, in some ORC tables in Hive we get duplicate partition "base" directory inside /table_name/partition_date=/base/ meaning: all contents of /table_name/partition_date=/base/* are in /table_name/partition_date=/base/base/*. After that partition become bad and from this bad partition we can’t do select count(*) or any other selects because of error occurring.

But when we dropping duplicate “base” directory problem goes away.

Why we got this duplicate folder in our buckets?

2 REPLIES 2

Expert Contributor

Could you give the exact table DDL and "ls -R" directory listing of the partition?

Contributor

This event occurs only if we are using NiFi Hive Streaming.

ls -R will later.