Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Apache hive: Load partitioned data into hive

Apache hive: Load partitioned data into hive

New Contributor

Hi,

I have the output of pig that is partitioned based on date and customer segment(2 level of segments). I wanted to load data into hive for a particular date. In load command if I point the INPATH location to date, I get error as "source contains directory". Could you suggest how to load the data from a partition directory. I also tried creating an external table with the LOCATION as partition folder. The table was created but there were no data. I wanted to do a LOAD since I wanted to remove the header and footer while loading.

2 REPLIES 2

Re: Apache hive: Load partitioned data into hive

New Contributor

I tried setting the below parameters:

SET mapred.input.dir.recursive=true; SET hive.mapred.supports.subdirectories=true; but didn't help. Is there a way to load the partitioned data.

Re: Apache hive: Load partitioned data into hive

New Contributor

It is working fine now. Thanks. Have to use /* to point to sub-directory