Support Questions
Find answers, ask questions, and share your expertise

Apache hive: Load partitioned data into hive

Explorer

Hi,

I have the output of pig that is partitioned based on date and customer segment(2 level of segments). I wanted to load data into hive for a particular date. In load command if I point the INPATH location to date, I get error as "source contains directory". Could you suggest how to load the data from a partition directory. I also tried creating an external table with the LOCATION as partition folder. The table was created but there were no data. I wanted to do a LOAD since I wanted to remove the header and footer while loading.

2 REPLIES 2

Re: Apache hive: Load partitioned data into hive

Explorer

I tried setting the below parameters:

SET mapred.input.dir.recursive=true; SET hive.mapred.supports.subdirectories=true; but didn't help. Is there a way to load the partitioned data.

Re: Apache hive: Load partitioned data into hive

Explorer

It is working fine now. Thanks. Have to use /* to point to sub-directory