Member since
12-31-2015
1
Post
0
Kudos Received
0
Solutions
03-17-2016
03:29 AM
Hi, I'm trying to read data that's exported into Parquet partitions via an external table. ex: a partition of the data would be in /user/root/parquet/TIMESLOT=201603162200 I can create an external table on the data IN EACH partition (using CREATE EXTERNAL TABLE xxx LIKE PARQUET syntax). ex: CREATE EXTERNAL TABLE ingest_parquet_201505141200 LIKE PARQUET '/user/root/parquet/TIMESLOT=201505141200/part-r-00000-db2fb64b-0bb1-4fbe-a851-e71ad13f10a6.gz.parquet' LOCATION '/user/root/parquet/TIMESLOT=201505141200'; But I need to see ALL of the partitions. That means that I can't use "LIKE PARQUET" syntax anymore (because the partition key -i.e. TIMESLOT would be missing from the table in that case), and more importantly I need to change the LOCATION clause, but when I use the " location '/user/root/parquet/' " querying the external table returns no rows! Is there a way to address the issue? Regards, Babak.
... View more