Support Questions

Find answers, ask questions, and share your expertise

how to load dynamic hdfs path data into hive table?

avatar
Explorer

Hi,

 

I have data coming into HDFS path everyday and that data need to loaded into hive tables.

Here is my HDFS path:

/user/hadoop/data/table/year=2021/month=02/day =11

/user/hadoop/data/table/year=2021/month=02/day =12

/user/hadoop/data/table/year=2021/month=02/day =13

 

I have hive tables created, here is the structure of my hive table

create table hive_table ( ID string,
timestamp bigint,
NAME string) stored as Parquet ; 

 

Is there a way to load hive tables automatically once data get loaded into HDFS. Or do we need a hive script or something to load data.

 

Please help me on loading data into hive tables.

 

Thank You.

1 REPLY 1

avatar
Explorer

Hi, 

Can someone please help me.

 

Thank you