Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

how to load dynamic hdfs path data into hive table?

avatar
Explorer

Hi,

 

I have data coming into HDFS path everyday and that data need to loaded into hive tables.

Here is my HDFS path:

/user/hadoop/data/table/year=2021/month=02/day =11

/user/hadoop/data/table/year=2021/month=02/day =12

/user/hadoop/data/table/year=2021/month=02/day =13

 

I have hive tables created, here is the structure of my hive table

create table hive_table ( ID string,
timestamp bigint,
NAME string) stored as Parquet ; 

 

Is there a way to load hive tables automatically once data get loaded into HDFS. Or do we need a hive script or something to load data.

 

Please help me on loading data into hive tables.

 

Thank You.

1 REPLY 1

avatar
Explorer

Hi, 

Can someone please help me.

 

Thank you