Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

how to load dynamic hdfs path data into hive table?

Explorer

Hi,

 

I have data coming into HDFS path everyday and that data need to loaded into hive tables.

Here is my HDFS path:

/user/hadoop/data/table/year=2021/month=02/day =11

/user/hadoop/data/table/year=2021/month=02/day =12

/user/hadoop/data/table/year=2021/month=02/day =13

 

I have hive tables created, here is the structure of my hive table

create table hive_table ( ID string,
timestamp bigint,
NAME string) stored as Parquet ; 

 

Is there a way to load hive tables automatically once data get loaded into HDFS. Or do we need a hive script or something to load data.

 

Please help me on loading data into hive tables.

 

Thank You.

1 REPLY 1

Explorer

Hi, 

Can someone please help me.

 

Thank you

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.