what is the conf file has hive.exec.parallel property set ?   ... View more

Hi All,   I have created an external table pointing to HDFS location where data gets stored for everyday logs. Details:   location: /user/data/year=2021/ partition: month and day   hdfs dfs -ls /user/data/year=2021/ Found 5 items drwxr-xr-x - user user 0 2021-03-19 16:53 /user/data/year=2021/month=03/day=18 drwxr-xr-x - user user 0 2021-03-20 16:04 /user/data/year=2021/month=03/day=19 drwxr-xr-x - user user 0 2021-03-21 16:59 /user/data/year=2021/month=03/day=20 drwxr-xr-x - user user 0 2021-03-22 16:57 /user/data/year=2021/month=03/day=21   Is there a way where my external table partitions get updated automatically when new file gets added to hdfs path.   Now, when I run manually, the table gets updated. hive>msck repair table <table_name>    Please let me know if there is anyway to update the table automatically, when the location gets updated.   Thank You! ... View more

I have two questions. To get data from Hive/Impala table into MySQL table 1. IF I have to connect to hive/Impala tables, from MySQL installed server, where there is no hadoop ecosystem set, is there a way to connect and import or export data from hive/Impala into MYSQL database through Sqoop.? 2. If there is a new server, with no connectors to MySQL and Hadoop. what are the requirement  for the connection to setup if hive is on one server and MySQL is on another server. how to import data from hive to MYSQL? Please help me with these. Its urgent please.  Thank you ... View more

Hi,   I have data coming into HDFS path everyday and that data need to loaded into hive tables. Here is my HDFS path: /user/hadoop/data/table/year=2021/month=02/day =11 /user/hadoop/data/table/year=2021/month=02/day =12 /user/hadoop/data/table/year=2021/month=02/day =13   I have hive tables created, here is the structure of my hive table create table hive_table ( ID string, timestamp bigint, NAME string) stored as Parquet ;    Is there a way to load hive tables automatically once data get loaded into HDFS. Or do we need a hive script or something to load data.   Please help me on loading data into hive tables.   Thank You. ... View more