Member since
02-17-2021
13
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2119 | 02-21-2021 09:43 PM |
03-30-2021
01:48 PM
Hi, Can someone please help me with this..!
... View more
03-24-2021
01:19 PM
what is the conf file has hive.exec.parallel property set ?
... View more
Labels:
- Labels:
-
Apache Hive
03-23-2021
12:10 PM
Hi All, I have created an external table pointing to HDFS location where data gets stored for everyday logs. Details: location: /user/data/year=2021/ partition: month and day hdfs dfs -ls /user/data/year=2021/ Found 5 items drwxr-xr-x - user user 0 2021-03-19 16:53 /user/data/year=2021/month=03/day=18 drwxr-xr-x - user user 0 2021-03-20 16:04 /user/data/year=2021/month=03/day=19 drwxr-xr-x - user user 0 2021-03-21 16:59 /user/data/year=2021/month=03/day=20 drwxr-xr-x - user user 0 2021-03-22 16:57 /user/data/year=2021/month=03/day=21 Is there a way where my external table partitions get updated automatically when new file gets added to hdfs path. Now, when I run manually, the table gets updated. hive>msck repair table <table_name> Please let me know if there is anyway to update the table automatically, when the location gets updated. Thank You!
... View more
Labels:
03-02-2021
01:21 AM
Thank you. I query run fine. select count (distinct id) from hive_table_tbs; output: 1092
... View more
03-01-2021
01:51 PM
HI, I am running a select distinct count on a column, am getting the below error. can you please help me. select distinct count (id) from hive_table_tbs; error message Error while compiling statement: FAILED: SemanticException [Error 10128]: line 1:16 Not yet supported place for UDAF 'count' Thank You
... View more
Labels:
- Labels:
-
Apache Hive
02-25-2021
05:41 AM
Hi, Can someone please help me. Thank you
... View more
02-25-2021
05:21 AM
@tusharkathpal okay got it thank you....! So, here I need to export data from hive/impala into RDBMS table. Can I export data into MySQL table which have already have some records, previously.. will the export delete the existing data in the MYSQL table? We are planning to export 1 year data from impala to MySQL table. Can you please help with suggestion. Thank You
... View more
02-24-2021
06:17 AM
I have two questions. To get data from Hive/Impala table into MySQL table 1. IF I have to connect to hive/Impala tables, from MySQL installed server, where there is no hadoop ecosystem set, is there a way to connect and import or export data from hive/Impala into MYSQL database through Sqoop.? 2. If there is a new server, with no connectors to MySQL and Hadoop. what are the requirement for the connection to setup if hive is on one server and MySQL is on another server. how to import data from hive to MYSQL? Please help me with these. Its urgent please. Thank you
... View more
Labels:
02-21-2021
09:43 PM
@GangWar Okay, got it. Thank you so much.
... View more
02-18-2021
01:51 PM
Hi, I have data coming into HDFS path everyday and that data need to loaded into hive tables. Here is my HDFS path: /user/hadoop/data/table/year=2021/month=02/day =11 /user/hadoop/data/table/year=2021/month=02/day =12 /user/hadoop/data/table/year=2021/month=02/day =13 I have hive tables created, here is the structure of my hive table create table hive_table ( ID string, timestamp bigint, NAME string) stored as Parquet ; Is there a way to load hive tables automatically once data get loaded into HDFS. Or do we need a hive script or something to load data. Please help me on loading data into hive tables. Thank You.
... View more
Labels:
- Labels:
-
Apache Hive
-
HDFS