Member since
11-02-2017
51
Posts
6
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1066 | 09-22-2022 04:16 AM | |
3436 | 03-09-2018 02:34 PM | |
15690 | 02-01-2018 06:15 AM | |
5628 | 11-13-2017 12:34 PM |
09-22-2022
04:16 AM
@yagoaparecidoti It looks like this particular user does not have permission to connect to HMS. You can add this user or put "*" under this configuration : CM->Hive->Configuration->Search "hive_proxy_user_groups_list" And then restart hive and then run "show databases" . Another possibility could be that it is not able to locate hive-site.xml on the node required to connect to Hive Metastore.
... View more
03-19-2018
05:39 PM
@Ashish Wadnerkar You can grep hiveserver2.log with "Parsing command" string and you will get complete hive query.
... View more
03-17-2018
03:31 PM
@Sooraj Antony As you have scenarios for skew data in the joining column, enable skew join optimization. set hive.optimize.skewjoin=true set hive.skewjoin.key=5000 you can tune it further with number of mapper tasks and split size by hive.skewjoin.mapjoin.map.tasks and hive.skewjoin.mapjoin.min.split properties.
... View more
03-12-2018
04:35 PM
@srini You can import xml directly using com.ibm.spss.hive.serde2.xml.XmlSerDe which is detailed here: https://community.hortonworks.com/articles/972/hive-and-xml-pasring.html Other option is to load entire record in a string and then access it using xpath UDF : 1. create table employee( employee_info string) ; 2. load data local inpath '/home/hduser/sample.xml' into table employee; 3. create view employee_xml_view as SELECT xpath_int(employee_info ,'code/root/root1/id'),xpath_string(employee_info ,'code/root/root1/joiningdate'),xpath_string(employee_info ,'code/root/root1/joiningdate').................. from employee; 4. Select * from employee_xml_view;
... View more
03-09-2018
02:34 PM
@Santanu Ghosh During Sqoop export, Staging table should be identical in structure to the destination table. I see in your tables datatype of third column is different. Can you update and then try.
... View more
03-08-2018
03:11 PM
Did you find any details in logs ?
... View more
03-08-2018
01:12 PM
@Satish Anjaneyappa You would get more details in hive logs, suggesting why the move operation failed.
... View more
03-08-2018
01:00 PM
@Satish Anjaneyappa This error occurs when map-reduce/ tez job is completed and then data is moved from staging directory to the destination directory. Error while moving could occur due to permission issues or if there is space issue in case of huge table. Can you check the permissions or if you have space quota set at the directory level.
... View more
03-08-2018
03:49 AM
@Dmitro Vasilenko Can you try this query without map join . Looks like data size is huge for hybrid grace hash join. set hive.auto.convert.join=false; And then execute this query.
... View more
03-07-2018
02:19 PM
@Dmitro Vasilenko I see frequent full GC in logs. Can you share yarn application log and the query that you executed? Also, share explain plan for the query.
... View more