nramanaiah
Expert Contributor

Re: Hive table need to be stored with a different ...

by New Contributor in Support Questions
‎10-26-2021 03:52 AM
‎10-26-2021 03:52 AM
I know this post was a long time ago, but does the script below add text qualifiers if a field contains one or more  '|'?   INSERT OVERWRITE DIRECTORY '/tmp/text-pipe' ROW FORMAT DELIMITED FIELDS TERMINATED BY '|' STORED AS TEXTFILE SELECT * FROM textcomma; Thanks!  ... View more

Re: Super slow when describing a Hive partitioned ...

by Expert Contributor Expert Contributor in Support Questions
‎01-29-2021 03:01 PM
‎01-29-2021 03:01 PM
I suspect the cause for "alter table" slowness is same as described here HIVE-23959 & HIVE-23806 might help your situation.     ... View more

Re: Hive CLI session warnings

by Expert Contributor Expert Contributor in Support Questions
‎06-24-2019 01:56 PM
1 Kudo
‎06-24-2019 01:56 PM
1 Kudo
This WARN logs should not cause any issue, 1) however if you want to remove this configs, you can use below syntax to delete the config on specific component config_type(Configs can be searched in ambari -> hive configs filter box to know which file to be updated) /var/lib/ambari-server/resources/scripts/configs.py -u <<username>> -p <<password>> -n <<clustername>> -l <<ambari-server-host>> -t <<ambari-server-port>> -a <<action>> -c <<config_type>> -k <<config-key>> eg., /var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.strict /var/lib/ambari-server/resources/scripts/configs.py -u admin -p <<dummy>> -n cluster1 -l ambari-server-host -t 8080 -a delete -c hive-site -k hive.mapred.supports.subdirectories This is the reference for configs.py https://cwiki.apache.org/confluence/display/AMBARI/Modify+configurations#Modifyconfigurations-Editconfigurationusingconfigs.py 2) To remove log4j warning, goto ambari -> hive configs -> advance hive-log4j, comment below line log4j.appender.DRFA.MaxFileSize After the above 2 changes, restart hive services, all those 3 warns should go away. If this article helps to resolve the issue, accept the answer, it might also help others members in the community. ... View more

Re: Error: java.io.IOException: java.lang.IllegalA...

by New Contributor in Support Questions
‎06-04-2019 12:34 PM
1 Kudo
‎06-04-2019 12:34 PM
1 Kudo
I faced the same issue after setting the following properties, it is working fine. set hive.mapred.mode=nonstrict; set hive.optimize.ppd=true; set hive.optimize.index.filter=true; set hive.tez.bucket.pruning=true; set hive.explain.user=false; set hive.fetch.task.conversion=none; set hive.support.concurrency=true; set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; ... View more

Re: Order by over subquery return wrong results

by Expert Contributor Expert Contributor in Support Questions
‎10-04-2018 05:24 PM
‎10-04-2018 05:24 PM
When applying order by twice, hive assumes column selection order is same on both inner & outer query which does order by on wrong column assuming wrong column datatype. You can rewrite your query having outer & inner query projection as same. SELECT t_6.color color, t_6.noq_empty noq_empty FROM (SELECT t_5.color_gbakc2 color, t_5.noq_empty_gbakc3 noq_empty FROM (SELECT testtable.color_gbakc2 color_gbakc2, testtable.noq_empty_gbakc3 noq_empty_gbakc3, testtable.color_gbakc1 color_gbakc1 FROM testtable testtable WHERE testtable.color_gbakc2 IN ('Red', 'Blue', 'Green') ) t_5 WHERE t_5.color_gbakc2 IN ('Red', 'Blue') ORDER BY noq_empty ASC ) t_6 ORDER BY color Fortunately HIVE-6348 is a plan optimizer & its eliminating this issue also. If my answer helped you, accept the answer. It will help others in the community. ... View more
Contact Me
Online
Offline
Last Visited
‎07-01-2022 03:16 PM
Public Statistics
Date Registered ‎08-18-2017 06:55 AM
Last Visited ‎07-01-2022 03:16 PM
Total Messages Posted 72
Total Kudos Received 11
; ;