Member since
11-11-2019
636
Posts
34
Kudos Received
27
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 966 | 10-09-2025 12:29 AM | |
| 8367 | 02-19-2025 09:43 PM | |
| 2439 | 02-28-2023 09:32 PM | |
| 5074 | 02-27-2023 03:33 AM | |
| 26757 | 12-24-2022 05:56 AM |
11-14-2022
03:44 AM
1 Kudo
@KPG1 I can think of Oracle database ha a feature i.e Oracle RAC,where we give SCAN address as the jdbc string to metastore,so the scan ip wll take care of loadbalancing. You need to check with mysql vendor(Oracle),if they have similar thing as of Oracle database. You can have HMS HA but all the HMS instance point to same database, you can not have 2 HMS instance pointing to a different database. Please let me know,if you have any querties and please "Accept As Solution", if your queries are answered
... View more
11-11-2022
03:18 AM
You can set tez.grouping.max-size to 1gb. Please increase below set hive.tez.container.size=10240; set tez.runtime.io.sort.mb=4096; (40% of container size)
... View more
11-11-2022
12:40 AM
1 Kudo
@octor You can tewk the split sizes if you are using Tez. set tez.grouping.min-size=16777216;--16 MB min split set tez.grouping.max-size=64000000;--64 GB max split
... View more
11-11-2022
12:40 AM
@pankshiv1809 were you able to fix? Please click "Accept as solution" if this has worked
... View more
11-10-2022
05:50 AM
1 Kudo
This seems to be more of Spark. But I see below error: java.io.FileNotFoundException: File does not exist: /warehouse/tablespace/external/hive/dim_cd_db.db/dim_subs_language_ivr/circle_id=14/part-00000-f53b4b78-8256-4040-9195-7af54c3365c8.c000.snappy.orc Can you please check,if the file is present: hdfs dfs -ls/warehouse/tablespace/external/hive/dim_cd_db.db/dim_subs_language_ivr/circle_id=14/part-00000-f53b4b78-8256-4040-9195-7af54c3365c8.c000.snappy.orc Please also perfrom and let us know msck repair table dim_subs_language_ivr Try to run the same in hive beeline and check if the issue persists.
... View more
11-10-2022
05:45 AM
@octor I see you have already raised https://issues.apache.org/jira/browse/HIVE-26720 May I know why do you want to change stripe size?
... View more
11-10-2022
05:20 AM
@pankshiv1809 I see you are getting Spark related error . Are you using Spark or Hive query ?
... View more
11-04-2022
12:59 AM
@chengxi Are you using CDP ? replicate the issue and provide /var/log/hive/ /var/run/cloudera-scm-agent/process/<hive that crashed>/logs
... View more
08-12-2022
02:24 AM
@mareb Can you please attach application logs for application_1657267798389_0085
... View more