Member since
10-31-2019
8
Posts
0
Kudos Received
0
Solutions
01-27-2021
10:23 PM
Env: HDP 3.1.5 Hive: hive_3_1_5_0_152 We have a hive table with 6k partitions, it is very normal when describing a single partition but super slow when describing the whole table, describing non-partitioned tables is normal. desc hive_desc_partition_tbl_01; -- cost 1k+ sec desc hive_desc_partition_tbl_02 partition(ns='NS1',slicetime=20200102); -- cost 3 sec alter table hive_desc_partition_tbl_01 change column id id string comment 'change'; -- cost 3600 sec
The DDL of the table: create TABLE `hive_desc_partition_tbl_01` ( `id` bigint, `b` string, `c` string, `d` string, `e` string, `ns_name` string) COMMENT 'compress test' PARTITIONED BY ( `ns` string, `slicetime` string)
Any ideas to optimize? Thanks in advance!
... View more
Labels:
11-14-2019
10:42 PM
@jsensharma It works after the change. Thanks a lot for your help!
... View more
11-11-2019
05:52 PM
AMBARI-25170 was closed as "not a problem", obviously the reporter hadn't tested with container change.
... View more
10-31-2019
11:17 PM
"Yarn Container" widget shows 0/0/0 when no containers are allocated,pending or reserved, but if any of the 3 metrics changed, the widget shows n/a, wonder if it is a bug or not?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache YARN