Member since
08-09-2018
4
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2580 | 03-24-2023 10:05 AM |
03-24-2023
10:12 AM
@DianaTorres I was able to received the reply to my question through Cloudera Support - see also my comment above. Should I mark my reply above as Solution?
... View more
03-24-2023
10:05 AM
Thanks for the offer and sorry for the late reply. We use CDP 7.4. In the meantime I have been able to also receive an answer from Cloudera support and they have confirmed that in our scenario we do not need to run the DROP INCREMENTAL STATS command. I do not think that additional tests are required.
... View more
03-14-2023
10:06 AM
Hello, this is not answering my question. I'd like to know why I must run the DROP INCREMENTAL STATS in my scenario. I have run a small test: - created a partitioned table - run COMPUTE INCREMENTAL STATS - run SHOW TABLE STATS and saved the result - added one row to one partition - run COMPUTE INCREMENTAL STATS PARTITION (<partitioning key of the partition to which the row was added) - run SHOW TABLE STATS and compare to the previous run Result of the comparison: the stats of the partition to which I have added one row were updated and reflecting the number of rows in the partition / number of files. Based on my tests it looks like the stats are updated, hence my question.
... View more
03-14-2023
06:01 AM
Dear all, I want to run COMPUTE INCREMENTAL STATS with PARTITION option on some partitions of a partitioned table. It is unclear to me from the documentation if DROP INCREMENTAL STATS must be run on those partitions. For my understanding of how INCREMENTAL STATS with the PARTITION option work, it should not be required, but I've found below sentence on this page https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/impala_perf_stats.html#perf_stats "In cases where new files are added to an existing partition, issue a REFRESH statement for the table, followed by a DROP INCREMENTAL STATS and COMPUTE INCREMENTAL STATS sequence for the changed partition.". I'd prefer to avoid running DROP INCREMENTAL STATS if not required. Does anyone know? Many thanks in advance.
... View more
Labels:
- Labels:
-
Cloudera Data Platform (CDP)