Support Questions
Find answers, ask questions, and share your expertise

Impala 2.8 vs 2.7 on CDH 5.10 upgrade

Solved Go to solution

Re: Need help with Impala 2.8 on CDH 5.10 upgrade

Explorer

Hi Lars , Tim

 

Coputing stats on specific partion works as it should in 5.10 and seesm to fix the problem .

 

5.10 with inc_stats_size_limit_bytes = 1073741824 ( 1GB)

 

[gc-test-impala28-02.c.bi-environment-1271.internal:21000] > COMPUTE INCREMENTAL STATS dwh.dwh_events partition (cluster_id=11,day=20170401);
Query: compute INCREMENTAL STATS dwh.dwh_events partition (cluster_id=11,day=20170401)
+-------------------------------------------+
| summary                                   |
+-------------------------------------------+
| Updated 1 partition(s) and 382 column(s). |
+-------------------------------------------+
Fetched 1 row(s) in 2.23s

 

 

5.9

-------

 

[gc-dp-pdpprd-data-04.c.bi-environment-1271.internal:21000] > COMPUTE INCREMENTAL STATS test_partitions.dwh_events partition (cluster_id=11,day=20170401);
Query: compute INCREMENTAL STATS test_partitions.dwh_events partition (cluster_id=11,day=20170401)
ERROR: AnalysisException: Incremental stats size estimate exceeds 200.00MB. Please try COMPUTE STATS instead.

 

Many Thanks :-)

 

Alon

Re: Need help with Impala 2.8 on CDH 5.10 upgrade

Expert Contributor
Yeap, you're right

Re: Need help with Impala 2.8 on CDH 5.10 upgrade

Expert Contributor

Thank you for catching this Tim!

 

The "SORTBY()" hint was added in IMPALA-4163, which was not included in Impala 2.8.0. It is currently being reworked into a SQL clause (IMPALA-4166), so I cannot make promises as to which release will contain this feature. My apologies for the confusion. I will make sure the documentation gets updated.