Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Impala 2.8 vs 2.7 on CDH 5.10 upgrade

Solved Go to solution

Re: Need help with Impala 2.8 on CDH 5.10 upgrade

Explorer

Hi Lars , Tim

 

Coputing stats on specific partion works as it should in 5.10 and seesm to fix the problem .

 

5.10 with inc_stats_size_limit_bytes = 1073741824 ( 1GB)

 

[gc-test-impala28-02.c.bi-environment-1271.internal:21000] > COMPUTE INCREMENTAL STATS dwh.dwh_events partition (cluster_id=11,day=20170401);
Query: compute INCREMENTAL STATS dwh.dwh_events partition (cluster_id=11,day=20170401)
+-------------------------------------------+
| summary                                   |
+-------------------------------------------+
| Updated 1 partition(s) and 382 column(s). |
+-------------------------------------------+
Fetched 1 row(s) in 2.23s

 

 

5.9

-------

 

[gc-dp-pdpprd-data-04.c.bi-environment-1271.internal:21000] > COMPUTE INCREMENTAL STATS test_partitions.dwh_events partition (cluster_id=11,day=20170401);
Query: compute INCREMENTAL STATS test_partitions.dwh_events partition (cluster_id=11,day=20170401)
ERROR: AnalysisException: Incremental stats size estimate exceeds 200.00MB. Please try COMPUTE STATS instead.

 

Many Thanks :-)

 

Alon

Highlighted

Re: Need help with Impala 2.8 on CDH 5.10 upgrade

Expert Contributor
Yeap, you're right

Re: Need help with Impala 2.8 on CDH 5.10 upgrade

Expert Contributor

Thank you for catching this Tim!

 

The "SORTBY()" hint was added in IMPALA-4163, which was not included in Impala 2.8.0. It is currently being reworked into a SQL clause (IMPALA-4166), so I cannot make promises as to which release will contain this feature. My apologies for the confusion. I will make sure the documentation gets updated.

Don't have an account?
Coming from Hortonworks? Activate your account here