About MikeA

MikeA · ‎10-27-2015

Thanks for the response, and yes, is looks like that's the issue - going over our logs it sems that this only occurs when we have multiple impalads targeting different partitions in the same table. Incidentally, I think we've seen this with as few as two concurrent operations, but in this case the two operations are likely to both start and complete at almost exactly the same times, so I guess there may be some race condition when updating the partition metadata?

MikeA · ‎10-27-2015

Hi there, We're seeing an intermittent issue with some of our Impala queries, where a compute incremental stats statement will fail with an "AnalysisException: Partition spec does not exist:" error, immediately after we have created the partition in the same script. So, a (faked) example would look like: ALTER TABLE db.table_name DROP IF EXISTS PARTITION (partition_column = 1234); INSERT INTO TABLE db.table_name PARTITION ( partition_column = 1234 ) SELECT column1 , column2 , ... FROM db.another_table ; COMPUTE INCREMENTAL STATS db.table_name (partition_column = 1234); AnalysisException: Partition spec does not exist: (partition_column = 1234). The tables in question are not being modifed by any external processes so we're not sure what could be happening here - has anyone else encountered this issue? Thanks, Mike

Online	Offline
Last Visited	‎08-15-2016 05:48 AM

Member Since	‎10-27-2015 03:38 AM
Last Visited	‎08-15-2016 05:48 AM
Posts	2

Cloudera Community

Re: Partition Spec Does Not Exist error

Partition Spec Does Not Exist error