Reply
Highlighted
Explorer
Posts: 23
Registered: ‎08-15-2016

Errors while running alter table and compute stats on tables with large number of partitions.

We are running Impala v2.7.0-cdh5.10.1 (876895d), and are facing similar issue.

 

While running alter table <table-name> recover partitions; - we get "Error communicating with impalad: TSocket read 0 bytes" error message. after multiple attempts to recover this table, we were finally able to recover partitions on the table.

 

At which point, we ran "compute stats <table-name>;" and received this error message: CatalogException: Table was modified during stats computation.

 

 

Although both these errors may be mutually exclusive, somehow they seems to only happen on the two tables with over 10,000 partition files.

 

Announcements