Hive Query Issue after CDH Upgrade

[#1]

Hi All,

We upgraded our CDH version from 5.9 to 5.12.2 one of the hive query which is running fine was taking more time now. 

Hive query - Select count(*) from table 

in CDH 5.9 - results in less than 1 min

in CDH 5.12.2 - restults in 13 min

what may be the cause.

I check JVM thread for hive metastore and hive server2 which is normal like 40 threads

Please do the needful.

Regards

Krishnan

[#2]

Hi Krishnan,

Did you get any responses on this one?

We are having similar issues after upgrading to CDH 5.12

Thanks

Vinay

[#3]

is your table stats being collected ? 

what file format ? 

is there any compression

is your table  partioned or buckted ? ? 

how many connections were made to HS2? 

do you have multiple instance of HS2 in your enviroment ? 

[#4]

Here are the answers, but as a pointer, absolutely nothing changed from the app / user side during upgrade.

We upgraded and boom! Performance was busted. Cloudera is working on the case for about 3 weeks now. We are still waiting for a resolution.

is your table stats being collected ? 

Yes

what file format ? 

Parquet

is there any compression

Snappy

is your table  partioned or buckted ? ? 

Yes (By org and date (week-year)

how many connections were made to HS2? 

Unsure

do you have multiple instance of HS2 in your enviroment ? 

No

[#5]

hi

Sorry for the off track question. But how did you manage the upgrade from 5.9 to 5.12, as I am not getting update after upgrading the cluster from 5.9 to 5.10.2

[#6]

Hi 

To get more visibility in this issue, Please let me know what steps you followed to upgrade your cluster in detail.