Reply
Explorer
Posts: 11
Registered: ‎05-04-2016

Hive Query Issue after CDH Upgrade

Hi All,

 

We upgraded our CDH version from 5.9 to 5.12.2 one of the hive query which is running fine was taking more time now. 

 

Hive query - Select count(*) from table 

 

in CDH 5.9 - results in less than 1 min

in CDH 5.12.2 - restults in 13 min

 

what may be the cause.

 

I check JVM thread for hive metastore and hive server2 which is normal like 40 threads

 

 

Please do the needful.

 

Regards

Krishnan

Explorer
Posts: 8
Registered: ‎03-25-2016

Re: Hive Query Issue after CDH Upgrade

Hi Krishnan,

 

Did you get any responses on this one?

We are having similar issues after upgrading to CDH 5.12

 

Thanks

Vinay

Champion
Posts: 744
Registered: ‎05-16-2016

Re: Hive Query Issue after CDH Upgrade

[ Edited ]

is your table stats being collected ? 

what file format ? 

is there any compression

is your table  partioned or buckted ? ? 

how many connections were made to HS2? 

do you have multiple instance of HS2 in your enviroment ? 

Explorer
Posts: 8
Registered: ‎03-25-2016

Re: Hive Query Issue after CDH Upgrade

Here are the answers, but as a pointer, absolutely nothing changed from the app / user side during upgrade.

We upgraded and boom! Performance was busted. Cloudera is working on the case for about 3 weeks now. We are still waiting for a resolution.

 

is your table stats being collected ? 

Yes

what file format ? 

Parquet

is there any compression

Snappy

is your table  partioned or buckted ? ? 

Yes (By org and date (week-year)

how many connections were made to HS2? 

Unsure

do you have multiple instance of HS2 in your enviroment ? 

No

Contributor
Posts: 51
Registered: ‎11-03-2016

Re: Hive Query Issue after CDH Upgrade

hi

Sorry for the off track question. But how did you manage the upgrade from 5.9 to 5.12, as I am not getting update after upgrading the cluster from 5.9 to 5.10.2
Highlighted
Explorer
Posts: 11
Registered: ‎05-04-2016

Re: Hive Query Issue after CDH Upgrade

Hi 

 

To get more visibility in this issue, Please let me know what steps you followed to upgrade your cluster in detail.

Announcements