Created 02-23-2018 08:53 PM
Hi All,
We upgraded our CDH version from 5.9 to 5.12.2 one of the hive query which is running fine was taking more time now.
Hive query - Select count(*) from table
in CDH 5.9 - results in less than 1 min
in CDH 5.12.2 - restults in 13 min
what may be the cause.
I check JVM thread for hive metastore and hive server2 which is normal like 40 threads
Please do the needful.
Regards
Krishnan
Created 03-06-2018 12:02 PM
Hi Krishnan,
Did you get any responses on this one?
We are having similar issues after upgrading to CDH 5.12
Thanks
Vinay
Created on 03-24-2018 08:50 PM - edited 03-24-2018 08:53 PM
is your table stats being collected ?
what file format ?
is there any compression
is your table partioned or buckted ? ?
how many connections were made to HS2?
do you have multiple instance of HS2 in your enviroment ?
Created 03-27-2018 08:58 AM
Here are the answers, but as a pointer, absolutely nothing changed from the app / user side during upgrade.
We upgraded and boom! Performance was busted. Cloudera is working on the case for about 3 weeks now. We are still waiting for a resolution.
is your table stats being collected ?
Yes
what file format ?
Parquet
is there any compression
Snappy
is your table partioned or buckted ? ?
Yes (By org and date (week-year)
how many connections were made to HS2?
Unsure
do you have multiple instance of HS2 in your enviroment ?
No
Created 04-10-2018 09:28 AM
Created 04-16-2018 04:21 AM
Hi
To get more visibility in this issue, Please let me know what steps you followed to upgrade your cluster in detail.