Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

MySQL on AWS RDS MySQL slowing hive queries ?

Highlighted

MySQL on AWS RDS MySQL slowing hive queries ?

Rising Star

Hi guys

 

I have a 3 node development cluster CDH 5.6.0 (managed by cloudera manager). This time I configured MySQL in AWS RDS as the Hive Metastore.

 

1NN + 1 DN

1 DN

1 DN

each node is 32GB RAM and 2X2TB 7200 rpm disks 

 

Like always I have tuned the memory params in yarn. A simple SELECT query on 1 Hive tablewith 22 million records  with one WHERE clause takes 15 minutes !

 

 

 

Can it be that the AWS RDS Hive Metastore is slowing the Hive query down ?

 

thanks

 

sanjay

 

1 REPLY 1

Re: MySQL on AWS RDS MySQL slowing hive queries ?

Rising Star

As a comparison I wrote Java MR code that does exactly what the query does and that ran in 1m 30s ! So something does not seem all right with Hive 

 

Don't have an account?
Coming from Hortonworks? Activate your account here