Reply
Explorer
Posts: 6
Registered: ‎08-19-2016

Hive Query running super slow in 5.7.2-1.cdh5.7.2.p0.18

Hive Query running super slow in 5.7.2-1.cdh5.7.2.p0.18.

 

Its takes more than 4 hours to complete.

 

Cloudera Employee
Posts: 34
Registered: ‎08-16-2016

Re: Hive Query running super slow in 5.7.2-1.cdh5.7.2.p0.18

For comparision, can you post what it took on other releases that you may have tried? Also, would you be able to post the full query, if its ok to publish it to a public forum.

Highlighted
Cloudera Employee
Posts: 824
Registered: ‎03-23-2015

Re: Hive Query running super slow in 5.7.2-1.cdh5.7.2.p0.18

Does the query have JOIN operator over partitioned data? If yes, I suggest you run EXPLAIN EXTENDED on the query to check if you can see the query will scan more than intended partitions.

 

There is a known issue in 5.7.x that partition pruning is not working correctly under certain JOIN conditions.