Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Can we get better performance for hive queries by using SSD?

Solved Go to solution
Highlighted

Can we get better performance for hive queries by using SSD?

New Contributor

One of my client is using Azure based IaaS for their HDP cluster. They are open to using more expensive storage to get better performance.

Is it recommended to use SSD for some of the data in hive tables, to get that boost in performance? Also what are the steps to make your temporary storage to point to SSD, that is used by Tez/MR jobs?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Can we get better performance for hive queries by using SSD?

2 REPLIES 2

Re: Can we get better performance for hive queries by using SSD?

I understood that yarn.nodemanager.local-dirs would be the setting to point to SSD to get better performance on shuffle and other temporary usage. I also would like to confirm it.

Re: Can we get better performance for hive queries by using SSD?

Don't have an account?
Coming from Hortonworks? Activate your account here