Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 10-20-2015 11:49 AM
One of my client is using Azure based IaaS for their HDP cluster. They are open to using more expensive storage to get better performance.
Is it recommended to use SSD for some of the data in hive tables, to get that boost in performance? Also what are the steps to make your temporary storage to point to SSD, that is used by Tez/MR jobs?
Created 10-21-2015 10:29 AM
This thread has all the details needed:
Created 10-20-2015 03:13 PM
I understood that yarn.nodemanager.local-dirs would be the setting to point to SSD to get better performance on shuffle and other temporary usage. I also would like to confirm it.
Created 10-21-2015 10:29 AM
This thread has all the details needed: