Where can I find sizing guidelines for Spark? (HDP 2.4 or 2.5)

[#1]

Hello. We are trying to dimension an HDP 2.4 architecture with Spark. We could not find specific HDP documentation about Spark nodes sizing. I would greatly appreciate you help with references or guidelines.

[#2 · Accepted solution]

@Fernando Lopez Bello

Check out this article:

https://community.hortonworks.com/questions/5535/spark-deployment-and-hardware-provisioning.html

This article for Spark 2.0 but it is also relevant for previous versions:

http://spark.apache.org/docs/latest/hardware-provisioning.html