question Re: Where can I find sizing guidelines for Spark? (HDP 2.4 or 2.5) in Archives of Support Questions (Read Only)

Where can I find sizing guidelines for Spark? (HDP 2.4 or 2.5)

fernando_lopez — Tue, 01 Nov 2016 23:13:17 GMT

Hello. We are trying to dimension an HDP 2.4 architecture with Spark. We could not find specific HDP documentation about Spark nodes sizing. I would greatly appreciate you help with references or guidelines.

Re: Where can I find sizing guidelines for Spark? (HDP 2.4 or 2.5)

Carolyn — Tue, 01 Nov 2016 23:19:06 GMT

@Fernando Lopez Bello

Check out this article:

https://community.hortonworks.com/questions/5535/spark-deployment-and-hardware-provisioning.html

This article for Spark 2.0 but it is also relevant for previous versions:

http://spark.apache.org/docs/latest/hardware-provisioning.html