Support Questions

Find answers, ask questions, and share your expertise

Apache Spark on YARN - Hardening of an Apache Cluster Running on YARN

avatar
Contributor

Hello -

I am new to Apache Spark.  I have installed a 5 node Apache Spark cluster running on YARN on AWS.

I am seeking any "prescriptive" vs descriptive information on how to security harden the cluster.

I have reviewed the Apache Spark security website, and scoured the internet for detailed, prescriptive information/approaches for security hardening this type of cluster and have not be been able to find information provided by folks with direct, hands on experience.

 

I have also searched for online courses that focus on implementing security with the Spark on YARN cluster and came up short.

 

Does anyone have any suggested references that provide/describe how to's, detailed information on hardening procedures for this type of cluster.

Any suggested references would be tremendously appreciated!

 

VR,

 

Dave

1 REPLY 1

avatar
Contributor

Any Apache Spark experts out there that have experience security hardening Spark on YARN?