Is there a data encryption option for Spark Thrift Server

[#1]

Is there any data encryption option for Spark Thrift Server ?

[#2 · Accepted solution]

Per Known issues, bug BUG-39674 - Spark does not yet support wire encryption, dynamic executor allocation, SparkR, GraphX, Spark Streaming, iPython, or Zeppelin. link here. also similar question was asked here.

[#3]

@also take a look here about spark security.

SASL encryption is currently supported for the block transfer service when authentication (spark.authenticate) is enabled. To enable SASL encryption for an application, set spark.authenticate.enableSaslEncryption to true in the application’s configuration.

When using an external shuffle service, it’s possible to disable unencrypted connections by setting spark.network.sasl.serverAlwaysEncrypt totrue in the shuffle service’s configuration. If that option is enabled, applications that are not set up to use SASL encryption will fail to connect to the shuffle service.