Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Is there a data encryption option for Spark Thrift Server

avatar
Expert Contributor

Is there any data encryption option for Spark Thrift Server ?

1 ACCEPTED SOLUTION

avatar
Master Guru

Per Known issues, bug BUG-39674 - Spark does not yet support wire encryption, dynamic executor allocation, SparkR, GraphX, Spark Streaming, iPython, or Zeppelin. link here. also similar question was asked here.

View solution in original post

2 REPLIES 2

avatar
Master Guru

Per Known issues, bug BUG-39674 - Spark does not yet support wire encryption, dynamic executor allocation, SparkR, GraphX, Spark Streaming, iPython, or Zeppelin. link here. also similar question was asked here.

avatar
Master Guru

@also take a look here about spark security.

SASL encryption is currently supported for the block transfer service when authentication (spark.authenticate) is enabled. To enable SASL encryption for an application, set spark.authenticate.enableSaslEncryption to true in the application’s configuration.

When using an external shuffle service, it’s possible to disable unencrypted connections by setting spark.network.sasl.serverAlwaysEncrypt totrue in the shuffle service’s configuration. If that option is enabled, applications that are not set up to use SASL encryption will fail to connect to the shuffle service.