Member since
05-24-2023
2
Posts
0
Kudos Received
0
Solutions
05-29-2023
11:28 PM
thanks for the information, we're running on yarn so I guess the steps mentioned in https://spark.apache.org/docs/3.0.0-preview2/running-on-yarn.html#configuring-the-external-shuffle-service must be executed to configure the external shuffle service on each worker node. Are there any plans to support any other external shuffle service like uber rss or apache uniffle in the future?
... View more
05-24-2023
02:27 AM
Hi, does anyone knows whether there are any restrictions on using external shuffle services on CDP? For instance, are the following external shuffle services supported?: - uber rss - apache uniffle
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache YARN