- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Apache Spark Job Is slow and wanted to Make It Apache Spark Jobs Run Faster
- Labels:
-
Apache Spark
Created 01-31-2023 12:26 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Team,
My current Apache spark jobs are executing very slow, could you please help me to make it Run Faster.
Looking for thumb rule to make spark job it RUN FASTER.
Thanks in advance for your kind support always.
Created 03-30-2023 04:35 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
To run application faster, we need to tune the resources, spark code and cluster. To solve any kind of performance issues, you need to go through the Spark UI and understand jobs, stages and executors. After that you need to tune the resources like driver and executor memory and no of executors and separate queue to process the data.
If you want to know other techniques raise the Cloudera case, we will help to further.
Created 03-30-2023 04:35 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
To run application faster, we need to tune the resources, spark code and cluster. To solve any kind of performance issues, you need to go through the Spark UI and understand jobs, stages and executors. After that you need to tune the resources like driver and executor memory and no of executors and separate queue to process the data.
If you want to know other techniques raise the Cloudera case, we will help to further.
