Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Apache Spark Job Is slow and wanted to Make It Apache Spark Jobs Run Faster

avatar
Contributor

Team,

 

My current Apache spark jobs are executing very slow, could you please help me to make it Run Faster.

 

Looking for thumb rule to make spark job it RUN FASTER.

 

Thanks in advance for your kind support always.

 

1 ACCEPTED SOLUTION

avatar
Master Collaborator

Hi @pankshiv1809 

 

To run application faster, we need to tune the resources, spark code and cluster. To solve any kind of performance issues, you need to go through the Spark UI and understand jobs, stages and executors. After that you need to tune the resources like driver and executor memory and no of executors and separate queue to process the data. 

 

If you want to know other techniques raise the Cloudera case, we will help to further. 

View solution in original post

1 REPLY 1

avatar
Master Collaborator

Hi @pankshiv1809 

 

To run application faster, we need to tune the resources, spark code and cluster. To solve any kind of performance issues, you need to go through the Spark UI and understand jobs, stages and executors. After that you need to tune the resources like driver and executor memory and no of executors and separate queue to process the data. 

 

If you want to know other techniques raise the Cloudera case, we will help to further.