Challenging issues solved on spark

[#1]

Hello All, 

Can anyone provide me the most challenging real time issues solved on Spark, YARN and Hive ? 

@RangaReddy 

[#2]

Tuning Spark jobs to minimize execution time and resource usage. Handling out-of-memory errors and optimizing memory allocation. Addressing issues where a disproportionate amount of work is done by a small number of tasks. Ensuring Spark applications can recover gracefully from worker failures. Efficiently distributing resources among various applications running in a cluster. Managing the lifecycle of containers that execute application tasks. 

[#3]

Thank you