Fix long running jobs in hadoop

[#1]

1.What are the ways to fix the long running jobs in hadoop, any of the jobs (hive/mapr/pig)?

2. A job took 5 mins for a week, but now its taking more than hour. What could be the reason ?

[#2]

Best place to start will be to check YARN tuning:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_command-line-installation/content/determ...

There can be number of reasons why your jobs might be running slow like what is the current load on cluster, how is capacity scheduling set up like priority, queues, resources etc.

You can check Hive execution plan to see bottlenecks.

[#3]

Hi Umair,

Will it be possible to share how to tune the performace in mapper/hive jobs?

Can you please share your experience in the performance tuning?