Support Questions

Find answers, ask questions, and share your expertise
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Fix long running jobs in hadoop


1.What are the ways to fix the long running jobs in hadoop, any of the jobs (hive/mapr/pig)?

2. A job took 5 mins for a week, but now its taking more than hour. What could be the reason ?


Expert Contributor

Best place to start will be to check YARN tuning:

There can be number of reasons why your jobs might be running slow like what is the current load on cluster, how is capacity scheduling set up like priority, queues, resources etc.

You can check Hive execution plan to see bottlenecks.

Hi Umair,
Will it be possible to share how to tune the performace in mapper/hive jobs?
Can you please share your experience in the performance tuning?
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.