- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Pig job keeps running without progress
- Labels:
-
Apache Pig
Created on ‎02-23-2016 11:52 AM - edited ‎08-18-2019 05:38 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I'm running Hortonworks version 2.3.2 on VirtualBox, just following dadoop tutorial: how to process data with apache pig (http://zh.hortonworks.com/hadoop-tutorial/how-to-process-data-with-apache-pig/).
Have uploaded batter.csv file to the exact location as per the instruction, and just executed the simplest load Pig statement: batting = LOAD 'Batting.csv' USING PigStorage(',');
The job starts running, but never proceeds. Tried to kill the job, cannot either.
Could anyone please give me some hint of the possible problem.
Used to run the same tutorial last year on the older version successfully.
.
Created ‎02-23-2016 11:56 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Couple of things to check
1) MapReduce - there is alert in your screenshot. Make sure that Core services are up
2) Another job is consuming all the cluster resources
Created ‎02-23-2016 11:53 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Your mapreduce service is down or execute in pig ambari view with tez, check the box for tez. Start the mapreduce2 service first
Created ‎02-23-2016 11:56 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Couple of things to check
1) MapReduce - there is alert in your screenshot. Make sure that Core services are up
2) Another job is consuming all the cluster resources
Created ‎02-23-2016 11:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Created ‎02-25-2016 08:15 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you for the link to the thread. I switched to another PC that is more powerful, then problem solved. I guess this was because the cluster was busy
Created ‎02-25-2016 08:32 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Please accept the best answer to close the thread.
Created ‎02-23-2016 01:34 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
What is the Status of application started by pig script. You can view it onYarn->ResourceManager UI.
