Created on 02-23-2016 11:52 AM - edited 08-18-2019 05:38 AM
I'm running Hortonworks version 2.3.2 on VirtualBox, just following dadoop tutorial: how to process data with apache pig (http://zh.hortonworks.com/hadoop-tutorial/how-to-process-data-with-apache-pig/).
Have uploaded batter.csv file to the exact location as per the instruction, and just executed the simplest load Pig statement: batting = LOAD 'Batting.csv' USING PigStorage(',');
The job starts running, but never proceeds. Tried to kill the job, cannot either.
Could anyone please give me some hint of the possible problem.
Used to run the same tutorial last year on the older version successfully.
.
Created 02-23-2016 11:56 AM
Couple of things to check
1) MapReduce - there is alert in your screenshot. Make sure that Core services are up
2) Another job is consuming all the cluster resources
Created 02-23-2016 11:53 AM
Your mapreduce service is down or execute in pig ambari view with tez, check the box for tez. Start the mapreduce2 service first
Created 02-23-2016 11:56 AM
Couple of things to check
1) MapReduce - there is alert in your screenshot. Make sure that Core services are up
2) Another job is consuming all the cluster resources
Created 02-23-2016 11:58 AM
Created 02-25-2016 08:15 AM
Thank you for the link to the thread. I switched to another PC that is more powerful, then problem solved. I guess this was because the cluster was busy
Created 02-25-2016 08:32 AM
Please accept the best answer to close the thread.
Created 02-23-2016 01:34 PM
What is the Status of application started by pig script. You can view it onYarn->ResourceManager UI.