Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Please see the Cloudera blog for information on the Cloudera Response to CVE-2021-4428

pig map reduce is failing

Contributor

I think I am running into a real problem now and need some expert advice.

I am running below scripts on grunt shell and everything is running fine except dump d; I am getting below error.

2016-03-28 20:08:30,686 [main] ERROR org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 1 map reduce job(s) failed!

script running :

a = LOAD '/user/admin/pig/scripts/pig1.csv' USING PigStorage(',') AS (pid chararray,id:int,city:chararray);

describe a ;

b = LIMIT a 100;

C = FOREACH a generate pid, id;

dump C;

d = group C by pid; dump d;

8 REPLIES 8

Please provide the tasks logs for this job from job history server page, I'm hoping that will give us more information.

Contributor

Hi, I can see the job in failed status on 8088 port. But when I click on the logs it gets timeout.. Do you know is there any reason to access the log... Any help will be appreciated. Thanks

Mentor

Go to your http:servername:19888 is job history server UI

Super Guru

you can find the logs at /var/log/pig/

Contributor

there is no pig folder inside /var/log 😞

Mentor

please install pig client.

Contributor

Is it something which i need to do manually ? as I have hortonworks distribution installed on a cloud server... and I have pig view as well.

Mentor

You can install via Ambari, go to your host page and select install pig client