Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Pig job hanging when using FixedWidthStorer

avatar
Rising Star

Using our sandbox to load fixed-width file using pig: https://martin.atlassian.net/wiki/pages/viewpage.action?pageId=21299205

dump or store into works fine; however, when running with FixedWidthStorer, the job hanging--- no error: store employees into '/user/root/emps-regenerated' USING org.apache.pig.piggybank.storage.FixedWidthStorer('-10, 11-30, 31-50, 51-70, 71-','SKIP_HEADER');

2015-12-02 18:35:39,386 [JobControl] INFO org.apache.hadoop.mapreduce.Job - The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1449078859822_0001/ 2015-12-02 18:35:39,387 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_1449078859822_0001 2015-12-02 18:35:39,387 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases employees 2015-12-02 18:35:39,387 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: employees[1,12] C: R: 2015-12-02 18:35:39,400 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete 2015-12-02 18:35:39,400 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Running jobs are [job_1449078859822_0001]

1 ACCEPTED SOLUTION

avatar
Rising Star

Figured it out: Note that the last column must have a defined end though; "71-" will cause an error.

View solution in original post

1 REPLY 1

avatar
Rising Star

Figured it out: Note that the last column must have a defined end though; "71-" will cause an error.