Support Questions
Find answers, ask questions, and share your expertise

Pig job hanging when using FixedWidthStorer

Solved Go to solution
Highlighted

Pig job hanging when using FixedWidthStorer

Contributor

Using our sandbox to load fixed-width file using pig: https://martin.atlassian.net/wiki/pages/viewpage.action?pageId=21299205

dump or store into works fine; however, when running with FixedWidthStorer, the job hanging--- no error: store employees into '/user/root/emps-regenerated' USING org.apache.pig.piggybank.storage.FixedWidthStorer('-10, 11-30, 31-50, 51-70, 71-','SKIP_HEADER');

2015-12-02 18:35:39,386 [JobControl] INFO org.apache.hadoop.mapreduce.Job - The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1449078859822_0001/ 2015-12-02 18:35:39,387 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_1449078859822_0001 2015-12-02 18:35:39,387 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases employees 2015-12-02 18:35:39,387 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: employees[1,12] C: R: 2015-12-02 18:35:39,400 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete 2015-12-02 18:35:39,400 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Running jobs are [job_1449078859822_0001]

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Pig job hanging when using FixedWidthStorer

Contributor

Figured it out: Note that the last column must have a defined end though; "71-" will cause an error.

View solution in original post

1 REPLY 1
Highlighted

Re: Pig job hanging when using FixedWidthStorer

Contributor

Figured it out: Note that the last column must have a defined end though; "71-" will cause an error.

View solution in original post