- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Pig job hanging when using FixedWidthStorer
- Labels:
-
Apache Hadoop
-
Apache Pig
Created ‎12-02-2015 10:28 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Using our sandbox to load fixed-width file using pig: https://martin.atlassian.net/wiki/pages/viewpage.action?pageId=21299205
dump or store into works fine; however, when running with FixedWidthStorer, the job hanging--- no error: store employees into '/user/root/emps-regenerated' USING org.apache.pig.piggybank.storage.FixedWidthStorer('-10, 11-30, 31-50, 51-70, 71-','SKIP_HEADER');
2015-12-02 18:35:39,386 [JobControl] INFO org.apache.hadoop.mapreduce.Job - The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1449078859822_0001/ 2015-12-02 18:35:39,387 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_1449078859822_0001 2015-12-02 18:35:39,387 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases employees 2015-12-02 18:35:39,387 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: employees[1,12] C: R: 2015-12-02 18:35:39,400 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete 2015-12-02 18:35:39,400 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Running jobs are [job_1449078859822_0001]
Created ‎12-02-2015 10:42 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Figured it out: Note that the last column must have a defined end though; "71-" will cause an error.
Created ‎12-02-2015 10:42 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Figured it out: Note that the last column must have a defined end though; "71-" will cause an error.
