question How to Skip header row using Pig in Archives of Support Questions (Read Only)

How to Skip header row using Pig

SatishS — Sun, 14 May 2017 06:00:52 GMT

Hi All,

I have requirement where I need to skip the file header on each load using pig.

Is there any way to skip the header row while processing? apart from using RANK?

Thanks,

Satish.

mqureshi — Sun, 14 May 2017 09:17:34 GMT

What's the file type? If its CSV, you can use CSVExcelStorage. Otherwise, the following should work.

A = LOAD 'file_name' as (line:chararray);

B = FILTER A by $0>1;

See the following link for more options on this.

SatishS — Sun, 14 May 2017 20:12:33 GMT

Thanks for these alernative methods to achive the result.