question Re: PIG tranform relations format after first load in Archives of Support Questions (Read Only)

PIG tranform relations format after first load

AndresUrrego — Sun, 18 Aug 2019 03:40:39 GMT

Hey everyone,

My case today is a little weird for me cause according to me I'm running the right scripts but well anyways, the thing is that I need load a file with a char structure but then I need to delete the headers and set the right structure relation.

Here my code:

Finally, I'm trying to perform a sum using this new structure but Pig always according with the log return an error casting the column with the new format as long for salary and int for the year so is like Pig won't be able to get the new structure.

Error:

Could some of our gurus let me know the right way to get a nice transformation and perform my scripts.

thanks so much

Re: PIG tranform relations format after first load

LesterMartin — Fri, 23 Jun 2017 01:37:55 GMT

Instead of

year as (year:int)

try

(int) year as castedYear:int

Re: PIG tranform relations format after first load

AndresUrrego — Sat, 24 Jun 2017 02:18:50 GMT

Thanks so much @Lester Martin I appreciate your help now worked, I replaced my statement using yours and it worked.

salaries_cl = FOREACH salaries_fl GENERATE (int)year as year:int,$1,$2,$3, (long)salary as salary:long;

Weird why the other one didn't work but well thanks so much.