Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

PIG tranform relations format after first load

Solved Go to solution
Highlighted

PIG tranform relations format after first load

Rising Star

Hey everyone,

My case today is a little weird for me cause according to me I'm running the right scripts but well anyways, the thing is that I need load a file with a char structure but then I need to delete the headers and set the right structure relation.

Here my code:

17463-transformed.png

Finally, I'm trying to perform a sum using this new structure but Pig always according with the log return an error casting the column with the new format as long for salary and int for the year so is like Pig won't be able to get the new structure.

17464-transformed.png

Error:

17465-transformed.png

Could some of our gurus let me know the right way to get a nice transformation and perform my scripts.

thanks so much

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: PIG tranform relations format after first load

Instead of

year as (year:int)

try

(int) year as castedYear:int

View solution in original post

2 REPLIES 2
Highlighted

Re: PIG tranform relations format after first load

Instead of

year as (year:int)

try

(int) year as castedYear:int

View solution in original post

Re: PIG tranform relations format after first load

Rising Star

Thanks so much @Lester Martin I appreciate your help now worked, I replaced my statement using yours and it worked.

salaries_cl = FOREACH salaries_fl GENERATE (int)year as year:int,$1,$2,$3, (long)salary as salary:long;

Weird why the other one didn't work but well thanks so much.

Don't have an account?
Coming from Hortonworks? Activate your account here