Hi all, I have a text file that look like (the is no header...): Year\tName\tSalary 2015 Marc 100
2016 Marc 200
2017 Marc 300
2015 Lucy 100
2016 Lucy 200
2017 Lucy 300
2015 John 100
2016 John 200
2017 John 300 and I wanto to calculate avg salary for each employee. By executing the following code: a = load '/user/horton/salary' as ( year:int, name:chararray, salary:int );
b = group a by name;
d = FOREACH b GENERATE group as name, AVG( a.salary ) as avgsalary;
describe d;
d { name: chararray, avgsalary: double ) } }
dump d; I obtained the result as aspected: (Marc, 200 ) (Lucy, 200 ) (John, 200 ) But, when I tried the following code: a = load '/user/horton/salary';
b = FOREACH a GENERATE $0 as year:int, $1 as name:chararray, $2 as salary:int;
b { year: int, name: chararray, salary: int }
c = group b by name;
c { group: chararray, b { ( year: int, name: chararray, salary: int ) } }
d = FOREACH c GENERATE group as name, AVG( b.salary ) as avgsalary;
describe d;
d { name: chararray, avgsalary: double ) } }
dump d; I have got an error: Error 0 Exception while executing (Name: c: Local Rearrange[touple]{chararry}(false) - scope 33 Operator key: scope-33) org.apache.pig.beckend.executionengine.ExecException: ERROR while computing average Initial Why? Can anyone help me? In general what is the approach whenever I have a file with a lot of fields and I cannot explicitly declare all the fields name in the LOAD phase? Thanks. Mauro
... View more
