question How to extact two fields( more than one) in pig nested foreach in Archives of Support Questions (Read Only)

How to extact two fields( more than one) in pig nested foreach

bsuresh — Fri, 29 Jan 2016 18:31:44 GMT

Hi All,

According to my requirement i need script like following

A = load '/bsuresh/sample' USING PigStorage(',') as (id,name,sal,deptid);
 B = GROUP A by deptid;
 C = foreach B {
         D = A.name,A.sal;--two fields
	 E = DISTINCT D;
         generate group,COUNT(E);
};

In relation 'D', i am extracting two fields.Where exactly i am facing error.

If i chnaged the script like,which is working fine.

C = foreach B {
         D = A.name; --one filed
 	 E = DISTINCT D;
        generate group,COUNT(E);
};

But i need count based on distinct of two columns .Can any one help me??

Re: How to extact two fields( more than one) in pig nested foreach

aervits — Fri, 29 Jan 2016 20:33:47 GMT

@Suresh Bonamhave you looked at Concat?

Re: How to extact two fields( more than one) in pig nested foreach

bsuresh — Fri, 29 Jan 2016 23:35:35 GMT

Yeah ...@Artem Ervits i got your point.simple but logical.

Re: How to extact two fields( more than one) in pig nested foreach

aervits — Fri, 29 Jan 2016 23:39:31 GMT

@Suresh Bonam let me know if that works for you and close the thread :).