- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to extact two fields( more than one) in pig nested foreach
- Labels:
-
Apache Pig
Created ‎01-29-2016 10:31 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi All,
According to my requirement i need script like following
A = load '/bsuresh/sample' USING PigStorage(',') as (id,name,sal,deptid); B = GROUP A by deptid; C = foreach B { D = A.name,A.sal;--two fields E = DISTINCT D; generate group,COUNT(E); };
In relation 'D', i am extracting two fields.Where exactly i am facing error.
If i chnaged the script like,which is working fine.
C = foreach B { D = A.name; --one filed E = DISTINCT D; generate group,COUNT(E); };
But i need count based on distinct of two columns .Can any one help me??
Created ‎01-29-2016 12:33 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Suresh Bonamhave you looked at Concat?
Created ‎01-29-2016 12:33 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Suresh Bonamhave you looked at Concat?
Created ‎01-29-2016 03:35 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yeah ...@Artem Ervits i got your point.simple but logical.
Created ‎01-29-2016 03:39 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Suresh Bonam let me know if that works for you and close the thread :).
