Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3362 | 05-03-2017 05:13 PM | |
2792 | 05-02-2017 08:38 AM | |
3069 | 05-02-2017 08:13 AM | |
3002 | 04-10-2017 10:51 PM | |
1511 | 03-28-2017 02:27 AM |
12-24-2015
02:25 PM
@James Barney did you try using string or one of the date types for unixgmtfetchtime?
... View more
12-24-2015
02:17 PM
please post errors as an attachment.
... View more
12-24-2015
02:15 PM
this would make an excellent wiki post
... View more
12-24-2015
02:14 PM
@Ancil McBarnett
... View more
12-24-2015
01:58 PM
@Suresh Bonam The string concat example is from the tests of dynamic invokers, I didn't create it. Here are some comments from the source code /** need more tests -- non-String funcs and especially the full path through the pig interpreter. * I tested manually, seems to work, but * should really add more here. It's passing their tests so I assume it does work. I will test it at some point. If you want a speedier answer, perhaps you can ping the Pig mailing list? I'm so glad you brought this up, I see how this feature can be really handy and it's been available since Pig 0.8! Here's some more info on it https://squarecog.wordpress.com/?s=dynamic+invoker.
... View more
12-24-2015
01:48 PM
also for the future, try to tag your posts with more general tags, so instead of ambari-2.1.0, tag with "Ambari" that way we have people following the Ambari topics notified of your questions.
... View more
12-24-2015
01:46 PM
is your server name really ambari-server.example.com? Confirm by going to /etc/ambari-agent/conf/ambari-agent.ini and check under ambari host property. Set it to whatever the node name is. You can get FQDN of the node by running "hostname -f".
... View more
12-24-2015
04:01 AM
1 Kudo
awesome question, didn't even know this exists but digging through Pig source code, here are some examples https://github.com/apache/pig/blob/a44b85a0ab941cd... -- invoking a static method DEFINE StringToLong InvokeForLong('java.lang.Long.valueOf', 'String') ; longs = FOREACH strings GENERATE StringToLong(some_chararray); -- invoking a method on an object DEFINE StringConcat InvokeForString('java.lang.String.concat', 'String String', 'false') ; concatenations = FOREACH strings GENERATE StringConcat(str1, str2);
and here are test cases that you can probably look for examples https://github.com/apache/pig/blob/a44b85a0ab941cd...
... View more
12-24-2015
03:53 AM
some obvious optimizations would be to convert the tables to ORC, you're using text, the tables are pretty large and ORC can help by skipping batches of rows that don't match the criteria. Another thing to look at is table ordering, here's more info https://cwiki.apache.org/confluence/display/Hive/OuterJoinBehavior and https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=34015666
... View more